Jul 13 07:12:14.174480 ip-10-0-130-143 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.584520    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590466    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590486    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590490    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590494    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590497    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590500    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590503    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 07:12:14.594929 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590507    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590510    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590530    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590533    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590537    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590540    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590543    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590546    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590549    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590553    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590556    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590559    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590563    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590567    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590572    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590575    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590579    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590582    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590586    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590589    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 07:12:14.596227 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590592    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590595    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590598    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590601    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590605    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590609    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590612    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590615    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590617    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590621    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590624    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590627    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590630    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590633    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590635    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590638    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590641    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590644    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590647    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 07:12:14.597160 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590649    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590652    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590655    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590657    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590661    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590663    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590666    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590668    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590671    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590677    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590681    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590684    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590687    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590690    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590693    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590695    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590698    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590701    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590704    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 07:12:14.598134 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590706    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590709    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590712    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590715    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590717    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590720    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590723    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590725    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590728    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590731    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590735    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590738    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590740    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590743    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590746    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590749    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590752    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590754    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590758    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590760    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 07:12:14.599044 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590763    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590766    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590769    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590772    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590775    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590777    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590780    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590785    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590788    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590791    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590793    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590797    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590801    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.590805    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591629    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591636    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591639    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591642    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591645    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591647    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 07:12:14.602261 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591650    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591653    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591657    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591659    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591663    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591665    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591668    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591672    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591675    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591677    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591680    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591686    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591691    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591695    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591698    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591702    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591705    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591707    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591710    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 07:12:14.603206 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591713    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591716    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591718    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591723    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591727    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591730    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591733    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591736    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591738    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591742    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591745    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591748    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591750    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591753    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591756    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591759    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591761    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591765    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591768    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591771    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 07:12:14.604143 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591774    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591777    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591781    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591786    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591788    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591792    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591795    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591798    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591800    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591803    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591806    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591809    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591812    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591815    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591818    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591821    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591823    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591826    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591829    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591831    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 07:12:14.605770 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591834    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591837    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591840    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591843    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591845    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591848    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591851    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591853    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591856    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591859    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591862    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591866    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591868    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591871    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591874    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591876    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591879    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591882    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591885    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591888    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 07:12:14.606727 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591891    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591894    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591897    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591900    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591902    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591905    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591908    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591911    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591914    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591917    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591919    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591922    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591925    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.591927    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592422    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592429    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592433    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592437    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592440    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592443    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 07:12:14.607672 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592447    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592450    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592453    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592456    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592459    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592462    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592466    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592469    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592471    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592474    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592481    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592487    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592491    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592496    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592500    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592503    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592506    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592529    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 07:12:14.609078 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592532    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592535    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592539    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592542    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592546    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592549    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592552    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592555    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592558    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592561    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592564    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592567    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592570    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592573    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592575    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592578    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592581    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592584    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592586    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592589    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 07:12:14.610018 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592592    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592595    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592598    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592600    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592603    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592610    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592613    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592616    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592619    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592622    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592624    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592627    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592630    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592633    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592636    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592639    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592641    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592644    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592647    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 07:12:14.611221 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592653    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592657    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592660    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592663    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592666    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592669    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592672    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592674    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592677    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592680    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592683    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592685    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592689    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592694    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592696    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592699    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592702    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592705    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592710    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592713    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592716    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 07:12:14.612183 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592719    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592722    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592724    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592727    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592730    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592732    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592735    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592738    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592741    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592743    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592746    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592749    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592751    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592754    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.592757    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592842    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592850    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592857    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592862    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592866    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592870    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 07:12:14.613357 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592875    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592879    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592883    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592888    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592891    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592895    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592898    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592902    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592907    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592911    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592915    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592918    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592923    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592926    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592929    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592932    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592936    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592940    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592943    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592947    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592950    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592953    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592956    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592959    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 07:12:14.614770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592963    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592966    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592971    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592974    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592977    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592980    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592984    2565 flags.go:64] FLAG: --enable-server="true"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592987    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592992    2565 flags.go:64] FLAG: --event-burst="100"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592995    2565 flags.go:64] FLAG: --event-qps="50"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.592998    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593003    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593006    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593011    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593014    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593017    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593022    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593025    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593028    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593032    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593036    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593039    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593042    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593045    2565 flags.go:64] FLAG: --feature-gates=""
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593049    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 07:12:14.616877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593052    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593056    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593059    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593063    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593066    2565 flags.go:64] FLAG: --help="false"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593069    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-130-143.ec2.internal"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593073    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593076    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593079    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593083    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593087    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593090    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593093    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593096    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593098    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593101    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593105    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593108    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593114    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593117    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593120    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593123    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593126    2565 flags.go:64] FLAG: --lock-file=""
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593131    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 07:12:14.618295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593135    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593138    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593143    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593147    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593150    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593153    2565 flags.go:64] FLAG: --logging-format="text"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593156    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593160    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593163    2565 flags.go:64] FLAG: --manifest-url=""
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593166    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593172    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593175    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593179    2565 flags.go:64] FLAG: --max-pods="110"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593182    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593185    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593188    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593191    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593195    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593198    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593201    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593210    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593214    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593217    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 07:12:14.619935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593221    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593224    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593230    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593233    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593238    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593242    2565 flags.go:64] FLAG: --port="10250"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593245    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593248    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0549e778a024aa265"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593253    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593257    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593260    2565 flags.go:64] FLAG: --register-node="true"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593263    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593267    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593270    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593274    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593277    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593286    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593290    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593293    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593296    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593310    2565 flags.go:64] FLAG: --runonce="false"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593314    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593317    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593320    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593323    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 07:12:14.621110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593326    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593330    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593333    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593336    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593340    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593343    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593346    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593349    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593352    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593355    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593358    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593366    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593369    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593372    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593377    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593382    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593385    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593388    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593392    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593395    2565 flags.go:64] FLAG: --v="2"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593399    2565 flags.go:64] FLAG: --version="false"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593404    2565 flags.go:64] FLAG: --vmodule=""
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593409    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.593413    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593590    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 07:12:14.622757 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593595    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593599    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593602    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593605    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593608    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593611    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593614    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593617    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593619    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593622    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593626    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593629    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593632    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593635    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593638    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593641    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593644    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593647    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593652    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593655    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 07:12:14.623937 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593658    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593660    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593665    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593668    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593671    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593673    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593676    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593679    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593682    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593685    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593688    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593691    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593693    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593696    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593699    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593701    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593704    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593707    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593709    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 07:12:14.625344 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593712    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593715    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593718    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593721    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593723    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593726    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593728    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593731    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593734    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593737    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593740    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593744    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593747    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593750    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593752    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593757    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593762    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593767    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593771    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593775    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 07:12:14.626286 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593779    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593783    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593788    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593794    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593799    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593803    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593806    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593809    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593811    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593814    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593817    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593820    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593822    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593825    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593828    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593831    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593834    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593836    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593840    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593842    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 07:12:14.628422 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593845    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593848    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593851    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593855    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593860    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593863    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593866    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593872    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593875    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593879    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593883    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593886    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593889    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593892    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593896    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593898    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593902    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593905    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 07:12:14.629371 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.593908    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.594585    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.601716    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.601736    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.601759    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.601766    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601827    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601833    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601836    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601840    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601843    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601846    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601849    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601852    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601855    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 07:12:14.631034 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601858    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601861    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601864    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601867    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601870    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601873    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601876    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601878    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601881    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601884    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601887    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601889    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601892    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601895    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601897    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601901    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601904    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601907    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601910    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601912    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 07:12:14.631978 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601916    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601919    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601923    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601925    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601928    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601931    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601934    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601937    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601940    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601943    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601946    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601948    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601951    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601954    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601957    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601960    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601963    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601975    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601979    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601983    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 07:12:14.632939 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601985    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601988    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601992    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601995    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.601997    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602001    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602006    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602009    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602013    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602016    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602019    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602022    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602026    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602029    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602032    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602035    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602038    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602040    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602043    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 07:12:14.633889 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602046    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602049    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602052    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602054    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602057    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602060    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602063    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602065    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602068    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602071    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602074    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602076    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602079    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602082    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602084    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602089    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602092    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602096    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602099    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 07:12:14.636168 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602102    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602105    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602109    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602112    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602115    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602119    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602124    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602127    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602130    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602133    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602136    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602139    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.602145    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602267    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602271    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 07:12:14.637341 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602274    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602277    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602280    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602283    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602286    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602289    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602292    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602295    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602298    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602301    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602303    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602306    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602309    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602313    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602317    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602320    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602323    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602326    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602329    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 07:12:14.638563 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602332    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602335    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602339    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602342    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602345    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602348    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602350    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602353    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602356    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602358    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602361    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602363    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602366    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602369    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602372    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602374    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602377    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602380    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602382    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602386    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 07:12:14.639786 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602388    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602391    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602394    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602396    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602399    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602401    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602404    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602406    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602409    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602412    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602414    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602417    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602420    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602423    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602426    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602430    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602432    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602435    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602437    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602441    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 07:12:14.772931 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602443    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 07:12:14.691251 ip-10-0-130-143 systemd[1]: Started Kubernetes Kubelet.
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602446    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602449    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602451    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602454    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602461    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602464    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602467    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602469    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602472    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602477    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602480    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602485    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602488    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602491    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602494    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602498    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602501    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602504    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 07:12:14.774162 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602523    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602528    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602531    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602534    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602537    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602540    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602543    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602546    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602549    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602553    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602556    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602559    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602562    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602564    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602567    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602570    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602573    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602576    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 07:12:14.776243 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:14.602580    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.602586    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.602718    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.604855    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.606181    2565 server.go:1019] "Starting client certificate rotation"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.608633    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.611699    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.611930    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.612397    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.659011    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.661343    2565 log.go:25] "Validated CRI v1 image API"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.662214    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 07:12:14.777387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.664921    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b8249d7a-d4cb-47d5-a3a8-1f9c13990af6:/dev/nvme0n1p4 e7a45ace-777d-46d2-9837-6a43e9e1fe49:/dev/nvme0n1p3]
Jul 13 07:12:14.778763 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.664941    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 07:12:14.778998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.671594    2565 manager.go:216] Machine: {Timestamp:2026-07-13 07:12:14.670057339 +0000 UTC m=+0.376934648 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095768 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27235ef42f1f70fee33c68ab723e81 SystemUUID:ec27235e-f42f-1f70-fee3-3c68ab723e81 BootID:0f736af1-cb45-4e86-9497-5d5615c87b09 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:56:79:bd:22:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:56:79:bd:22:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:9f:fe:a3:4b:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 07:12:14.778998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.671713    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 07:12:14.778998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.671810    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 07:12:14.778998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.674709    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 07:12:14.778998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.674742    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 07:12:14.778998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.675441    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 07:12:14.778998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.675450    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 07:12:14.778998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.675459    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.676116    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.677354    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.677880    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.680409    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.680573    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.680607    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.680619    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.680632    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.680642    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.680650    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.681080    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.681108    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.683376    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.685215    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.685246    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.685394    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.685407    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.685414    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.685420    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.685428    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.685435    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.686008    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.686015    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.686028    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.686034    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.686048    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.686056    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.686971    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.686978    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.690331    2565 server.go:1268] "Started kubelet"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.690641    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.690629    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.690707    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.692053    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.693216    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.696995    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.700069    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 07:12:14.780638 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.700295    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.696962    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-143.ec2.internal.18c1c7e9de89cdd1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-143.ec2.internal,UID:ip-10-0-130-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-143.ec2.internal,},FirstTimestamp:2026-07-13 07:12:14.690307537 +0000 UTC m=+0.397184835,LastTimestamp:2026-07-13 07:12:14.690307537 +0000 UTC m=+0.397184835,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-143.ec2.internal,}"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.700710    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.705530    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.705648    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.705530    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706272    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706291    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706276    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706440    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706464    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706627    2565 factory.go:55] Registering systemd factory
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706699    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706957    2565 factory.go:153] Registering CRI-O factory
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.706973    2565 factory.go:223] Registration of the crio container factory successfully
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.707032    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.707058    2565 factory.go:103] Registering Raw factory
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.707075    2565 manager.go:1196] Started watching for new ooms in manager
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.708020    2565 manager.go:349] Starting recovery of all containers
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.709053    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.709111    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.724923    2565 manager.go:354] Recovery completed
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.731241    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.733513    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.733555    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.733566    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientPID"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.734413    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8ndr6"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.734529    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.734539    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.734557    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.734857    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.735699    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 07:12:14.782426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.735727    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.735738    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientPID"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.735901    2565 policy_none.go:49] "None policy: Start"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.735916    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.735927    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.736973    2565 policy_none.go:47] "Start"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.747195    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-143.ec2.internal.18c1c7e9e11d6f84  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-143.ec2.internal,UID:ip-10-0-130-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-143.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-143.ec2.internal,},FirstTimestamp:2026-07-13 07:12:14.733537156 +0000 UTC m=+0.440414459,LastTimestamp:2026-07-13 07:12:14.733537156 +0000 UTC m=+0.440414459,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-143.ec2.internal,}"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.748460    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8ndr6"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.753076    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-143.ec2.internal.18c1c7e9e11dca48  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-143.ec2.internal,UID:ip-10-0-130-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-143.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-143.ec2.internal,},FirstTimestamp:2026-07-13 07:12:14.733560392 +0000 UTC m=+0.440437692,LastTimestamp:2026-07-13 07:12:14.733560392 +0000 UTC m=+0.440437692,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-143.ec2.internal,}"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.783233    2565 manager.go:337] "Starting Device Plugin manager"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.783268    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.783279    2565 server.go:87] "Starting device plugin registration server"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.783633    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.783646    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.783759    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.783864    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 07:12:14.783881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.783874    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.794439    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.794506    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.889644    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.890826    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.890861    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.890876    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientPID"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.890929    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-143.ec2.internal"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.897622    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-143.ec2.internal"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.897648    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-143.ec2.internal\": node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.912847    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.914200    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.914238    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.914264    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.914299    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:14.917350    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:14.982806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:14.918258    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.014595    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal"]
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.014684    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.015817    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.015843    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.015853    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientPID"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.017140    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.017295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.017326    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.018089    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.018113    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.018123    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientPID"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.018333    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.018344    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.018352    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientPID"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.019562    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.019772    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.019805    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.020569    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.020601    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.020619    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeHasSufficientPID"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.042226    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-143.ec2.internal\" not found" node="ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.047190    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-143.ec2.internal\" not found" node="ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.109168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec08dae2cc59d2e3b6f0cfcdea507328-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal\" (UID: \"ec08dae2cc59d2e3b6f0cfcdea507328\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.109200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec08dae2cc59d2e3b6f0cfcdea507328-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal\" (UID: \"ec08dae2cc59d2e3b6f0cfcdea507328\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.109218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b12fa66d6056d22316fd135bb16dacac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-143.ec2.internal\" (UID: \"b12fa66d6056d22316fd135bb16dacac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.145442 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.119981    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:15.314411 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.209752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec08dae2cc59d2e3b6f0cfcdea507328-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal\" (UID: \"ec08dae2cc59d2e3b6f0cfcdea507328\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.314411 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.209810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec08dae2cc59d2e3b6f0cfcdea507328-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal\" (UID: \"ec08dae2cc59d2e3b6f0cfcdea507328\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.314411 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.209837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b12fa66d6056d22316fd135bb16dacac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-143.ec2.internal\" (UID: \"b12fa66d6056d22316fd135bb16dacac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.314411 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.209760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec08dae2cc59d2e3b6f0cfcdea507328-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal\" (UID: \"ec08dae2cc59d2e3b6f0cfcdea507328\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.314411 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.209887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b12fa66d6056d22316fd135bb16dacac-config\") pod \"kube-apiserver-proxy-ip-10-0-130-143.ec2.internal\" (UID: \"b12fa66d6056d22316fd135bb16dacac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.314411 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.209913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec08dae2cc59d2e3b6f0cfcdea507328-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal\" (UID: \"ec08dae2cc59d2e3b6f0cfcdea507328\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.314411 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.220620    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:15.486361 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.321101    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:15.486361 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.345120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.486361 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.350494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.486361 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.421857    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:15.522533 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.522493    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:15.612087 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.611985    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 07:12:15.612579 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.612170    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 07:12:15.622966 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.622939    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-143.ec2.internal\" not found"
Jul 13 07:12:15.636392 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.636368    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 07:12:15.638019 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.637993    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 07:12:15.684285 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.684246    2565 apiserver.go:52] "Watching apiserver"
Jul 13 07:12:15.692676 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.692651    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 07:12:15.693054 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.693031    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6","openshift-dns/node-resolver-mz4lc","openshift-image-registry/node-ca-qklsz","openshift-network-diagnostics/network-check-target-459sm","openshift-network-operator/iptables-alerter-wfqt4","kube-system/global-pull-secret-syncer-6gdkr","kube-system/konnectivity-agent-q5whj","openshift-cluster-node-tuning-operator/tuned-tjj26","openshift-multus/multus-additional-cni-plugins-4x792","openshift-multus/multus-d5lkr","openshift-multus/network-metrics-daemon-g6mws","openshift-ovn-kubernetes/ovnkube-node-dblg6"]
Jul 13 07:12:15.694538 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.694518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.695829 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.695805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.696903 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.696882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.697042 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.697021    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 07:12:15.697269 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.697254    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 07:12:15.697358 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.697309    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 07:12:15.697494 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.697481    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2dvmw\""
Jul 13 07:12:15.697915 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.697896    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:15.698008 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.697970    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 07:12:15.698057 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.697969    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:15.698202 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.698185    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zfml9\""
Jul 13 07:12:15.698245 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.698208    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 07:12:15.698995 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.698976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.699131 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.699109    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 07:12:15.699330 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.699311    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6qh8s\""
Jul 13 07:12:15.700390 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.699848    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 07:12:15.700390 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.699991    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 07:12:15.701884 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.701263    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 07:12:15.701884 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.701389    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 07:12:15.701884 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.701558    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 07:12:15.702144 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.701976    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wwjwx\""
Jul 13 07:12:15.702390 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.702274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:15.703494 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.703475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.704792 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.704763    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 07:12:15.704792 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.704764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.704952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.704815    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cvtq7\""
Jul 13 07:12:15.704952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.704824    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 07:12:15.705709 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.705693    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.705791 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.705734    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 07:12:15.705887 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.705865    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nhb79\""
Jul 13 07:12:15.705962 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.705901    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 07:12:15.705962 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.705926    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 07:12:15.705962 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.705958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.707009 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.706992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:15.707127 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.707104    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:15.707259 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.707240    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 07:12:15.707359 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.707341    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 07:12:15.707456 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.707441    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 07:12:15.707601 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.707587    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 07:12:15.707969 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.707956    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 07:12:15.708188 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.708173    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvzbt\""
Jul 13 07:12:15.708435 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.708421    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.709177 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.709160    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 07:12:15.709410 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.709394    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b77bd\""
Jul 13 07:12:15.709715 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.709698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.709808 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.709788    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:15.712101 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8h2k\" (UniqueName: \"kubernetes.io/projected/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-kube-api-access-z8h2k\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.712155 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-var-lib-kubelet\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.712155 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-socket-dir-parent\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712155 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8czjn\" (UniqueName: \"kubernetes.io/projected/c8c26a1d-921b-489c-9928-40aa9b17cb16-kube-api-access-8czjn\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.712307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-device-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.712307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0852ae9a-0b67-4d99-8655-e629550683b8-cni-binary-copy\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-cni-multus\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-etc-kubernetes\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:15.712483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3fb64be-7807-4db6-872b-9efab6a90d01-agent-certs\") pod \"konnectivity-agent-q5whj\" (UID: \"b3fb64be-7807-4db6-872b-9efab6a90d01\") " pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:15.712483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-host\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.712483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-netns\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0852ae9a-0b67-4d99-8655-e629550683b8-multus-daemon-config\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv6kg\" (UniqueName: \"kubernetes.io/projected/bc1b4053-e0be-46ae-acae-13031176aaed-kube-api-access-vv6kg\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.712483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-cni-bin\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhs2f\" (UniqueName: \"kubernetes.io/projected/46cfca3b-e76c-46a7-a4ab-196e727c3e85-kube-api-access-qhs2f\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-socket-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-system-cni-dir\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-kubelet\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqft\" (UniqueName: \"kubernetes.io/projected/d76d51ba-aefd-44a7-8e4d-e808004fd437-kube-api-access-5kqft\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-multus-certs\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-tuned\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-host\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysconfig\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-kubernetes\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.712774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysctl-conf\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-cnibin\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-os-release\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-system-cni-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-serviceca\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-modprobe-d\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712899    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdqpr\" (UniqueName: \"kubernetes.io/projected/0852ae9a-0b67-4d99-8655-e629550683b8-kube-api-access-fdqpr\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8c26a1d-921b-489c-9928-40aa9b17cb16-tmp-dir\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.712991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-cni-binary-copy\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-cni-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysctl-d\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713096    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 07:12:15.713221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc1b4053-e0be-46ae-acae-13031176aaed-iptables-alerter-script\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc1b4053-e0be-46ae-acae-13031176aaed-host-slash\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-tmp\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713172    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-sys-fs\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713217    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3fb64be-7807-4db6-872b-9efab6a90d01-konnectivity-ca\") pod \"konnectivity-agent-q5whj\" (UID: \"b3fb64be-7807-4db6-872b-9efab6a90d01\") " pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb24g\" (UniqueName: \"kubernetes.io/projected/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-kube-api-access-lb24g\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-registration-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjqsw\" (UniqueName: \"kubernetes.io/projected/687091fa-916b-4b89-bfbf-a837bd8828bb-kube-api-access-zjqsw\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-sys\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-os-release\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-systemd\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-lib-modules\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.713725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-cnibin\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.714227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:15.714227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-k8s-cni-cncf-io\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.714227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-hostroot\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.714227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-run\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.714227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-conf-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.714227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.713564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8c26a1d-921b-489c-9928-40aa9b17cb16-hosts-file\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.714497 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.714327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8j845\""
Jul 13 07:12:15.714497 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.714338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 07:12:15.714497 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.714344    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 07:12:15.714497 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.714386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 07:12:15.720408 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.720392    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 07:12:15.720494 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.720478    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal"
Jul 13 07:12:15.720699 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.720682    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal"]
Jul 13 07:12:15.723790 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.723739    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 07:12:15.729407 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.729390    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 07:12:15.729505 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.729440    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal"]
Jul 13 07:12:15.744107 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.744085    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5blc8"
Jul 13 07:12:15.751318 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.751287    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5blc8"
Jul 13 07:12:15.751465 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.751288    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 07:07:15 +0000 UTC" deadline="2028-02-26 13:26:54.431256252 +0000 UTC"
Jul 13 07:12:15.751465 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.751348    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14238h14m38.67991229s"
Jul 13 07:12:15.807065 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.807039    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 07:12:15.813817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.813774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-device-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.813817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.813815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0852ae9a-0b67-4d99-8655-e629550683b8-cni-binary-copy\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.813842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-cni-multus\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.813871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-etc-kubernetes\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.813928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-etc-kubernetes\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.813929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-device-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.813970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-cni-multus\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-kubelet\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3fb64be-7807-4db6-872b-9efab6a90d01-agent-certs\") pod \"konnectivity-agent-q5whj\" (UID: \"b3fb64be-7807-4db6-872b-9efab6a90d01\") " pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:15.814124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-host\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-netns\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.814157    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0852ae9a-0b67-4d99-8655-e629550683b8-multus-daemon-config\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv6kg\" (UniqueName: \"kubernetes.io/projected/bc1b4053-e0be-46ae-acae-13031176aaed-kube-api-access-vv6kg\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-netns\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-host\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.814261    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs podName:46cfca3b-e76c-46a7-a4ab-196e727c3e85 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:16.314234805 +0000 UTC m=+2.021112087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs") pod "network-metrics-daemon-g6mws" (UID: "46cfca3b-e76c-46a7-a4ab-196e727c3e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-run-ovn-kubernetes\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-cni-netd\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-cni-bin\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhs2f\" (UniqueName: \"kubernetes.io/projected/46cfca3b-e76c-46a7-a4ab-196e727c3e85-kube-api-access-qhs2f\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-cni-bin\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.814730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814562    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovn-node-metrics-cert\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-socket-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0852ae9a-0b67-4d99-8655-e629550683b8-cni-binary-copy\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-system-cni-dir\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-system-cni-dir\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0852ae9a-0b67-4d99-8655-e629550683b8-multus-daemon-config\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-socket-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-etc-selinux\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-kubelet\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-systemd\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqft\" (UniqueName: \"kubernetes.io/projected/d76d51ba-aefd-44a7-8e4d-e808004fd437-kube-api-access-5kqft\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.815532 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-slash\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-var-lib-kubelet\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.814978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-cni-bin\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-multus-certs\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-tuned\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-host\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-multus-certs\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysconfig\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-kubernetes\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysconfig\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysctl-conf\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-host\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-cnibin\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-cnibin\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-kubernetes\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.816255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-os-release\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-system-cni-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-serviceca\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-modprobe-d\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysctl-conf\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdqpr\" (UniqueName: \"kubernetes.io/projected/0852ae9a-0b67-4d99-8655-e629550683b8-kube-api-access-fdqpr\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8c26a1d-921b-489c-9928-40aa9b17cb16-tmp-dir\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-systemd-units\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815513    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-modprobe-d\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-cni-binary-copy\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-system-cni-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-os-release\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.817120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-cni-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-run-netns\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-serviceca\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-etc-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysctl-d\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815955    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.815984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc1b4053-e0be-46ae-acae-13031176aaed-iptables-alerter-script\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc1b4053-e0be-46ae-acae-13031176aaed-host-slash\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-ovn\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d76d51ba-aefd-44a7-8e4d-e808004fd437-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-cni-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-env-overrides\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-tmp\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-cni-binary-copy\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.817883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-sys-fs\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc1b4053-e0be-46ae-acae-13031176aaed-host-slash\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8c26a1d-921b-489c-9928-40aa9b17cb16-tmp-dir\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-sysctl-d\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-sys-fs\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816339    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3fb64be-7807-4db6-872b-9efab6a90d01-konnectivity-ca\") pod \"konnectivity-agent-q5whj\" (UID: \"b3fb64be-7807-4db6-872b-9efab6a90d01\") " pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb24g\" (UniqueName: \"kubernetes.io/projected/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-kube-api-access-lb24g\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovnkube-config\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-registration-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjqsw\" (UniqueName: \"kubernetes.io/projected/687091fa-916b-4b89-bfbf-a837bd8828bb-kube-api-access-zjqsw\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-registration-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d76d51ba-aefd-44a7-8e4d-e808004fd437-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-sys\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.818623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-os-release\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc1b4053-e0be-46ae-acae-13031176aaed-iptables-alerter-script\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a07db2fc-5703-4db6-b9b1-93486b584ec4-dbus\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.816977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-systemd\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-lib-modules\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-cnibin\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-log-socket\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-k8s-cni-cncf-io\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-os-release\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-hostroot\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817247    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-run\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-systemd\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b3fb64be-7807-4db6-872b-9efab6a90d01-konnectivity-ca\") pod \"konnectivity-agent-q5whj\" (UID: \"b3fb64be-7807-4db6-872b-9efab6a90d01\") " pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:15.819698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-hostroot\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-conf-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-run\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8c26a1d-921b-489c-9928-40aa9b17cb16-hosts-file\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-sys\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-var-lib-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-host-run-k8s-cni-cncf-io\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovnkube-script-lib\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-lib-modules\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/687091fa-916b-4b89-bfbf-a837bd8828bb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg76g\" (UniqueName: \"kubernetes.io/projected/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-kube-api-access-xg76g\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a07db2fc-5703-4db6-b9b1-93486b584ec4-kubelet-config\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8c26a1d-921b-489c-9928-40aa9b17cb16-hosts-file\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.820262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8h2k\" (UniqueName: \"kubernetes.io/projected/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-kube-api-access-z8h2k\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-var-lib-kubelet\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817640    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-conf-dir\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-socket-dir-parent\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czjn\" (UniqueName: \"kubernetes.io/projected/c8c26a1d-921b-489c-9928-40aa9b17cb16-kube-api-access-8czjn\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-node-log\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-multus-socket-dir-parent\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0852ae9a-0b67-4d99-8655-e629550683b8-cnibin\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.817899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-var-lib-kubelet\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.818777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b3fb64be-7807-4db6-872b-9efab6a90d01-agent-certs\") pod \"konnectivity-agent-q5whj\" (UID: \"b3fb64be-7807-4db6-872b-9efab6a90d01\") " pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.818975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-etc-tuned\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.820767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.819921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-tmp\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.824698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.824669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhs2f\" (UniqueName: \"kubernetes.io/projected/46cfca3b-e76c-46a7-a4ab-196e727c3e85-kube-api-access-qhs2f\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:15.825211 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.825187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv6kg\" (UniqueName: \"kubernetes.io/projected/bc1b4053-e0be-46ae-acae-13031176aaed-kube-api-access-vv6kg\") pod \"iptables-alerter-wfqt4\" (UID: \"bc1b4053-e0be-46ae-acae-13031176aaed\") " pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:15.825392 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.825371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqft\" (UniqueName: \"kubernetes.io/projected/d76d51ba-aefd-44a7-8e4d-e808004fd437-kube-api-access-5kqft\") pod \"multus-additional-cni-plugins-4x792\" (UID: \"d76d51ba-aefd-44a7-8e4d-e808004fd437\") " pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:15.825745 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.825710    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 07:12:15.825745 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.825737    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 07:12:15.825745 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.825753    2565 projected.go:196] Error preparing data for projected volume kube-api-access-ctz69 for pod openshift-network-diagnostics/network-check-target-459sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:15.826055 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.825843    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69 podName:a24688f8-8334-4ec7-bd1b-6cad27ecc472 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:16.325816217 +0000 UTC m=+2.032693504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ctz69" (UniqueName: "kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69") pod "network-check-target-459sm" (UID: "a24688f8-8334-4ec7-bd1b-6cad27ecc472") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:15.827635 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.827609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdqpr\" (UniqueName: \"kubernetes.io/projected/0852ae9a-0b67-4d99-8655-e629550683b8-kube-api-access-fdqpr\") pod \"multus-d5lkr\" (UID: \"0852ae9a-0b67-4d99-8655-e629550683b8\") " pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.828401 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.828371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjqsw\" (UniqueName: \"kubernetes.io/projected/687091fa-916b-4b89-bfbf-a837bd8828bb-kube-api-access-zjqsw\") pod \"aws-ebs-csi-driver-node-cmzs6\" (UID: \"687091fa-916b-4b89-bfbf-a837bd8828bb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:15.828494 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.828379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb24g\" (UniqueName: \"kubernetes.io/projected/7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703-kube-api-access-lb24g\") pod \"tuned-tjj26\" (UID: \"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703\") " pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:15.828494 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.828416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8czjn\" (UniqueName: \"kubernetes.io/projected/c8c26a1d-921b-489c-9928-40aa9b17cb16-kube-api-access-8czjn\") pod \"node-resolver-mz4lc\" (UID: \"c8c26a1d-921b-489c-9928-40aa9b17cb16\") " pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:15.828703 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.828683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8h2k\" (UniqueName: \"kubernetes.io/projected/3f3811e3-9b16-4cb2-b09e-2d4786a481b3-kube-api-access-z8h2k\") pod \"node-ca-qklsz\" (UID: \"3f3811e3-9b16-4cb2-b09e-2d4786a481b3\") " pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:15.850709 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.850677    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d5lkr"
Jul 13 07:12:15.918645 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-run-netns\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918645 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-etc-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918645 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918624    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-ovn\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918645 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-env-overrides\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-ovn\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-run-netns\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovnkube-config\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-etc-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a07db2fc-5703-4db6-b9b1-93486b584ec4-dbus\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a07db2fc-5703-4db6-b9b1-93486b584ec4-dbus\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-log-socket\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-var-lib-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-log-socket\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-var-lib-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.918975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovnkube-script-lib\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.918998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg76g\" (UniqueName: \"kubernetes.io/projected/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-kube-api-access-xg76g\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a07db2fc-5703-4db6-b9b1-93486b584ec4-kubelet-config\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-node-log\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-kubelet\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919150    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a07db2fc-5703-4db6-b9b1-93486b584ec4-kubelet-config\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-run-ovn-kubernetes\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-cni-netd\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovn-node-metrics-cert\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-kubelet\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-systemd\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovnkube-config\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.919636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-slash\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-cni-bin\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-env-overrides\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.919419    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-systemd-units\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:15.919540    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret podName:a07db2fc-5703-4db6-b9b1-93486b584ec4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:16.419520377 +0000 UTC m=+2.126397662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret") pod "global-pull-secret-syncer-6gdkr" (UID: "a07db2fc-5703-4db6-b9b1-93486b584ec4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovnkube-script-lib\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-cni-bin\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-systemd\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-run-openvswitch\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-slash\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-run-ovn-kubernetes\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-host-cni-netd\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920185 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.919749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-node-log\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.920670 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.920194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-systemd-units\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.924334 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.924308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-ovn-node-metrics-cert\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.929210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.929188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg76g\" (UniqueName: \"kubernetes.io/projected/6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46-kube-api-access-xg76g\") pod \"ovnkube-node-dblg6\" (UID: \"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46\") " pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:15.938220 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:15.938186    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec08dae2cc59d2e3b6f0cfcdea507328.slice/crio-73400c7e029bac1971441d96f60f29bc04870b3c15aa5da5bccc0b9a97a3c4c3 WatchSource:0}: Error finding container 73400c7e029bac1971441d96f60f29bc04870b3c15aa5da5bccc0b9a97a3c4c3: Status 404 returned error can't find the container with id 73400c7e029bac1971441d96f60f29bc04870b3c15aa5da5bccc0b9a97a3c4c3
Jul 13 07:12:15.938709 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:15.938681    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12fa66d6056d22316fd135bb16dacac.slice/crio-654391ff00dbc0714f9601be3fc008a61a107c32c0dd2218dfaefcd5ca0cb0bf WatchSource:0}: Error finding container 654391ff00dbc0714f9601be3fc008a61a107c32c0dd2218dfaefcd5ca0cb0bf: Status 404 returned error can't find the container with id 654391ff00dbc0714f9601be3fc008a61a107c32c0dd2218dfaefcd5ca0cb0bf
Jul 13 07:12:15.943936 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:15.943916    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 07:12:16.022832 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.022795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6"
Jul 13 07:12:16.033362 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:16.033336    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687091fa_916b_4b89_bfbf_a837bd8828bb.slice/crio-5ea80966bc7e7ad88584167dbe893323a0e1b28fb0a328756b7442d47994ca4a WatchSource:0}: Error finding container 5ea80966bc7e7ad88584167dbe893323a0e1b28fb0a328756b7442d47994ca4a: Status 404 returned error can't find the container with id 5ea80966bc7e7ad88584167dbe893323a0e1b28fb0a328756b7442d47994ca4a
Jul 13 07:12:16.038797 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.038776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mz4lc"
Jul 13 07:12:16.046331 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:16.046304    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c26a1d_921b_489c_9928_40aa9b17cb16.slice/crio-42c877fa87d659bed6240aa6c3ff32e7bcb8f196cad8b4d77d937b14f6ba83eb WatchSource:0}: Error finding container 42c877fa87d659bed6240aa6c3ff32e7bcb8f196cad8b4d77d937b14f6ba83eb: Status 404 returned error can't find the container with id 42c877fa87d659bed6240aa6c3ff32e7bcb8f196cad8b4d77d937b14f6ba83eb
Jul 13 07:12:16.055741 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.055718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qklsz"
Jul 13 07:12:16.063808 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:16.063778    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3811e3_9b16_4cb2_b09e_2d4786a481b3.slice/crio-5b0922cc75805b50c11ac7bc34fbf521cd408210b810445a574e269b5a6bf890 WatchSource:0}: Error finding container 5b0922cc75805b50c11ac7bc34fbf521cd408210b810445a574e269b5a6bf890: Status 404 returned error can't find the container with id 5b0922cc75805b50c11ac7bc34fbf521cd408210b810445a574e269b5a6bf890
Jul 13 07:12:16.069468 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.069450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wfqt4"
Jul 13 07:12:16.076903 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:16.076877    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1b4053_e0be_46ae_acae_13031176aaed.slice/crio-0c54ba34550efdb0e1ba2aa3baf1d612cb47bf233ff9d8ea6b3bc91f294ec3f9 WatchSource:0}: Error finding container 0c54ba34550efdb0e1ba2aa3baf1d612cb47bf233ff9d8ea6b3bc91f294ec3f9: Status 404 returned error can't find the container with id 0c54ba34550efdb0e1ba2aa3baf1d612cb47bf233ff9d8ea6b3bc91f294ec3f9
Jul 13 07:12:16.088357 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.088330    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:16.093626 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.093605    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjj26"
Jul 13 07:12:16.096556 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:16.096526    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fb64be_7807_4db6_872b_9efab6a90d01.slice/crio-6fdaede60760ef67f405eb5fb462b076ad871ea7502d9ab59ce42197fbdb5000 WatchSource:0}: Error finding container 6fdaede60760ef67f405eb5fb462b076ad871ea7502d9ab59ce42197fbdb5000: Status 404 returned error can't find the container with id 6fdaede60760ef67f405eb5fb462b076ad871ea7502d9ab59ce42197fbdb5000
Jul 13 07:12:16.102278 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:16.102254    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6dc4dc_4ca5_4170_9a07_1ee62bd1e703.slice/crio-1a2ce92cfdbe13d3c98dd2a268ea2c56a4f3a3edf92d8a7eb7d0f8fbc5860cd5 WatchSource:0}: Error finding container 1a2ce92cfdbe13d3c98dd2a268ea2c56a4f3a3edf92d8a7eb7d0f8fbc5860cd5: Status 404 returned error can't find the container with id 1a2ce92cfdbe13d3c98dd2a268ea2c56a4f3a3edf92d8a7eb7d0f8fbc5860cd5
Jul 13 07:12:16.113926 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.113900    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4x792"
Jul 13 07:12:16.158310 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.158268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:16.166881 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:16.166854    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebe5ef4_aaf1_4526_89a3_79d7e04c6f46.slice/crio-024480ad7c2d9e3ba96e46d84fbb7dc2395b1cb13de712c18bb31aa6040a4940 WatchSource:0}: Error finding container 024480ad7c2d9e3ba96e46d84fbb7dc2395b1cb13de712c18bb31aa6040a4940: Status 404 returned error can't find the container with id 024480ad7c2d9e3ba96e46d84fbb7dc2395b1cb13de712c18bb31aa6040a4940
Jul 13 07:12:16.195722 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:12:16.195696    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0852ae9a_0b67_4d99_8655_e629550683b8.slice/crio-5ed2efe02812bad680c72774b9fce1c048e306a42579228e5e0cfba1b5994e2e WatchSource:0}: Error finding container 5ed2efe02812bad680c72774b9fce1c048e306a42579228e5e0cfba1b5994e2e: Status 404 returned error can't find the container with id 5ed2efe02812bad680c72774b9fce1c048e306a42579228e5e0cfba1b5994e2e
Jul 13 07:12:16.323072 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.323039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:16.323265 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.323202    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:16.323314 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.323265    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs podName:46cfca3b-e76c-46a7-a4ab-196e727c3e85 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:17.323248191 +0000 UTC m=+3.030125478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs") pod "network-metrics-daemon-g6mws" (UID: "46cfca3b-e76c-46a7-a4ab-196e727c3e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:16.424261 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.424149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:16.424261 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.424222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:16.424536 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.424306    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 07:12:16.424536 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.424334    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 07:12:16.424536 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.424349    2565 projected.go:196] Error preparing data for projected volume kube-api-access-ctz69 for pod openshift-network-diagnostics/network-check-target-459sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:16.424536 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.424357    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:16.424536 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.424421    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69 podName:a24688f8-8334-4ec7-bd1b-6cad27ecc472 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:17.424400502 +0000 UTC m=+3.131277800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctz69" (UniqueName: "kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69") pod "network-check-target-459sm" (UID: "a24688f8-8334-4ec7-bd1b-6cad27ecc472") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:16.424536 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.424442    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret podName:a07db2fc-5703-4db6-b9b1-93486b584ec4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:17.424431759 +0000 UTC m=+3.131309042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret") pod "global-pull-secret-syncer-6gdkr" (UID: "a07db2fc-5703-4db6-b9b1-93486b584ec4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:16.754111 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.753993    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 07:07:16 +0000 UTC" deadline="2028-03-14 07:39:06.035751063 +0000 UTC"
Jul 13 07:12:16.754111 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.754053    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14640h26m49.281702578s"
Jul 13 07:12:16.755829 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.755496    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 07:12:16.919081 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.918270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:16.919081 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:16.918405    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:16.940320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.940255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q5whj" event={"ID":"b3fb64be-7807-4db6-872b-9efab6a90d01","Type":"ContainerStarted","Data":"6fdaede60760ef67f405eb5fb462b076ad871ea7502d9ab59ce42197fbdb5000"}
Jul 13 07:12:16.951154 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.951118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mz4lc" event={"ID":"c8c26a1d-921b-489c-9928-40aa9b17cb16","Type":"ContainerStarted","Data":"42c877fa87d659bed6240aa6c3ff32e7bcb8f196cad8b4d77d937b14f6ba83eb"}
Jul 13 07:12:16.973379 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.973293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6" event={"ID":"687091fa-916b-4b89-bfbf-a837bd8828bb","Type":"ContainerStarted","Data":"5ea80966bc7e7ad88584167dbe893323a0e1b28fb0a328756b7442d47994ca4a"}
Jul 13 07:12:16.983377 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:16.983291    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjj26" event={"ID":"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703","Type":"ContainerStarted","Data":"1a2ce92cfdbe13d3c98dd2a268ea2c56a4f3a3edf92d8a7eb7d0f8fbc5860cd5"}
Jul 13 07:12:17.001442 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.001338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wfqt4" event={"ID":"bc1b4053-e0be-46ae-acae-13031176aaed","Type":"ContainerStarted","Data":"0c54ba34550efdb0e1ba2aa3baf1d612cb47bf233ff9d8ea6b3bc91f294ec3f9"}
Jul 13 07:12:17.013837 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.013748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qklsz" event={"ID":"3f3811e3-9b16-4cb2-b09e-2d4786a481b3","Type":"ContainerStarted","Data":"5b0922cc75805b50c11ac7bc34fbf521cd408210b810445a574e269b5a6bf890"}
Jul 13 07:12:17.036431 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.036339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal" event={"ID":"ec08dae2cc59d2e3b6f0cfcdea507328","Type":"ContainerStarted","Data":"73400c7e029bac1971441d96f60f29bc04870b3c15aa5da5bccc0b9a97a3c4c3"}
Jul 13 07:12:17.046545 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.046364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal" event={"ID":"b12fa66d6056d22316fd135bb16dacac","Type":"ContainerStarted","Data":"654391ff00dbc0714f9601be3fc008a61a107c32c0dd2218dfaefcd5ca0cb0bf"}
Jul 13 07:12:17.085445 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.085383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d5lkr" event={"ID":"0852ae9a-0b67-4d99-8655-e629550683b8","Type":"ContainerStarted","Data":"5ed2efe02812bad680c72774b9fce1c048e306a42579228e5e0cfba1b5994e2e"}
Jul 13 07:12:17.091674 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.091534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"024480ad7c2d9e3ba96e46d84fbb7dc2395b1cb13de712c18bb31aa6040a4940"}
Jul 13 07:12:17.117552 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.117471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4x792" event={"ID":"d76d51ba-aefd-44a7-8e4d-e808004fd437","Type":"ContainerStarted","Data":"6f30d5df88aa1b4c453df27e6ffe23c573088e8421fd8dac6a65fcb300b3f3ab"}
Jul 13 07:12:17.332074 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.331991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:17.332284 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.332161    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:17.332284 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.332232    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs podName:46cfca3b-e76c-46a7-a4ab-196e727c3e85 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:19.332212296 +0000 UTC m=+5.039089585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs") pod "network-metrics-daemon-g6mws" (UID: "46cfca3b-e76c-46a7-a4ab-196e727c3e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:17.432493 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.432436    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:17.432799 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.432522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:17.432799 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.432627    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 07:12:17.432799 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.432659    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 07:12:17.432799 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.432665    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:17.432799 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.432674    2565 projected.go:196] Error preparing data for projected volume kube-api-access-ctz69 for pod openshift-network-diagnostics/network-check-target-459sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:17.432799 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.432732    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret podName:a07db2fc-5703-4db6-b9b1-93486b584ec4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:19.432712125 +0000 UTC m=+5.139589437 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret") pod "global-pull-secret-syncer-6gdkr" (UID: "a07db2fc-5703-4db6-b9b1-93486b584ec4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:17.432799 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.432753    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69 podName:a24688f8-8334-4ec7-bd1b-6cad27ecc472 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:19.432741681 +0000 UTC m=+5.139618968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctz69" (UniqueName: "kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69") pod "network-check-target-459sm" (UID: "a24688f8-8334-4ec7-bd1b-6cad27ecc472") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:17.755256 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.755151    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 07:07:16 +0000 UTC" deadline="2028-04-27 10:44:09.628854528 +0000 UTC"
Jul 13 07:12:17.755256 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.755188    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15699h31m51.873670995s"
Jul 13 07:12:17.915214 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.915093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:17.915459 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.915246    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:17.915786 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:17.915722    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:17.915866 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:17.915842    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:18.928950 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:18.928911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:18.929620 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:18.929267    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:19.351278 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:19.351182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:19.351533 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.351412    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:19.351533 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.351510    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs podName:46cfca3b-e76c-46a7-a4ab-196e727c3e85 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:23.351486729 +0000 UTC m=+9.058364035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs") pod "network-metrics-daemon-g6mws" (UID: "46cfca3b-e76c-46a7-a4ab-196e727c3e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:19.451808 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:19.451759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:19.452013 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:19.451830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:19.452013 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.451994    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:19.452139 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.452060    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret podName:a07db2fc-5703-4db6-b9b1-93486b584ec4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:23.452040193 +0000 UTC m=+9.158917499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret") pod "global-pull-secret-syncer-6gdkr" (UID: "a07db2fc-5703-4db6-b9b1-93486b584ec4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:19.452612 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.452589    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 07:12:19.452724 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.452616    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 07:12:19.452724 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.452629    2565 projected.go:196] Error preparing data for projected volume kube-api-access-ctz69 for pod openshift-network-diagnostics/network-check-target-459sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:19.452724 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.452679    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69 podName:a24688f8-8334-4ec7-bd1b-6cad27ecc472 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:23.452663627 +0000 UTC m=+9.159540924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctz69" (UniqueName: "kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69") pod "network-check-target-459sm" (UID: "a24688f8-8334-4ec7-bd1b-6cad27ecc472") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:19.914695 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:19.914656    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:19.914909 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.914799    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:19.915288 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:19.915265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:19.915416 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:19.915395    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:20.917013 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:20.916333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:20.917013 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:20.916506    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:21.915248 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:21.915211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:21.915529 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:21.915221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:21.915529 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:21.915358    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:21.915529 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:21.915404    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:22.915122 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:22.915023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:22.915627 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:22.915166    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:23.388713 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:23.388672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:23.388917 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.388821    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:23.388917 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.388889    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs podName:46cfca3b-e76c-46a7-a4ab-196e727c3e85 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:31.388869791 +0000 UTC m=+17.095747076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs") pod "network-metrics-daemon-g6mws" (UID: "46cfca3b-e76c-46a7-a4ab-196e727c3e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:23.490096 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:23.490014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:23.490096 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:23.490115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:23.490382 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.490276    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 07:12:23.490382 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.490294    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 07:12:23.490382 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.490307    2565 projected.go:196] Error preparing data for projected volume kube-api-access-ctz69 for pod openshift-network-diagnostics/network-check-target-459sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:23.490382 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.490366    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69 podName:a24688f8-8334-4ec7-bd1b-6cad27ecc472 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:31.490346749 +0000 UTC m=+17.197224037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctz69" (UniqueName: "kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69") pod "network-check-target-459sm" (UID: "a24688f8-8334-4ec7-bd1b-6cad27ecc472") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:23.490782 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.490752    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:23.490954 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.490828    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret podName:a07db2fc-5703-4db6-b9b1-93486b584ec4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:31.490808633 +0000 UTC m=+17.197685919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret") pod "global-pull-secret-syncer-6gdkr" (UID: "a07db2fc-5703-4db6-b9b1-93486b584ec4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:23.914668 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:23.914631    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:23.915032 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.915003    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:23.915184 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:23.914659    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:23.915700 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:23.915677    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:24.915989 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:24.915949    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:24.916488 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:24.916082    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:25.914909 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:25.914824    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:25.915119 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:25.915000    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:25.915299 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:25.914828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:25.915472 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:25.915410    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:26.915102 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:26.914982    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:26.915670 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:26.915147    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:27.914909 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:27.914871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:27.915093 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:27.914871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:27.915093 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:27.914997    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:27.915093 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:27.915050    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:28.914769 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:28.914685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:28.914921 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:28.914814    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:29.914496 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:29.914414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:29.914898 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:29.914544    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:29.914898 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:29.914604    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:29.914898 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:29.914714    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:30.915493 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:30.915453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:30.915974 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:30.915581    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:31.456284 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:31.456239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:31.456504 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.456417    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:31.456504 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.456500    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs podName:46cfca3b-e76c-46a7-a4ab-196e727c3e85 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:47.456484217 +0000 UTC m=+33.163361500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs") pod "network-metrics-daemon-g6mws" (UID: "46cfca3b-e76c-46a7-a4ab-196e727c3e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:31.556717 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:31.556677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:31.556904 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:31.556729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:31.556904 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.556860    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 07:12:31.556904 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.556896    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 07:12:31.556904 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.556908    2565 projected.go:196] Error preparing data for projected volume kube-api-access-ctz69 for pod openshift-network-diagnostics/network-check-target-459sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:31.557092 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.556858    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:31.557092 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.556963    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69 podName:a24688f8-8334-4ec7-bd1b-6cad27ecc472 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:47.556942859 +0000 UTC m=+33.263820148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctz69" (UniqueName: "kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69") pod "network-check-target-459sm" (UID: "a24688f8-8334-4ec7-bd1b-6cad27ecc472") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:31.557092 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.556994    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret podName:a07db2fc-5703-4db6-b9b1-93486b584ec4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:47.556982866 +0000 UTC m=+33.263860150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret") pod "global-pull-secret-syncer-6gdkr" (UID: "a07db2fc-5703-4db6-b9b1-93486b584ec4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:31.915157 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:31.915122    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:31.915157 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:31.915161    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:31.915411 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.915255    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:31.915411 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:31.915381    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:32.915339 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:32.915308    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:32.915721 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:32.915425    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:33.915009 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:33.914971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:33.915225 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:33.915018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:33.915225 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:33.915121    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:33.915349 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:33.915257    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:34.915557 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:34.915524    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:34.915978 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:34.915640    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:35.915291 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:35.915248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:35.915501 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:35.915262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:35.915501 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:35.915396    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:35.915501 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:35.915472    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:36.915151 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:36.915121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:36.915402 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:36.915235    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:37.914743 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:37.914526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:37.915322 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:37.914853    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:37.915322 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:37.914623    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:37.915455 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:37.915327    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:38.177652 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.177624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6" event={"ID":"687091fa-916b-4b89-bfbf-a837bd8828bb","Type":"ContainerStarted","Data":"6cf9998581341a00be3883f2ff17998ab6ddd453c3465f62bdcb642456d42b84"}
Jul 13 07:12:38.179088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.179061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjj26" event={"ID":"7a6dc4dc-4ca5-4170-9a07-1ee62bd1e703","Type":"ContainerStarted","Data":"319e1293e84c302cb10e53c34a9e5016a66855fe6324e3c1880c3b487f9ae367"}
Jul 13 07:12:38.180430 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.180407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qklsz" event={"ID":"3f3811e3-9b16-4cb2-b09e-2d4786a481b3","Type":"ContainerStarted","Data":"e72c47bb9814ac5a4ddb3b272d3854d165164dcd0f12440a32cb824982fe2a75"}
Jul 13 07:12:38.181805 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.181784    2565 generic.go:356] "Generic (PLEG): container finished" podID="ec08dae2cc59d2e3b6f0cfcdea507328" containerID="1eeb35f99008a1af685f6caede81c1d44174226472fc161c1208941c7b6a469f" exitCode=0
Jul 13 07:12:38.181916 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.181806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal" event={"ID":"ec08dae2cc59d2e3b6f0cfcdea507328","Type":"ContainerDied","Data":"1eeb35f99008a1af685f6caede81c1d44174226472fc161c1208941c7b6a469f"}
Jul 13 07:12:38.183290 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.183264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal" event={"ID":"b12fa66d6056d22316fd135bb16dacac","Type":"ContainerStarted","Data":"fe3650e054f7e878b482c072b9285ff3d0ec958e04264c1857dc6492815669cf"}
Jul 13 07:12:38.184691 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.184671    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d5lkr" event={"ID":"0852ae9a-0b67-4d99-8655-e629550683b8","Type":"ContainerStarted","Data":"13a1fc141d3d5aa8ca76cefbff1489ba1ddb99a730c718db1614b420c66e744a"}
Jul 13 07:12:38.186328 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.186308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"70a095c6ebe07d12e64bb62281ee6160a6c49c9bb6c396c4ce96f5cb578a34c9"}
Jul 13 07:12:38.186416 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.186361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"b0b8fe2c8fa5ded8df98481bdde0c2dc70240aabdbde33e1464433c00f3f0e36"}
Jul 13 07:12:38.187675 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.187654    2565 generic.go:356] "Generic (PLEG): container finished" podID="d76d51ba-aefd-44a7-8e4d-e808004fd437" containerID="2089871c7e0642010fda30e96233e5f7ad3f3abdc86c01d669eafca400ab08d6" exitCode=0
Jul 13 07:12:38.187776 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.187729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4x792" event={"ID":"d76d51ba-aefd-44a7-8e4d-e808004fd437","Type":"ContainerDied","Data":"2089871c7e0642010fda30e96233e5f7ad3f3abdc86c01d669eafca400ab08d6"}
Jul 13 07:12:38.189274 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.189243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q5whj" event={"ID":"b3fb64be-7807-4db6-872b-9efab6a90d01","Type":"ContainerStarted","Data":"991e3666de58db020881ac3d99dcaaa3b43a17c6110eee5431181fbe66e3c936"}
Jul 13 07:12:38.190689 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.190666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mz4lc" event={"ID":"c8c26a1d-921b-489c-9928-40aa9b17cb16","Type":"ContainerStarted","Data":"08606caed8478c54937d8820a892438c8122e6535b5d599167e4992192da73f3"}
Jul 13 07:12:38.197178 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.197131    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tjj26" podStartSLOduration=1.748732399 podStartE2EDuration="23.197117605s" totalImagesPullingTime="21.448385206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:38.196686952 +0000 UTC m=+23.903564279" watchObservedRunningTime="2026-07-13 07:12:38.197117605 +0000 UTC m=+23.903994904"
Jul 13 07:12:38.226403 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.226356    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d5lkr" podStartSLOduration=1.849726062 podStartE2EDuration="23.226340385s" totalImagesPullingTime="21.376614323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:38.225861888 +0000 UTC m=+23.932739239" watchObservedRunningTime="2026-07-13 07:12:38.226340385 +0000 UTC m=+23.933217707"
Jul 13 07:12:38.277376 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.277187    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mz4lc" podStartSLOduration=1.77494783 podStartE2EDuration="23.277169906s" totalImagesPullingTime="21.502222076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:38.276760332 +0000 UTC m=+23.983637670" watchObservedRunningTime="2026-07-13 07:12:38.277169906 +0000 UTC m=+23.984047208"
Jul 13 07:12:38.277581 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.277556    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-143.ec2.internal" podStartSLOduration=22.277548682 podStartE2EDuration="22.277548682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:38.261969264 +0000 UTC m=+23.968846567" watchObservedRunningTime="2026-07-13 07:12:38.277548682 +0000 UTC m=+23.984425985"
Jul 13 07:12:38.297368 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.297319    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qklsz" podStartSLOduration=6.4863367610000005 podStartE2EDuration="23.297303508s" totalImagesPullingTime="16.810966747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:38.297089137 +0000 UTC m=+24.003966452" watchObservedRunningTime="2026-07-13 07:12:38.297303508 +0000 UTC m=+24.004180811"
Jul 13 07:12:38.341961 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.341914    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q5whj" podStartSLOduration=1.941557828 podStartE2EDuration="23.341898877s" totalImagesPullingTime="21.400341049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:38.317022547 +0000 UTC m=+24.023899861" watchObservedRunningTime="2026-07-13 07:12:38.341898877 +0000 UTC m=+24.048776181"
Jul 13 07:12:38.522404 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.522358    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:38.523142 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.523115    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:38.914860 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:38.914822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:38.915477 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:38.914929    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:39.196489 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.196459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"316e11142239f24b1759e4c1e6c9076c76551a39e5198654309f18405fb4703c"}
Jul 13 07:12:39.196659 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.196553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"fa903f1333c5970279e007ad440d6f8c7db1dd2e32b38e148364740d8d4dfe50"}
Jul 13 07:12:39.196659 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.196602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"46c02853f10eb0e477f20885efa185a3c54738f4c1a03b424193c620ab1a66f7"}
Jul 13 07:12:39.196659 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.196650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"78b862d02eda91c7fe2c8d828c77bb87d7f332821f94567c3910bc59056a237a"}
Jul 13 07:12:39.198209 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.198139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wfqt4" event={"ID":"bc1b4053-e0be-46ae-acae-13031176aaed","Type":"ContainerStarted","Data":"1d4ab7ba0c0d8da3c18aa588245f48f6a837c1c36650bef33003d0074d791820"}
Jul 13 07:12:39.200270 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.200242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal" event={"ID":"ec08dae2cc59d2e3b6f0cfcdea507328","Type":"ContainerStarted","Data":"9864aa911a678f3fda62af82cd62438952987dddaf3445022bf1894e928b1b34"}
Jul 13 07:12:39.200666 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.200646    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:39.201145 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.201126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q5whj"
Jul 13 07:12:39.215570 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.215520    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wfqt4" podStartSLOduration=2.827608939 podStartE2EDuration="24.215505284s" totalImagesPullingTime="21.387896345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:39.215005269 +0000 UTC m=+24.921882597" watchObservedRunningTime="2026-07-13 07:12:39.215505284 +0000 UTC m=+24.922382625"
Jul 13 07:12:39.230006 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.229923    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-143.ec2.internal" podStartSLOduration=23.229902657 podStartE2EDuration="23.229902657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:39.228981071 +0000 UTC m=+24.935858374" watchObservedRunningTime="2026-07-13 07:12:39.229902657 +0000 UTC m=+24.936779961"
Jul 13 07:12:39.325853 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.325822    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 07:12:39.795358 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.795248    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T07:12:39.325846695Z","UUID":"bcffe337-1125-4dba-a6ff-1583de031031","Handler":null,"Name":"","Endpoint":""}
Jul 13 07:12:39.798389 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.798359    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 07:12:39.798567 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.798408    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 07:12:39.915158 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.915125    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:39.915584 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:39.915237    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:39.915584 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:39.915291    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:39.915584 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:39.915402    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:40.204231 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:40.204131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6" event={"ID":"687091fa-916b-4b89-bfbf-a837bd8828bb","Type":"ContainerStarted","Data":"c9fabac733d12c9b661ba24ecb84fe667b3fb4fe932c736a89b734daefc6b651"}
Jul 13 07:12:40.915290 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:40.915207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:40.915723 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:40.915344    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:41.209366 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:41.209287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"6f75a4b1c31aa2aaace8cb7eefdc8af9c4a7ecd822ddf820700be096159a756c"}
Jul 13 07:12:41.211154 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:41.211127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6" event={"ID":"687091fa-916b-4b89-bfbf-a837bd8828bb","Type":"ContainerStarted","Data":"0cbbc10823b2a6e6b98b3efe10c84871bd36e29fffed402d1353d000d59c34dc"}
Jul 13 07:12:41.230558 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:41.230509    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cmzs6" podStartSLOduration=2.545293785 podStartE2EDuration="26.230494495s" totalImagesPullingTime="23.68520071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:41.229997525 +0000 UTC m=+26.936874863" watchObservedRunningTime="2026-07-13 07:12:41.230494495 +0000 UTC m=+26.937371799"
Jul 13 07:12:41.914656 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:41.914613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:41.914843 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:41.914760    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:41.914843 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:41.914820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:41.914942 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:41.914927    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:42.915521 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:42.915486    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:42.915977 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:42.915612    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:42.950163 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:42.950131    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mz4lc_c8c26a1d-921b-489c-9928-40aa9b17cb16/dns-node-resolver/0.log"
Jul 13 07:12:43.915083 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:43.914908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:43.915396 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:43.914909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:43.915396 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:43.915159    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:43.915396 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:43.915259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:43.927847 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:43.927825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qklsz_3f3811e3-9b16-4cb2-b09e-2d4786a481b3/node-ca/0.log"
Jul 13 07:12:44.221485 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:44.221454    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" event={"ID":"6ebe5ef4-aaf1-4526-89a3-79d7e04c6f46","Type":"ContainerStarted","Data":"b530807a6570f8a5afad21101e7ba397e668b438ff150059f45a5f68d811aaa7"}
Jul 13 07:12:44.221753 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:44.221725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:44.223330 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:44.223305    2565 generic.go:356] "Generic (PLEG): container finished" podID="d76d51ba-aefd-44a7-8e4d-e808004fd437" containerID="40c62e01a95270e82d49b161d8f3aa6c26a42c6259a10e20c13d4fedf0b578f3" exitCode=0
Jul 13 07:12:44.223473 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:44.223364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4x792" event={"ID":"d76d51ba-aefd-44a7-8e4d-e808004fd437","Type":"ContainerDied","Data":"40c62e01a95270e82d49b161d8f3aa6c26a42c6259a10e20c13d4fedf0b578f3"}
Jul 13 07:12:44.238391 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:44.238354    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:44.250151 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:44.250106    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6" podStartSLOduration=7.733534649 podStartE2EDuration="29.250092146s" totalImagesPullingTime="21.516557497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:44.249668113 +0000 UTC m=+29.956545449" watchObservedRunningTime="2026-07-13 07:12:44.250092146 +0000 UTC m=+29.956969448"
Jul 13 07:12:44.916405 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:44.916370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:44.916659 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:44.916478    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:45.226731 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.226707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:45.227070 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.226787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:45.244367 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.244113    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:12:45.702551 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.702515    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-459sm"]
Jul 13 07:12:45.702771 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.702616    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:45.702771 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:45.702692    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:45.705586 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.705560    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gdkr"]
Jul 13 07:12:45.705720 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.705676    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:45.705807 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:45.705780    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:45.706138 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.706115    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g6mws"]
Jul 13 07:12:45.706232 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:45.706216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:45.706334 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:45.706312    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:46.230217 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:46.230180    2565 generic.go:356] "Generic (PLEG): container finished" podID="d76d51ba-aefd-44a7-8e4d-e808004fd437" containerID="20d5f94f54fea647999b94ab4efe19947935befd0e24ab0d9fc7d7663d78f0b3" exitCode=0
Jul 13 07:12:46.230715 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:46.230239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4x792" event={"ID":"d76d51ba-aefd-44a7-8e4d-e808004fd437","Type":"ContainerDied","Data":"20d5f94f54fea647999b94ab4efe19947935befd0e24ab0d9fc7d7663d78f0b3"}
Jul 13 07:12:46.914656 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:46.914625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:46.914798 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:46.914742    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:46.914798 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:46.914789    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:46.914895 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:46.914877    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:47.474046 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:47.473961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:47.474500 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.474084    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:47.474500 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.474137    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs podName:46cfca3b-e76c-46a7-a4ab-196e727c3e85 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:19.474122886 +0000 UTC m=+65.181000167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs") pod "network-metrics-daemon-g6mws" (UID: "46cfca3b-e76c-46a7-a4ab-196e727c3e85") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 07:12:47.575328 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:47.575293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:47.575511 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:47.575340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:47.575511 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.575422    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 07:12:47.575511 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.575465    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 07:12:47.575511 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.575469    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:47.575511 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.575478    2565 projected.go:196] Error preparing data for projected volume kube-api-access-ctz69 for pod openshift-network-diagnostics/network-check-target-459sm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:47.575683 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.575523    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret podName:a07db2fc-5703-4db6-b9b1-93486b584ec4 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:19.57550932 +0000 UTC m=+65.282386601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret") pod "global-pull-secret-syncer-6gdkr" (UID: "a07db2fc-5703-4db6-b9b1-93486b584ec4") : object "kube-system"/"original-pull-secret" not registered
Jul 13 07:12:47.575683 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.575535    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69 podName:a24688f8-8334-4ec7-bd1b-6cad27ecc472 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:19.575529754 +0000 UTC m=+65.282407035 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ctz69" (UniqueName: "kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69") pod "network-check-target-459sm" (UID: "a24688f8-8334-4ec7-bd1b-6cad27ecc472") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 07:12:47.915379 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:47.915350    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:47.915575 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:47.915477    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:48.237550 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:48.237516    2565 generic.go:356] "Generic (PLEG): container finished" podID="d76d51ba-aefd-44a7-8e4d-e808004fd437" containerID="7cd00f063969eaa3e4f5a59414bd7c69865b981ab976f458668870eef0505f5b" exitCode=0
Jul 13 07:12:48.237733 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:48.237560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4x792" event={"ID":"d76d51ba-aefd-44a7-8e4d-e808004fd437","Type":"ContainerDied","Data":"7cd00f063969eaa3e4f5a59414bd7c69865b981ab976f458668870eef0505f5b"}
Jul 13 07:12:48.915481 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:48.915450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:48.916093 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:48.915518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:48.916093 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:48.915578    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:48.916093 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:48.915674    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:49.915227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:49.915192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:49.915399 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:49.915327    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:50.914887 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:50.914849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:50.915333 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:50.914902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:50.915333 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:50.914995    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:50.915333 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:50.915136    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:51.914879 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:51.914843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:51.915082 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:51.914966    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:52.914998 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:52.914966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:52.915157 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:52.915072    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:52.915462 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:52.915150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:52.915462 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:52.915235    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:53.252695 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:53.252606    2565 generic.go:356] "Generic (PLEG): container finished" podID="d76d51ba-aefd-44a7-8e4d-e808004fd437" containerID="9034356e7644418a4776019c5b928a6601069b5c05c1e2d3d1edaf160eeb25a7" exitCode=0
Jul 13 07:12:53.252695 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:53.252655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4x792" event={"ID":"d76d51ba-aefd-44a7-8e4d-e808004fd437","Type":"ContainerDied","Data":"9034356e7644418a4776019c5b928a6601069b5c05c1e2d3d1edaf160eeb25a7"}
Jul 13 07:12:53.915344 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:53.915303    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:53.915785 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:53.915460    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:54.257993 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:54.257911    2565 generic.go:356] "Generic (PLEG): container finished" podID="d76d51ba-aefd-44a7-8e4d-e808004fd437" containerID="fd896640e7f531e7a789bf55bb368b71f008f0439be74014616d22e328003e78" exitCode=0
Jul 13 07:12:54.257993 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:54.257952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4x792" event={"ID":"d76d51ba-aefd-44a7-8e4d-e808004fd437","Type":"ContainerDied","Data":"fd896640e7f531e7a789bf55bb368b71f008f0439be74014616d22e328003e78"}
Jul 13 07:12:54.915383 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:54.915349    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:54.915985 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:54.915507    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:54.915985 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:54.915568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:54.915985 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:54.915672    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:55.263360 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:55.263279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4x792" event={"ID":"d76d51ba-aefd-44a7-8e4d-e808004fd437","Type":"ContainerStarted","Data":"1f7eca44872eb610abfb8d37bc7b3435a4e3b4cb8afbbfc53e556eb03ed613a4"}
Jul 13 07:12:55.285685 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:55.285636    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4x792" podStartSLOduration=7.278953421 podStartE2EDuration="40.285620775s" totalImagesPullingTime="33.006667354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:55.285505187 +0000 UTC m=+40.992382487" watchObservedRunningTime="2026-07-13 07:12:55.285620775 +0000 UTC m=+40.992498078"
Jul 13 07:12:55.914928 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:55.914893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:55.915076 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:55.915007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:56.915484 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:56.915430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:56.915939 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:56.915431    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:56.915939 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:56.915578    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:56.915939 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:56.915621    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:57.914657 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:57.914619    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:57.914811 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:57.914729    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:12:58.915241 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:58.915209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:12:58.915647 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:58.915209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:12:58.915647 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:58.915328    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:12:58.915647 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:58.915375    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:12:59.915349 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:12:59.915318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:12:59.915773 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:12:59.915425    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:13:00.914747 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:00.914716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:00.914990 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:00.914813    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:13:00.914990 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:00.914897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:00.915061 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:00.915003    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:13:01.914921 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:01.914885    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:13:01.915297 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:01.914997    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:13:02.914948 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:02.914912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:02.915328 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:02.915029    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:13:02.915328 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:02.915061    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:02.915328 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:02.915110    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:13:03.914484 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:03.914428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:13:03.914669 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:03.914567    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:13:04.915505 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:04.915469    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:04.915990 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:04.915514    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:04.915990 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:04.915580    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:13:04.915990 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:04.915679    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:13:05.915415 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:05.915377    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:13:05.915619 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:05.915511    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:13:06.917831 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:06.917803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:06.918198 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:06.917898    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:13:06.918198 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:06.917952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:06.918198 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:06.918034    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:13:07.914894 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:07.914862    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:13:07.915177 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:07.914991    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g6mws" podUID="46cfca3b-e76c-46a7-a4ab-196e727c3e85"
Jul 13 07:13:08.917827 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:08.917800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:08.918201 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:08.917899    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6gdkr" podUID="a07db2fc-5703-4db6-b9b1-93486b584ec4"
Jul 13 07:13:08.918201 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:08.917953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:08.918201 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:08.918045    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-459sm" podUID="a24688f8-8334-4ec7-bd1b-6cad27ecc472"
Jul 13 07:13:09.635445 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.635417    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-143.ec2.internal" event="NodeReady"
Jul 13 07:13:09.635611 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.635564    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 07:13:09.681976 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.681939    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-652tj"]
Jul 13 07:13:09.706039 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.705999    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wvfbf"]
Jul 13 07:13:09.706189 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.706142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.708549 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.708521    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 07:13:09.708549 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.708521    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 07:13:09.708737 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.708571    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj5f5\""
Jul 13 07:13:09.727926 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.727897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ec54b3-77a3-4621-84c2-389b259e09a3-tmp-dir\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.728060 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.727938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52ec54b3-77a3-4621-84c2-389b259e09a3-config-volume\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.728060 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.727967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbxf5\" (UniqueName: \"kubernetes.io/projected/52ec54b3-77a3-4621-84c2-389b259e09a3-kube-api-access-gbxf5\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.728060 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.728034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ec54b3-77a3-4621-84c2-389b259e09a3-metrics-tls\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.730005 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.729981    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-652tj"]
Jul 13 07:13:09.730122 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.730024    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wvfbf"]
Jul 13 07:13:09.730122 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.730098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wvfbf"
Jul 13 07:13:09.732604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.732572    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x4nqx\""
Jul 13 07:13:09.732604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.732592    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 07:13:09.732755 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.732636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 07:13:09.732793 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.732748    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 07:13:09.785857 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.785825    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dh42w"]
Jul 13 07:13:09.806993 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.806965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dh42w"]
Jul 13 07:13:09.807141 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.807043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.809518 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.809496    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8g2nr\""
Jul 13 07:13:09.809662 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.809558    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 07:13:09.809662 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.809614    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 07:13:09.809764 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.809724    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 07:13:09.809831 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.809810    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 07:13:09.828620 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52ec54b3-77a3-4621-84c2-389b259e09a3-config-volume\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.828620 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbxf5\" (UniqueName: \"kubernetes.io/projected/52ec54b3-77a3-4621-84c2-389b259e09a3-kube-api-access-gbxf5\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.828791 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bd1f393-12a6-4a56-8605-4c2f0c3def97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.828791 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpqnc\" (UniqueName: \"kubernetes.io/projected/0b0a7b50-64d9-449a-bd65-75da8a38e2fe-kube-api-access-vpqnc\") pod \"ingress-canary-wvfbf\" (UID: \"0b0a7b50-64d9-449a-bd65-75da8a38e2fe\") " pod="openshift-ingress-canary/ingress-canary-wvfbf"
Jul 13 07:13:09.828791 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bd1f393-12a6-4a56-8605-4c2f0c3def97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.828791 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdm4x\" (UniqueName: \"kubernetes.io/projected/8bd1f393-12a6-4a56-8605-4c2f0c3def97-kube-api-access-kdm4x\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.828941 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bd1f393-12a6-4a56-8605-4c2f0c3def97-crio-socket\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.828941 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ec54b3-77a3-4621-84c2-389b259e09a3-metrics-tls\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.828941 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ec54b3-77a3-4621-84c2-389b259e09a3-tmp-dir\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.829064 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bd1f393-12a6-4a56-8605-4c2f0c3def97-data-volume\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.829064 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.828957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b0a7b50-64d9-449a-bd65-75da8a38e2fe-cert\") pod \"ingress-canary-wvfbf\" (UID: \"0b0a7b50-64d9-449a-bd65-75da8a38e2fe\") " pod="openshift-ingress-canary/ingress-canary-wvfbf"
Jul 13 07:13:09.829168 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.829107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52ec54b3-77a3-4621-84c2-389b259e09a3-config-volume\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.829271 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.829242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52ec54b3-77a3-4621-84c2-389b259e09a3-tmp-dir\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.833013 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.832983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52ec54b3-77a3-4621-84c2-389b259e09a3-metrics-tls\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.836315 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.836282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbxf5\" (UniqueName: \"kubernetes.io/projected/52ec54b3-77a3-4621-84c2-389b259e09a3-kube-api-access-gbxf5\") pod \"dns-default-652tj\" (UID: \"52ec54b3-77a3-4621-84c2-389b259e09a3\") " pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:09.882113 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.882083    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"]
Jul 13 07:13:09.898966 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.898892    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"]
Jul 13 07:13:09.899099 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.898986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"
Jul 13 07:13:09.902247 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.902219    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 13 07:13:09.902389 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.902305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2kt2j\""
Jul 13 07:13:09.914947 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.914924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:13:09.917464 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.917446    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5sc2t\""
Jul 13 07:13:09.917638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.917620    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 07:13:09.929946 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.929922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bd1f393-12a6-4a56-8605-4c2f0c3def97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.930320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.929956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpqnc\" (UniqueName: \"kubernetes.io/projected/0b0a7b50-64d9-449a-bd65-75da8a38e2fe-kube-api-access-vpqnc\") pod \"ingress-canary-wvfbf\" (UID: \"0b0a7b50-64d9-449a-bd65-75da8a38e2fe\") " pod="openshift-ingress-canary/ingress-canary-wvfbf"
Jul 13 07:13:09.930320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.929974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bd1f393-12a6-4a56-8605-4c2f0c3def97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.930320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.929991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdm4x\" (UniqueName: \"kubernetes.io/projected/8bd1f393-12a6-4a56-8605-4c2f0c3def97-kube-api-access-kdm4x\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.930320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.930120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bd1f393-12a6-4a56-8605-4c2f0c3def97-crio-socket\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.930320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.930181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5df22173-d341-4b19-8eb0-4ee42c660574-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7rd95\" (UID: \"5df22173-d341-4b19-8eb0-4ee42c660574\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"
Jul 13 07:13:09.930320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.930268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bd1f393-12a6-4a56-8605-4c2f0c3def97-data-volume\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.930320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.930298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b0a7b50-64d9-449a-bd65-75da8a38e2fe-cert\") pod \"ingress-canary-wvfbf\" (UID: \"0b0a7b50-64d9-449a-bd65-75da8a38e2fe\") " pod="openshift-ingress-canary/ingress-canary-wvfbf"
Jul 13 07:13:09.930623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.930346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8bd1f393-12a6-4a56-8605-4c2f0c3def97-crio-socket\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.930623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.930576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8bd1f393-12a6-4a56-8605-4c2f0c3def97-data-volume\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.930623 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.930599    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8bd1f393-12a6-4a56-8605-4c2f0c3def97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.932673 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.932647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8bd1f393-12a6-4a56-8605-4c2f0c3def97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.932853 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.932835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b0a7b50-64d9-449a-bd65-75da8a38e2fe-cert\") pod \"ingress-canary-wvfbf\" (UID: \"0b0a7b50-64d9-449a-bd65-75da8a38e2fe\") " pod="openshift-ingress-canary/ingress-canary-wvfbf"
Jul 13 07:13:09.946209 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.946183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdm4x\" (UniqueName: \"kubernetes.io/projected/8bd1f393-12a6-4a56-8605-4c2f0c3def97-kube-api-access-kdm4x\") pod \"insights-runtime-extractor-dh42w\" (UID: \"8bd1f393-12a6-4a56-8605-4c2f0c3def97\") " pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:09.949566 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:09.949543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpqnc\" (UniqueName: \"kubernetes.io/projected/0b0a7b50-64d9-449a-bd65-75da8a38e2fe-kube-api-access-vpqnc\") pod \"ingress-canary-wvfbf\" (UID: \"0b0a7b50-64d9-449a-bd65-75da8a38e2fe\") " pod="openshift-ingress-canary/ingress-canary-wvfbf"
Jul 13 07:13:10.015324 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.015281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:10.030638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.030602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5df22173-d341-4b19-8eb0-4ee42c660574-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7rd95\" (UID: \"5df22173-d341-4b19-8eb0-4ee42c660574\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"
Jul 13 07:13:10.033062 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.033040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5df22173-d341-4b19-8eb0-4ee42c660574-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-7rd95\" (UID: \"5df22173-d341-4b19-8eb0-4ee42c660574\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"
Jul 13 07:13:10.038922 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.038901    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wvfbf"
Jul 13 07:13:10.116040 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.116004    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dh42w"
Jul 13 07:13:10.208858 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.208546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"
Jul 13 07:13:10.256881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.256296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wvfbf"]
Jul 13 07:13:10.263058 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:10.263021    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0a7b50_64d9_449a_bd65_75da8a38e2fe.slice/crio-e946b289ab71d5b7a249240d02e06c0264d0793e4f818f2ee6bd8d31e53b5282 WatchSource:0}: Error finding container e946b289ab71d5b7a249240d02e06c0264d0793e4f818f2ee6bd8d31e53b5282: Status 404 returned error can't find the container with id e946b289ab71d5b7a249240d02e06c0264d0793e4f818f2ee6bd8d31e53b5282
Jul 13 07:13:10.273697 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.273666    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-652tj"]
Jul 13 07:13:10.277940 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:10.277907    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52ec54b3_77a3_4621_84c2_389b259e09a3.slice/crio-8db1d7f8f8a0fb4e181c7f98875a40ca73fc846088a0c4a272dcffe518e8d16a WatchSource:0}: Error finding container 8db1d7f8f8a0fb4e181c7f98875a40ca73fc846088a0c4a272dcffe518e8d16a: Status 404 returned error can't find the container with id 8db1d7f8f8a0fb4e181c7f98875a40ca73fc846088a0c4a272dcffe518e8d16a
Jul 13 07:13:10.292739 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.292638    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dh42w"]
Jul 13 07:13:10.297208 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:10.297170    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd1f393_12a6_4a56_8605_4c2f0c3def97.slice/crio-8ac648be8830de18580f0d08b5b7225ad4032c73f01db641a6d231c120fc7d63 WatchSource:0}: Error finding container 8ac648be8830de18580f0d08b5b7225ad4032c73f01db641a6d231c120fc7d63: Status 404 returned error can't find the container with id 8ac648be8830de18580f0d08b5b7225ad4032c73f01db641a6d231c120fc7d63
Jul 13 07:13:10.300094 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.300064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wvfbf" event={"ID":"0b0a7b50-64d9-449a-bd65-75da8a38e2fe","Type":"ContainerStarted","Data":"e946b289ab71d5b7a249240d02e06c0264d0793e4f818f2ee6bd8d31e53b5282"}
Jul 13 07:13:10.301362 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.301326    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-652tj" event={"ID":"52ec54b3-77a3-4621-84c2-389b259e09a3","Type":"ContainerStarted","Data":"8db1d7f8f8a0fb4e181c7f98875a40ca73fc846088a0c4a272dcffe518e8d16a"}
Jul 13 07:13:10.361319 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.361291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"]
Jul 13 07:13:10.364631 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:10.364602    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df22173_d341_4b19_8eb0_4ee42c660574.slice/crio-08169c67c9e627706d0d5d4138bda5d834ecb58f65fea1ac7d8a0623972e9491 WatchSource:0}: Error finding container 08169c67c9e627706d0d5d4138bda5d834ecb58f65fea1ac7d8a0623972e9491: Status 404 returned error can't find the container with id 08169c67c9e627706d0d5d4138bda5d834ecb58f65fea1ac7d8a0623972e9491
Jul 13 07:13:10.915622 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.915413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:10.915935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.915914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:10.918656 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.918630    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 07:13:10.918910 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.918891    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 07:13:10.919256 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.919238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4492s\""
Jul 13 07:13:10.919590 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:10.919543    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 07:13:11.308537 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:11.308461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95" event={"ID":"5df22173-d341-4b19-8eb0-4ee42c660574","Type":"ContainerStarted","Data":"08169c67c9e627706d0d5d4138bda5d834ecb58f65fea1ac7d8a0623972e9491"}
Jul 13 07:13:11.311689 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:11.311577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dh42w" event={"ID":"8bd1f393-12a6-4a56-8605-4c2f0c3def97","Type":"ContainerStarted","Data":"8ac648be8830de18580f0d08b5b7225ad4032c73f01db641a6d231c120fc7d63"}
Jul 13 07:13:12.317106 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.317037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95" event={"ID":"5df22173-d341-4b19-8eb0-4ee42c660574","Type":"ContainerStarted","Data":"31d1ffafe4ad8dd32bd399878e46dad2f814fb93031303a4f68989cf4f176939"}
Jul 13 07:13:12.317713 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.317659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"
Jul 13 07:13:12.324038 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.323982    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95"
Jul 13 07:13:12.333594 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.333534    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-7rd95" podStartSLOduration=1.706762401 podStartE2EDuration="3.333517162s" totalImagesPullingTime="1.626754761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:12.333004142 +0000 UTC m=+58.039881502" watchObservedRunningTime="2026-07-13 07:13:12.333517162 +0000 UTC m=+58.040394462"
Jul 13 07:13:12.900648 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.900613    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xspkh"]
Jul 13 07:13:12.907060 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.907033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:12.909730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.909702    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 07:13:12.909895 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.909710    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 13 07:13:12.911021 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.910847    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 07:13:12.911021 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.910847    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 13 07:13:12.911021 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.910927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 07:13:12.911245 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.911195    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-clnvz\""
Jul 13 07:13:12.911971 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.911950    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xspkh"]
Jul 13 07:13:12.956597 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.956556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:12.956597 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.956599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c30a1-30d8-49e4-8535-40222abb4019-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:12.956810 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.956666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:12.956810 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:12.956735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fps8\" (UniqueName: \"kubernetes.io/projected/7a8c30a1-30d8-49e4-8535-40222abb4019-kube-api-access-8fps8\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.057106 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.057068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.057335 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.057160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fps8\" (UniqueName: \"kubernetes.io/projected/7a8c30a1-30d8-49e4-8535-40222abb4019-kube-api-access-8fps8\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.057335 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.057211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.057335 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.057237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c30a1-30d8-49e4-8535-40222abb4019-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.057526 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:13.057375    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 13 07:13:13.057526 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:13.057466    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-tls podName:7a8c30a1-30d8-49e4-8535-40222abb4019 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:13.557423787 +0000 UTC m=+59.264301080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-tls") pod "prometheus-operator-64785b6675-xspkh" (UID: "7a8c30a1-30d8-49e4-8535-40222abb4019") : secret "prometheus-operator-tls" not found
Jul 13 07:13:13.058218 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.058181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a8c30a1-30d8-49e4-8535-40222abb4019-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.059899 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.059868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.066447 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.066408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fps8\" (UniqueName: \"kubernetes.io/projected/7a8c30a1-30d8-49e4-8535-40222abb4019-kube-api-access-8fps8\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.561596 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.561558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.564116 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.564090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a8c30a1-30d8-49e4-8535-40222abb4019-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xspkh\" (UID: \"7a8c30a1-30d8-49e4-8535-40222abb4019\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:13.819367 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:13.819288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh"
Jul 13 07:13:15.035971 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.035938    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b457674f5-kj4jk"]
Jul 13 07:13:15.043139 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.043116    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.045528 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.045499    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 07:13:15.045670 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.045630    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 07:13:15.046764 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.046744    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 07:13:15.046887 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.046847    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gb2r6\""
Jul 13 07:13:15.046970 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.046958    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 07:13:15.047252 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.047236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 07:13:15.047422 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.047250    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 07:13:15.047506 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.047483    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 07:13:15.049237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.049212    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b457674f5-kj4jk"]
Jul 13 07:13:15.051467 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.051429    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 07:13:15.071200 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.071164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-trusted-ca-bundle\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.071382 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.071209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phhz4\" (UniqueName: \"kubernetes.io/projected/7d60e047-25fd-4573-9f08-311bf31494e3-kube-api-access-phhz4\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.071382 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.071302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-oauth-serving-cert\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.071382 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.071337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-console-config\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.071581 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.071428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-serving-cert\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.071581 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.071481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-service-ca\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.071581 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.071517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-oauth-config\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.172868 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.172816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-oauth-config\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.173066 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.172895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-trusted-ca-bundle\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.173066 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.172923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phhz4\" (UniqueName: \"kubernetes.io/projected/7d60e047-25fd-4573-9f08-311bf31494e3-kube-api-access-phhz4\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.173188 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.173139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-oauth-serving-cert\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.173243 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.173197    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-console-config\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.173331 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.173314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-serving-cert\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.173390 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.173342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-service-ca\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.174111 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.174058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-oauth-serving-cert\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.174425 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.174400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-service-ca\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.174551 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.174528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-console-config\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.174627 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.174612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-trusted-ca-bundle\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.175823 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.175801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-oauth-config\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.176039 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.176011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-serving-cert\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.183034 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.183006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phhz4\" (UniqueName: \"kubernetes.io/projected/7d60e047-25fd-4573-9f08-311bf31494e3-kube-api-access-phhz4\") pod \"console-b457674f5-kj4jk\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") " pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.355910 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.355809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:15.748280 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.748149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xspkh"]
Jul 13 07:13:15.754595 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:15.754552    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8c30a1_30d8_49e4_8535_40222abb4019.slice/crio-5fb9578137daf8794bbd8af50744a9308305624f36e84423fea354cef8d4e3dc WatchSource:0}: Error finding container 5fb9578137daf8794bbd8af50744a9308305624f36e84423fea354cef8d4e3dc: Status 404 returned error can't find the container with id 5fb9578137daf8794bbd8af50744a9308305624f36e84423fea354cef8d4e3dc
Jul 13 07:13:15.764967 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:15.763858    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b457674f5-kj4jk"]
Jul 13 07:13:15.769597 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:15.769563    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d60e047_25fd_4573_9f08_311bf31494e3.slice/crio-9fee2dc450a0cabad341719560a794ac43c3e50e5b1fece9e71443a9295f31e1 WatchSource:0}: Error finding container 9fee2dc450a0cabad341719560a794ac43c3e50e5b1fece9e71443a9295f31e1: Status 404 returned error can't find the container with id 9fee2dc450a0cabad341719560a794ac43c3e50e5b1fece9e71443a9295f31e1
Jul 13 07:13:16.332314 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.332178    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wvfbf" event={"ID":"0b0a7b50-64d9-449a-bd65-75da8a38e2fe","Type":"ContainerStarted","Data":"b0379fdb37983238400f625054ada2d4488f545223e3ddb3cd7855e74a9838e5"}
Jul 13 07:13:16.335405 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.335365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-652tj" event={"ID":"52ec54b3-77a3-4621-84c2-389b259e09a3","Type":"ContainerStarted","Data":"cf4b98e29b838416663b328cf2ee6a4f28c6021f9701f1b4501d2070f868b21c"}
Jul 13 07:13:16.335577 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.335424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-652tj" event={"ID":"52ec54b3-77a3-4621-84c2-389b259e09a3","Type":"ContainerStarted","Data":"77a03793d155962918ec6be9df42a58911b1a6d8335b558dcd98543f54a4ebe4"}
Jul 13 07:13:16.335577 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.335483    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:16.337078 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.337052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b457674f5-kj4jk" event={"ID":"7d60e047-25fd-4573-9f08-311bf31494e3","Type":"ContainerStarted","Data":"9fee2dc450a0cabad341719560a794ac43c3e50e5b1fece9e71443a9295f31e1"}
Jul 13 07:13:16.339040 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.339004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh" event={"ID":"7a8c30a1-30d8-49e4-8535-40222abb4019","Type":"ContainerStarted","Data":"5fb9578137daf8794bbd8af50744a9308305624f36e84423fea354cef8d4e3dc"}
Jul 13 07:13:16.341834 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.341801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dh42w" event={"ID":"8bd1f393-12a6-4a56-8605-4c2f0c3def97","Type":"ContainerStarted","Data":"60e246af38696295c15604213bdb7960fc0cc49c954c56fc1ae993f3b892d854"}
Jul 13 07:13:16.341940 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.341855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dh42w" event={"ID":"8bd1f393-12a6-4a56-8605-4c2f0c3def97","Type":"ContainerStarted","Data":"2b7032f9294168d17fe55d12e49c3466e176f63532a2e7ebbd47dda62c8b9334"}
Jul 13 07:13:16.348515 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.348457    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wvfbf" podStartSLOduration=2.032007104 podStartE2EDuration="7.348416836s" totalImagesPullingTime="5.316409732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:16.347117688 +0000 UTC m=+62.053994992" watchObservedRunningTime="2026-07-13 07:13:16.348416836 +0000 UTC m=+62.055294139"
Jul 13 07:13:16.365959 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:16.365900    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-652tj" podStartSLOduration=2.394115119 podStartE2EDuration="7.365874597s" totalImagesPullingTime="4.971759478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:16.365000917 +0000 UTC m=+62.071878251" watchObservedRunningTime="2026-07-13 07:13:16.365874597 +0000 UTC m=+62.072751901"
Jul 13 07:13:17.256083 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:17.256050    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dblg6"
Jul 13 07:13:19.512016 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.511970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:13:19.514722 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.514693    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 07:13:19.525160 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.525131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46cfca3b-e76c-46a7-a4ab-196e727c3e85-metrics-certs\") pod \"network-metrics-daemon-g6mws\" (UID: \"46cfca3b-e76c-46a7-a4ab-196e727c3e85\") " pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:13:19.613237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.613187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:19.613454 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.613263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:19.616618 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.616587    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 07:13:19.616618 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.616611    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 07:13:19.626910 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.626879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a07db2fc-5703-4db6-b9b1-93486b584ec4-original-pull-secret\") pod \"global-pull-secret-syncer-6gdkr\" (UID: \"a07db2fc-5703-4db6-b9b1-93486b584ec4\") " pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:19.627172 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.627146    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 07:13:19.636882 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.636849    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6gdkr"
Jul 13 07:13:19.638303 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.638273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctz69\" (UniqueName: \"kubernetes.io/projected/a24688f8-8334-4ec7-bd1b-6cad27ecc472-kube-api-access-ctz69\") pod \"network-check-target-459sm\" (UID: \"a24688f8-8334-4ec7-bd1b-6cad27ecc472\") " pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:19.825539 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.825510    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5sc2t\""
Jul 13 07:13:19.833816 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.833784    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g6mws"
Jul 13 07:13:19.933300 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.932907    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4492s\""
Jul 13 07:13:19.940622 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:19.940565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:20.106383 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.106324    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6gdkr"]
Jul 13 07:13:20.110969 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:20.110936    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07db2fc_5703_4db6_b9b1_93486b584ec4.slice/crio-5a9b664cfb0707f623446a345f9391f0cc484d1f6e88681194bf0206a31ac72d WatchSource:0}: Error finding container 5a9b664cfb0707f623446a345f9391f0cc484d1f6e88681194bf0206a31ac72d: Status 404 returned error can't find the container with id 5a9b664cfb0707f623446a345f9391f0cc484d1f6e88681194bf0206a31ac72d
Jul 13 07:13:20.134244 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.134209    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g6mws"]
Jul 13 07:13:20.138021 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:20.137991    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46cfca3b_e76c_46a7_a4ab_196e727c3e85.slice/crio-23bf1fc74208e5f2dc9421be1d5159dcf5a8190d16d7b654a624e6a9e12d3796 WatchSource:0}: Error finding container 23bf1fc74208e5f2dc9421be1d5159dcf5a8190d16d7b654a624e6a9e12d3796: Status 404 returned error can't find the container with id 23bf1fc74208e5f2dc9421be1d5159dcf5a8190d16d7b654a624e6a9e12d3796
Jul 13 07:13:20.147452 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.147415    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-459sm"]
Jul 13 07:13:20.151198 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:20.151172    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24688f8_8334_4ec7_bd1b_6cad27ecc472.slice/crio-370dadc086c7cd11f4d72be0965e5f2e86687c15f4a121495436c2fabf1935ba WatchSource:0}: Error finding container 370dadc086c7cd11f4d72be0965e5f2e86687c15f4a121495436c2fabf1935ba: Status 404 returned error can't find the container with id 370dadc086c7cd11f4d72be0965e5f2e86687c15f4a121495436c2fabf1935ba
Jul 13 07:13:20.358057 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.357951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh" event={"ID":"7a8c30a1-30d8-49e4-8535-40222abb4019","Type":"ContainerStarted","Data":"5a58f6183b7fa4da3439f0ebe2fe4fda0fe741c0e96cb8e817ae995516e59eba"}
Jul 13 07:13:20.358057 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.358015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh" event={"ID":"7a8c30a1-30d8-49e4-8535-40222abb4019","Type":"ContainerStarted","Data":"b1e92f85b58dcf9bc14a2de89debfffdab3959bca1ec9bbe2dbcadb64faaab44"}
Jul 13 07:13:20.360290 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.360259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dh42w" event={"ID":"8bd1f393-12a6-4a56-8605-4c2f0c3def97","Type":"ContainerStarted","Data":"58fb01fc6ddda8fc2eeee5a1a6f9f6632240085310e5126ce69dd8dc0145132a"}
Jul 13 07:13:20.361691 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.361661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g6mws" event={"ID":"46cfca3b-e76c-46a7-a4ab-196e727c3e85","Type":"ContainerStarted","Data":"23bf1fc74208e5f2dc9421be1d5159dcf5a8190d16d7b654a624e6a9e12d3796"}
Jul 13 07:13:20.362894 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.362870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-459sm" event={"ID":"a24688f8-8334-4ec7-bd1b-6cad27ecc472","Type":"ContainerStarted","Data":"370dadc086c7cd11f4d72be0965e5f2e86687c15f4a121495436c2fabf1935ba"}
Jul 13 07:13:20.363921 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.363897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gdkr" event={"ID":"a07db2fc-5703-4db6-b9b1-93486b584ec4","Type":"ContainerStarted","Data":"5a9b664cfb0707f623446a345f9391f0cc484d1f6e88681194bf0206a31ac72d"}
Jul 13 07:13:20.365315 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.365288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b457674f5-kj4jk" event={"ID":"7d60e047-25fd-4573-9f08-311bf31494e3","Type":"ContainerStarted","Data":"1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5"}
Jul 13 07:13:20.375602 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.375551    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-xspkh" podStartSLOduration=4.213289525 podStartE2EDuration="8.37553172s" totalImagesPullingTime="4.162242195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:20.375163586 +0000 UTC m=+66.082040910" watchObservedRunningTime="2026-07-13 07:13:20.37553172 +0000 UTC m=+66.082409025"
Jul 13 07:13:20.395219 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.395162    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dh42w" podStartSLOduration=1.9025252049999999 podStartE2EDuration="11.395141341s" totalImagesPullingTime="9.492616136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:13:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:20.395028381 +0000 UTC m=+66.101905710" watchObservedRunningTime="2026-07-13 07:13:20.395141341 +0000 UTC m=+66.102018646"
Jul 13 07:13:20.417635 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:20.417578    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b457674f5-kj4jk" podStartSLOduration=1.26145095 podStartE2EDuration="5.417559472s" totalImagesPullingTime="4.156108522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:20.416830914 +0000 UTC m=+66.123708217" watchObservedRunningTime="2026-07-13 07:13:20.417559472 +0000 UTC m=+66.124436775"
Jul 13 07:13:21.377597 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:21.377378    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g6mws" event={"ID":"46cfca3b-e76c-46a7-a4ab-196e727c3e85","Type":"ContainerStarted","Data":"1519cd1c6f56b8937a2436b1af07b0c4118856d1437185c88d8db378d00a969e"}
Jul 13 07:13:21.377597 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:21.377506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g6mws" event={"ID":"46cfca3b-e76c-46a7-a4ab-196e727c3e85","Type":"ContainerStarted","Data":"5742969e671256a7d63405ad7cf12d74299ea9154f8e60e20d65f081cdae452b"}
Jul 13 07:13:21.397329 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:21.397201    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g6mws" podStartSLOduration=65.405522738 podStartE2EDuration="1m6.397180634s" totalImagesPullingTime="991.657896ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:21.395486214 +0000 UTC m=+67.102363538" watchObservedRunningTime="2026-07-13 07:13:21.397180634 +0000 UTC m=+67.104057937"
Jul 13 07:13:22.377492 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.377378    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"]
Jul 13 07:13:22.381770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.381607    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"]
Jul 13 07:13:22.382209 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.381928    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.383901 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.383879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.385559 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.385534    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 13 07:13:22.385695 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.385565    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9fksm\""
Jul 13 07:13:22.385888 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.385865    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 13 07:13:22.386767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.386744    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 13 07:13:22.386866 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.386791    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 13 07:13:22.387058 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.386994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fs46n\""
Jul 13 07:13:22.387135 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.387056    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 13 07:13:22.399980 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.399895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"]
Jul 13 07:13:22.401869 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.401841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"]
Jul 13 07:13:22.402592 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.402573    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7rggb"]
Jul 13 07:13:22.405497 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.405477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.408506 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.408480    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 07:13:22.408657 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.408634    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ddsqx\""
Jul 13 07:13:22.408657 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.408492    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 07:13:22.408901 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.408884    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 07:13:22.433599 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.433599 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-root\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.433813 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbd9\" (UniqueName: \"kubernetes.io/projected/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-api-access-zdbd9\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.433813 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.433813 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.433813 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-676wx\" (UniqueName: \"kubernetes.io/projected/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-kube-api-access-676wx\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.433813 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-textfile\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.434041 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-tls\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.434041 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.434041 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.434041 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.433973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.434041 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.434003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-sys\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.434281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.434072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.434281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.434099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba66db81-908a-47ba-975d-159f1ac2b204-metrics-client-ca\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.434281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.434132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.434281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.434165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.434281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.434207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-wtmp\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.434281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.434250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8s8v\" (UniqueName: \"kubernetes.io/projected/ba66db81-908a-47ba-975d-159f1ac2b204-kube-api-access-j8s8v\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.434578 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.434286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.534959 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.534925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-tls\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.534959 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.534966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.534996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-sys\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba66db81-908a-47ba-975d-159f1ac2b204-metrics-client-ca\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:22.535103    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-sys\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:22.535179    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 13 07:13:22.535230 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:22.535184    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-tls podName:ba66db81-908a-47ba-975d-159f1ac2b204 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:23.035162679 +0000 UTC m=+68.742039977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-tls") pod "node-exporter-7rggb" (UID: "ba66db81-908a-47ba-975d-159f1ac2b204") : secret "node-exporter-tls" not found
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:22.535412    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-tls podName:3366b9b6-ea5b-4e73-8e77-5a562c1be2ec nodeName:}" failed. No retries permitted until 2026-07-13 07:13:23.035381132 +0000 UTC m=+68.742258416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-gxgjq" (UID: "3366b9b6-ea5b-4e73-8e77-5a562c1be2ec") : secret "kube-state-metrics-tls" not found
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-wtmp\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8s8v\" (UniqueName: \"kubernetes.io/projected/ba66db81-908a-47ba-975d-159f1ac2b204-kube-api-access-j8s8v\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-root\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbd9\" (UniqueName: \"kubernetes.io/projected/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-api-access-zdbd9\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.535742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-676wx\" (UniqueName: \"kubernetes.io/projected/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-kube-api-access-676wx\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-textfile\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba66db81-908a-47ba-975d-159f1ac2b204-metrics-client-ca\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-accelerators-collector-config\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.535975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-wtmp\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.536042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba66db81-908a-47ba-975d-159f1ac2b204-root\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.536085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-textfile\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.536281 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.536252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.536704 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.536654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.538254 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.538205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.538569 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.538522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.539205 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.539180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.539701 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.539664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.545064 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.545036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-676wx\" (UniqueName: \"kubernetes.io/projected/fd6e2ed6-ab73-4057-9f69-af85280dcdb0-kube-api-access-676wx\") pod \"openshift-state-metrics-84bd68b896-spnpt\" (UID: \"fd6e2ed6-ab73-4057-9f69-af85280dcdb0\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:22.545308 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.545273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8s8v\" (UniqueName: \"kubernetes.io/projected/ba66db81-908a-47ba-975d-159f1ac2b204-kube-api-access-j8s8v\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:22.547483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.547452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbd9\" (UniqueName: \"kubernetes.io/projected/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-api-access-zdbd9\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:22.704086 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:22.704007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"
Jul 13 07:13:23.039932 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.039893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-tls\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:23.040108 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.039979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:23.042916 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.042879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba66db81-908a-47ba-975d-159f1ac2b204-node-exporter-tls\") pod \"node-exporter-7rggb\" (UID: \"ba66db81-908a-47ba-975d-159f1ac2b204\") " pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:23.043072 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.043011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3366b9b6-ea5b-4e73-8e77-5a562c1be2ec-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-gxgjq\" (UID: \"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:23.296110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.296023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"
Jul 13 07:13:23.320534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.320501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7rggb"
Jul 13 07:13:23.447241 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.447208    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 07:13:23.449790 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.449765    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.453485 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.453461    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 07:13:23.453485 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.453473    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 07:13:23.454050 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.454032    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 07:13:23.454305 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.454290    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 07:13:23.455573 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.455420    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 07:13:23.455573 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.455429    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 07:13:23.455573 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.455463    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 07:13:23.455573 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.455490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 07:13:23.456135 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.455612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 07:13:23.456902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.456594    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2mljl\""
Jul 13 07:13:23.469493 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.469224    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 07:13:23.543898 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.543865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3dc766-f0aa-4d90-b668-69c85f83b505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544073 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.543914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544073 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.543934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mh2m\" (UniqueName: \"kubernetes.io/projected/ca3dc766-f0aa-4d90-b668-69c85f83b505-kube-api-access-4mh2m\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544073 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544240 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3dc766-f0aa-4d90-b668-69c85f83b505-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544240 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544240 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544184    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544240 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544240 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3dc766-f0aa-4d90-b668-69c85f83b505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3dc766-f0aa-4d90-b668-69c85f83b505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.544483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.544457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3dc766-f0aa-4d90-b668-69c85f83b505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645197 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3dc766-f0aa-4d90-b668-69c85f83b505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645197 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645423 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mh2m\" (UniqueName: \"kubernetes.io/projected/ca3dc766-f0aa-4d90-b668-69c85f83b505-kube-api-access-4mh2m\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645423 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645423 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3dc766-f0aa-4d90-b668-69c85f83b505-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645565 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645565 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645565 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645565 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645777 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3dc766-f0aa-4d90-b668-69c85f83b505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645777 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ca3dc766-f0aa-4d90-b668-69c85f83b505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645777 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3dc766-f0aa-4d90-b668-69c85f83b505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645777 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.645777 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.645732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3dc766-f0aa-4d90-b668-69c85f83b505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.646752 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.646682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3dc766-f0aa-4d90-b668-69c85f83b505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.647775 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.647699    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca3dc766-f0aa-4d90-b668-69c85f83b505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.648814 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.648768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.649603 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.649544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.649713 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.649695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-web-config\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.650021 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.649974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca3dc766-f0aa-4d90-b668-69c85f83b505-config-out\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.650377 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.650110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-config-volume\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.650650 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.650533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca3dc766-f0aa-4d90-b668-69c85f83b505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.650784 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.650740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.651299 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.651274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.652332 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.652312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca3dc766-f0aa-4d90-b668-69c85f83b505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.658567 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.658533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mh2m\" (UniqueName: \"kubernetes.io/projected/ca3dc766-f0aa-4d90-b668-69c85f83b505-kube-api-access-4mh2m\") pod \"alertmanager-main-0\" (UID: \"ca3dc766-f0aa-4d90-b668-69c85f83b505\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:23.761851 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:23.761816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 07:13:24.315992 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.315951    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-dbc847896-2gtqt"]
Jul 13 07:13:24.337962 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.337927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dbc847896-2gtqt"]
Jul 13 07:13:24.338125 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.338028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.340682 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.340656    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 13 07:13:24.340824 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.340719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 13 07:13:24.341138 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.340966    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kbgbq\""
Jul 13 07:13:24.341138 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.341017    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 13 07:13:24.341138 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.341086    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 13 07:13:24.341367 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.341166    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ed1kmdsj0rmbo\""
Jul 13 07:13:24.341791 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.341618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 13 07:13:24.453807 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.453748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-tls\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.454249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.453842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.454249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.453878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.454249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.453919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3e825c-5ae2-4265-a86e-a681f5aca448-metrics-client-ca\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.454249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.454003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.454249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.454044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-grpc-tls\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.454249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.454081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mwr2\" (UniqueName: \"kubernetes.io/projected/6d3e825c-5ae2-4265-a86e-a681f5aca448-kube-api-access-4mwr2\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.454249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.454137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555020 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.554977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.555044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3e825c-5ae2-4265-a86e-a681f5aca448-metrics-client-ca\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.555080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.555109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-grpc-tls\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.555138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mwr2\" (UniqueName: \"kubernetes.io/projected/6d3e825c-5ae2-4265-a86e-a681f5aca448-kube-api-access-4mwr2\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.555167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.555212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-tls\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555607 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.555279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.555971 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.555913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d3e825c-5ae2-4265-a86e-a681f5aca448-metrics-client-ca\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.558257 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.558229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.558384 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.558271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-grpc-tls\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.558384 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.558348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.558540 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.558428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.558604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.558549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.559307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.559285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d3e825c-5ae2-4265-a86e-a681f5aca448-secret-thanos-querier-tls\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.563534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.563506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mwr2\" (UniqueName: \"kubernetes.io/projected/6d3e825c-5ae2-4265-a86e-a681f5aca448-kube-api-access-4mwr2\") pod \"thanos-querier-dbc847896-2gtqt\" (UID: \"6d3e825c-5ae2-4265-a86e-a681f5aca448\") " pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:24.649681 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:24.649593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:25.128131 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:25.126588    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba66db81_908a_47ba_975d_159f1ac2b204.slice/crio-57e28fe857292791cb3ece0b71ea24f9b988bca1219a23f5eb13304c097984db WatchSource:0}: Error finding container 57e28fe857292791cb3ece0b71ea24f9b988bca1219a23f5eb13304c097984db: Status 404 returned error can't find the container with id 57e28fe857292791cb3ece0b71ea24f9b988bca1219a23f5eb13304c097984db
Jul 13 07:13:25.331059 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.331022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 07:13:25.335377 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:25.335335    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3dc766_f0aa_4d90_b668_69c85f83b505.slice/crio-f01cefd7fdb97f98d47bd0c3bdd65d43d23bba13bfecdc35498ad2d763e4699f WatchSource:0}: Error finding container f01cefd7fdb97f98d47bd0c3bdd65d43d23bba13bfecdc35498ad2d763e4699f: Status 404 returned error can't find the container with id f01cefd7fdb97f98d47bd0c3bdd65d43d23bba13bfecdc35498ad2d763e4699f
Jul 13 07:13:25.356151 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.356118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:25.356311 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.356183    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:25.362495 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.362463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:25.368568 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.368546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-gxgjq"]
Jul 13 07:13:25.371305 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:25.371275    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3366b9b6_ea5b_4e73_8e77_5a562c1be2ec.slice/crio-57f3a8d74403131072f523187dff439501a9064e1f1749473e5bead9f727cacf WatchSource:0}: Error finding container 57f3a8d74403131072f523187dff439501a9064e1f1749473e5bead9f727cacf: Status 404 returned error can't find the container with id 57f3a8d74403131072f523187dff439501a9064e1f1749473e5bead9f727cacf
Jul 13 07:13:25.396336 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.396295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3dc766-f0aa-4d90-b668-69c85f83b505","Type":"ContainerStarted","Data":"f01cefd7fdb97f98d47bd0c3bdd65d43d23bba13bfecdc35498ad2d763e4699f"}
Jul 13 07:13:25.397604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.397568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq" event={"ID":"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec","Type":"ContainerStarted","Data":"57f3a8d74403131072f523187dff439501a9064e1f1749473e5bead9f727cacf"}
Jul 13 07:13:25.399143 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.399116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-459sm" event={"ID":"a24688f8-8334-4ec7-bd1b-6cad27ecc472","Type":"ContainerStarted","Data":"9c656aaff8a2195a20996a054b9b07e7b477b890eb886750ac6e164a250e12a2"}
Jul 13 07:13:25.399285 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.399247    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:13:25.401391 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.400870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6gdkr" event={"ID":"a07db2fc-5703-4db6-b9b1-93486b584ec4","Type":"ContainerStarted","Data":"9de42d593c5ec63af6fa27ca7722a6befd04ae8aeb05e0cfcc037bc3b0bbc05c"}
Jul 13 07:13:25.402476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.402450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rggb" event={"ID":"ba66db81-908a-47ba-975d-159f1ac2b204","Type":"ContainerStarted","Data":"57e28fe857292791cb3ece0b71ea24f9b988bca1219a23f5eb13304c097984db"}
Jul 13 07:13:25.406643 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.406618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:13:25.414910 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.414854    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-459sm" podStartSLOduration=65.44165508 podStartE2EDuration="1m10.414838772s" totalImagesPullingTime="4.973183692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:25.413492099 +0000 UTC m=+71.120369423" watchObservedRunningTime="2026-07-13 07:13:25.414838772 +0000 UTC m=+71.121716095"
Jul 13 07:13:25.427365 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.427312    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6gdkr" podStartSLOduration=64.410694986 podStartE2EDuration="1m9.427295433s" totalImagesPullingTime="5.016600447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:25.42686849 +0000 UTC m=+71.133745820" watchObservedRunningTime="2026-07-13 07:13:25.427295433 +0000 UTC m=+71.134172735"
Jul 13 07:13:25.534670 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.534635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt"]
Jul 13 07:13:25.538086 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:25.538054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-dbc847896-2gtqt"]
Jul 13 07:13:25.538741 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:25.538710    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd6e2ed6_ab73_4057_9f69_af85280dcdb0.slice/crio-cc9245f013e982b50c90d2f94aba049d6720cc2b180ea3bf1257d460350fb2f3 WatchSource:0}: Error finding container cc9245f013e982b50c90d2f94aba049d6720cc2b180ea3bf1257d460350fb2f3: Status 404 returned error can't find the container with id cc9245f013e982b50c90d2f94aba049d6720cc2b180ea3bf1257d460350fb2f3
Jul 13 07:13:25.541244 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:25.541208    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3e825c_5ae2_4265_a86e_a681f5aca448.slice/crio-39371ab1d6f805bc816f884e00c47a1f26968f3734519b0a56dc6c2826fe7a65 WatchSource:0}: Error finding container 39371ab1d6f805bc816f884e00c47a1f26968f3734519b0a56dc6c2826fe7a65: Status 404 returned error can't find the container with id 39371ab1d6f805bc816f884e00c47a1f26968f3734519b0a56dc6c2826fe7a65
Jul 13 07:13:26.349561 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.349526    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-652tj"
Jul 13 07:13:26.409333 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.409259    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt" event={"ID":"6d3e825c-5ae2-4265-a86e-a681f5aca448","Type":"ContainerStarted","Data":"39371ab1d6f805bc816f884e00c47a1f26968f3734519b0a56dc6c2826fe7a65"}
Jul 13 07:13:26.412241 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.412204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt" event={"ID":"fd6e2ed6-ab73-4057-9f69-af85280dcdb0","Type":"ContainerStarted","Data":"a5dfbc906b02f36c6353d25e113852f35295248de89a73150bf6e975aa0acffd"}
Jul 13 07:13:26.412395 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.412275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt" event={"ID":"fd6e2ed6-ab73-4057-9f69-af85280dcdb0","Type":"ContainerStarted","Data":"319bde4e5618e61c1d2a5476fc49711f90595c1b75e4af0068cdf2e3927937d6"}
Jul 13 07:13:26.412395 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.412304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt" event={"ID":"fd6e2ed6-ab73-4057-9f69-af85280dcdb0","Type":"ContainerStarted","Data":"cc9245f013e982b50c90d2f94aba049d6720cc2b180ea3bf1257d460350fb2f3"}
Jul 13 07:13:26.415828 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.414976    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba66db81-908a-47ba-975d-159f1ac2b204" containerID="c4eb7f059ee5a2914a0c3e3cf79fa56836b3103d9732c82dcce63fab5f1434e0" exitCode=0
Jul 13 07:13:26.415828 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.415076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rggb" event={"ID":"ba66db81-908a-47ba-975d-159f1ac2b204","Type":"ContainerDied","Data":"c4eb7f059ee5a2914a0c3e3cf79fa56836b3103d9732c82dcce63fab5f1434e0"}
Jul 13 07:13:26.773667 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.773587    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"]
Jul 13 07:13:26.776534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.776494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.783030 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.782999    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 07:13:26.786183 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.785904    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 13 07:13:26.786183 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.785966    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 13 07:13:26.786183 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.785996    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qgkr6\""
Jul 13 07:13:26.786183 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.785905    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 13 07:13:26.786183 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.785905    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-73e0s08m980g5\""
Jul 13 07:13:26.788929 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.788835    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"]
Jul 13 07:13:26.879605 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.879556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-secret-metrics-server-tls\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.879797 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.879618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d6de3496-5907-4394-b4d1-fc0a19c367db-audit-log\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.879797 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.879719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d6de3496-5907-4394-b4d1-fc0a19c367db-metrics-server-audit-profiles\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.879797 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.879754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-secret-metrics-server-client-certs\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.879797 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.879779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g84pb\" (UniqueName: \"kubernetes.io/projected/d6de3496-5907-4394-b4d1-fc0a19c367db-kube-api-access-g84pb\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.880009 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.879823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6de3496-5907-4394-b4d1-fc0a19c367db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.880009 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.879903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-client-ca-bundle\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.981130 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.981077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d6de3496-5907-4394-b4d1-fc0a19c367db-metrics-server-audit-profiles\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.981130 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.981134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-secret-metrics-server-client-certs\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.981404 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.981157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g84pb\" (UniqueName: \"kubernetes.io/projected/d6de3496-5907-4394-b4d1-fc0a19c367db-kube-api-access-g84pb\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.981404 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.981195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6de3496-5907-4394-b4d1-fc0a19c367db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.981404 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.981236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-client-ca-bundle\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.981404 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.981268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-secret-metrics-server-tls\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.981404 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.981312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d6de3496-5907-4394-b4d1-fc0a19c367db-audit-log\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.982054 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.982002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d6de3496-5907-4394-b4d1-fc0a19c367db-audit-log\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.982174 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.982063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6de3496-5907-4394-b4d1-fc0a19c367db-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.982299 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.982273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d6de3496-5907-4394-b4d1-fc0a19c367db-metrics-server-audit-profiles\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.984186 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.984153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-client-ca-bundle\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.984314 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.984233    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-secret-metrics-server-client-certs\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.984314 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.984260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d6de3496-5907-4394-b4d1-fc0a19c367db-secret-metrics-server-tls\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:26.989916 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:26.989890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g84pb\" (UniqueName: \"kubernetes.io/projected/d6de3496-5907-4394-b4d1-fc0a19c367db-kube-api-access-g84pb\") pod \"metrics-server-7fcd484c5b-5s6jb\" (UID: \"d6de3496-5907-4394-b4d1-fc0a19c367db\") " pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:27.068361 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.068325    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"]
Jul 13 07:13:27.071064 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.071037    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:27.074924 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.074896    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 13 07:13:27.075108 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.074964    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qkjw7\""
Jul 13 07:13:27.082002 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.081895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"]
Jul 13 07:13:27.089924 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.089892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:27.183036 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.182990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rljr7\" (UniqueName: \"kubernetes.io/projected/1b645680-65e7-437f-ae49-f9bc4a9c2d10-kube-api-access-rljr7\") pod \"monitoring-plugin-5f68df7f58-9t5nl\" (UID: \"1b645680-65e7-437f-ae49-f9bc4a9c2d10\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:27.183202 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.183082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b645680-65e7-437f-ae49-f9bc4a9c2d10-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9t5nl\" (UID: \"1b645680-65e7-437f-ae49-f9bc4a9c2d10\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:27.284809 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.284370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b645680-65e7-437f-ae49-f9bc4a9c2d10-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9t5nl\" (UID: \"1b645680-65e7-437f-ae49-f9bc4a9c2d10\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:27.284809 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.284507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rljr7\" (UniqueName: \"kubernetes.io/projected/1b645680-65e7-437f-ae49-f9bc4a9c2d10-kube-api-access-rljr7\") pod \"monitoring-plugin-5f68df7f58-9t5nl\" (UID: \"1b645680-65e7-437f-ae49-f9bc4a9c2d10\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:27.284809 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:27.284577    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 13 07:13:27.284809 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:13:27.284662    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b645680-65e7-437f-ae49-f9bc4a9c2d10-monitoring-plugin-cert podName:1b645680-65e7-437f-ae49-f9bc4a9c2d10 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:27.784637633 +0000 UTC m=+73.491514919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1b645680-65e7-437f-ae49-f9bc4a9c2d10-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-9t5nl" (UID: "1b645680-65e7-437f-ae49-f9bc4a9c2d10") : secret "monitoring-plugin-cert" not found
Jul 13 07:13:27.293227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.293194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rljr7\" (UniqueName: \"kubernetes.io/projected/1b645680-65e7-437f-ae49-f9bc4a9c2d10-kube-api-access-rljr7\") pod \"monitoring-plugin-5f68df7f58-9t5nl\" (UID: \"1b645680-65e7-437f-ae49-f9bc4a9c2d10\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:27.495631 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.495577    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"]
Jul 13 07:13:27.499354 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.499328    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.501765 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.501738    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 13 07:13:27.501909 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.501781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 13 07:13:27.501909 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.501793    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 13 07:13:27.501909 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.501814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-26d6k\""
Jul 13 07:13:27.501909 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.501738    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 13 07:13:27.502182 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.502165    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 13 07:13:27.506982 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.506951    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 13 07:13:27.511073 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.510997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"]
Jul 13 07:13:27.587657 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.587567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.587657 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.587638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-federate-client-tls\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.587851 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.587705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-metrics-client-ca\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.587851 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.587800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-telemeter-client-tls\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.587959 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.587867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksxtq\" (UniqueName: \"kubernetes.io/projected/e81adf55-2a33-491e-9828-45a71df17013-kube-api-access-ksxtq\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.587959 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.587931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.588050 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.587966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-secret-telemeter-client\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.588050 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.588031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-serving-certs-ca-bundle\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.689390 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.689344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksxtq\" (UniqueName: \"kubernetes.io/projected/e81adf55-2a33-491e-9828-45a71df17013-kube-api-access-ksxtq\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.689610 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.689449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.689610 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.689478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-secret-telemeter-client\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.689610 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.689500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-serving-certs-ca-bundle\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.689759 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.689621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.689759 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.689686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-federate-client-tls\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.689759 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.689711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-metrics-client-ca\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.689908 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.689756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-telemeter-client-tls\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.690302 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.690243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-serving-certs-ca-bundle\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.690468 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.690408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-metrics-client-ca\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.690649 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.690603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e81adf55-2a33-491e-9828-45a71df17013-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.692761 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.692716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-secret-telemeter-client\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.692865 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.692781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.692865 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.692845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-federate-client-tls\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.692966 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.692917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e81adf55-2a33-491e-9828-45a71df17013-telemeter-client-tls\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.698520 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.698499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksxtq\" (UniqueName: \"kubernetes.io/projected/e81adf55-2a33-491e-9828-45a71df17013-kube-api-access-ksxtq\") pod \"telemeter-client-5fc99d999d-mh9zt\" (UID: \"e81adf55-2a33-491e-9828-45a71df17013\") " pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.790631 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.790577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b645680-65e7-437f-ae49-f9bc4a9c2d10-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9t5nl\" (UID: \"1b645680-65e7-437f-ae49-f9bc4a9c2d10\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:27.793395 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.793362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b645680-65e7-437f-ae49-f9bc4a9c2d10-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9t5nl\" (UID: \"1b645680-65e7-437f-ae49-f9bc4a9c2d10\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:27.812403 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.812368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"
Jul 13 07:13:27.985093 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:27.985064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:28.045606 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.045211    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"]
Jul 13 07:13:28.088518 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.087982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5fc99d999d-mh9zt"]
Jul 13 07:13:28.214420 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.213994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"]
Jul 13 07:13:28.428997 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.428890    2565 generic.go:356] "Generic (PLEG): container finished" podID="ca3dc766-f0aa-4d90-b668-69c85f83b505" containerID="b22d2fb305e2c642f9f075a197abcd1d24cd9b32a407996c6a92fa9dbc94668b" exitCode=0
Jul 13 07:13:28.429355 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.429012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3dc766-f0aa-4d90-b668-69c85f83b505","Type":"ContainerDied","Data":"b22d2fb305e2c642f9f075a197abcd1d24cd9b32a407996c6a92fa9dbc94668b"}
Jul 13 07:13:28.434212 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.434177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq" event={"ID":"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec","Type":"ContainerStarted","Data":"c8e9ccd130bffa731e80a258cfdc8a940672376ca152c92c5b4de65d9d952506"}
Jul 13 07:13:28.434325 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.434242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq" event={"ID":"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec","Type":"ContainerStarted","Data":"f2507b91818020b5c9180a404b579726139be2980d7976f3a3d868860dd7a551"}
Jul 13 07:13:28.434325 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.434273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq" event={"ID":"3366b9b6-ea5b-4e73-8e77-5a562c1be2ec","Type":"ContainerStarted","Data":"b93d3dfcf514d64ef7ade3c6c607272cc7d57ea12e043f7849a42aebd196d140"}
Jul 13 07:13:28.437183 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.437156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt" event={"ID":"6d3e825c-5ae2-4265-a86e-a681f5aca448","Type":"ContainerStarted","Data":"ae99f467a2807bd38d601d42356b38ad971685361e1e64fb4bfd732f840cd85b"}
Jul 13 07:13:28.437313 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.437233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt" event={"ID":"6d3e825c-5ae2-4265-a86e-a681f5aca448","Type":"ContainerStarted","Data":"a7a430a280d3315b59bb65f187d1c241f23d8b6e11eb99e7fa55e07f3b502741"}
Jul 13 07:13:28.437313 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.437276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt" event={"ID":"6d3e825c-5ae2-4265-a86e-a681f5aca448","Type":"ContainerStarted","Data":"d28233d13e77cab747216e067a74021ddbe2c5af990928bdd3a99429cf054305"}
Jul 13 07:13:28.438950 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.438919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl" event={"ID":"1b645680-65e7-437f-ae49-f9bc4a9c2d10","Type":"ContainerStarted","Data":"f87733127ffeb5b9ccb932b0dd03b4a3f457e81f7e617c38cf6942cfa15a88b9"}
Jul 13 07:13:28.441348 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.441275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt" event={"ID":"e81adf55-2a33-491e-9828-45a71df17013","Type":"ContainerStarted","Data":"2a724fb8a92d2da1b4d237e85f0e057df62d907af39ee97babbe20ea1011d7a1"}
Jul 13 07:13:28.444094 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.444070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt" event={"ID":"fd6e2ed6-ab73-4057-9f69-af85280dcdb0","Type":"ContainerStarted","Data":"a305a8374e3855e9d5812411cc691368c761fd7c2638535342a344788214789e"}
Jul 13 07:13:28.447501 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.447467    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rggb" event={"ID":"ba66db81-908a-47ba-975d-159f1ac2b204","Type":"ContainerStarted","Data":"ad2337c0bc415d54b3b3ab341d846b4b44089a9340a6096352c05954b2d229d6"}
Jul 13 07:13:28.447615 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.447521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7rggb" event={"ID":"ba66db81-908a-47ba-975d-159f1ac2b204","Type":"ContainerStarted","Data":"640e24b2d3a277b320a9e217f4eec18e964c8558bacf8590c02111718e42cfe4"}
Jul 13 07:13:28.448686 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.448656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb" event={"ID":"d6de3496-5907-4394-b4d1-fc0a19c367db","Type":"ContainerStarted","Data":"21e6f1631d48720fdfa5752154f0d7d657a152bfe5b8e97020754e7c050651c6"}
Jul 13 07:13:28.479227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.479168    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-gxgjq" podStartSLOduration=3.986342663 podStartE2EDuration="6.479147948s" totalImagesPullingTime="2.492805285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:28.478255993 +0000 UTC m=+74.185133297" watchObservedRunningTime="2026-07-13 07:13:28.479147948 +0000 UTC m=+74.186025251"
Jul 13 07:13:28.501409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.501338    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7rggb" podStartSLOduration=5.593206426 podStartE2EDuration="6.501314999s" totalImagesPullingTime="820.970021ms" totalInitContainerRuntime="87.138552ms" isStatefulPod=true podCreationTimestamp="2026-07-13 07:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:28.500362876 +0000 UTC m=+74.207240198" watchObservedRunningTime="2026-07-13 07:13:28.501314999 +0000 UTC m=+74.208192286"
Jul 13 07:13:28.521936 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.521876    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-spnpt" podStartSLOduration=4.349275732 podStartE2EDuration="6.521827177s" totalImagesPullingTime="2.172551445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:28.521048097 +0000 UTC m=+74.227925449" watchObservedRunningTime="2026-07-13 07:13:28.521827177 +0000 UTC m=+74.228704481"
Jul 13 07:13:28.625229 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.625194    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 07:13:28.629331 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.629286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.633057    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.633423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.633599    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.633690    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.633808    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.633986    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.634188    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.634331    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 07:13:28.634466 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.634380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 07:13:28.634970 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.634550    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sn4cs\""
Jul 13 07:13:28.635273 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.635245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 07:13:28.635273 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.635270    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 07:13:28.635509 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.635362    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 07:13:28.635857 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.635840    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ed2s1gofgn4lm\""
Jul 13 07:13:28.637140 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.637120    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 07:13:28.641347 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.641327    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 07:13:28.651388 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.651354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 07:13:28.716181 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.716060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.716689 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.716637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.717001 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.716924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.717233 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.717489 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c8pc\" (UniqueName: \"kubernetes.io/projected/caa13f40-d33b-4661-b8da-7557ea478093-kube-api-access-5c8pc\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa13f40-d33b-4661-b8da-7557ea478093-config-out\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-config\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa13f40-d33b-4661-b8da-7557ea478093-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.717972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.718013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.718046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.718877 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.718072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-web-config\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.820722 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa13f40-d33b-4661-b8da-7557ea478093-config-out\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-config\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820840    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.820962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.821210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.821003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa13f40-d33b-4661-b8da-7557ea478093-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.821026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-web-config\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.825817 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.822424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8pc\" (UniqueName: \"kubernetes.io/projected/caa13f40-d33b-4661-b8da-7557ea478093-kube-api-access-5c8pc\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.826384 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.826358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.826457 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.826382    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.827957 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.826984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.827957 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.826993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.827957 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.827644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.829270 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.828732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.832579 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.830243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.832579 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.830726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/caa13f40-d33b-4661-b8da-7557ea478093-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.832579 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.832516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.832579 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.832546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c8pc\" (UniqueName: \"kubernetes.io/projected/caa13f40-d33b-4661-b8da-7557ea478093-kube-api-access-5c8pc\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.836747 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.836717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.836970 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.836941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-web-config\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.837697 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.837170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.837697 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.837385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.837697 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.837532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.837697 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.837635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-config\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.837952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.837920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.838392 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.838350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa13f40-d33b-4661-b8da-7557ea478093-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.838681 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.838594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa13f40-d33b-4661-b8da-7557ea478093-config-out\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.838681 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.838595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa13f40-d33b-4661-b8da-7557ea478093-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"caa13f40-d33b-4661-b8da-7557ea478093\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:28.944477 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:28.944416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:29.172664 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:29.172557    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 07:13:29.311342 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:13:29.311291    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa13f40_d33b_4661_b8da_7557ea478093.slice/crio-c8a8931e25b007bc0d29683df7857998376d0f1fcbbe7a2ca45cf16b02fc8112 WatchSource:0}: Error finding container c8a8931e25b007bc0d29683df7857998376d0f1fcbbe7a2ca45cf16b02fc8112: Status 404 returned error can't find the container with id c8a8931e25b007bc0d29683df7857998376d0f1fcbbe7a2ca45cf16b02fc8112
Jul 13 07:13:29.459938 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:29.459483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caa13f40-d33b-4661-b8da-7557ea478093","Type":"ContainerStarted","Data":"c8a8931e25b007bc0d29683df7857998376d0f1fcbbe7a2ca45cf16b02fc8112"}
Jul 13 07:13:30.467086 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:30.467048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt" event={"ID":"6d3e825c-5ae2-4265-a86e-a681f5aca448","Type":"ContainerStarted","Data":"456fe2cc5fd5d5a7bd0aeef7340b8f0418ba4ac5bb645716d54f226ccb467f26"}
Jul 13 07:13:30.467515 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:30.467132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt" event={"ID":"6d3e825c-5ae2-4265-a86e-a681f5aca448","Type":"ContainerStarted","Data":"09d311b5f016f70e09ab79c9806a58e62b02f600970be21777c045b03fd80996"}
Jul 13 07:13:30.468806 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:30.468777    2565 generic.go:356] "Generic (PLEG): container finished" podID="caa13f40-d33b-4661-b8da-7557ea478093" containerID="36c2a6f4cdddca762a32185509127047fb2651f929ef6565c7a0e3bac8a94916" exitCode=0
Jul 13 07:13:30.468943 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:30.468869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caa13f40-d33b-4661-b8da-7557ea478093","Type":"ContainerDied","Data":"36c2a6f4cdddca762a32185509127047fb2651f929ef6565c7a0e3bac8a94916"}
Jul 13 07:13:31.503399 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:31.503281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt" event={"ID":"6d3e825c-5ae2-4265-a86e-a681f5aca448","Type":"ContainerStarted","Data":"2290ea96b4fea30246efc074aa7dd2e9a8dd4785d273a7754675c25d67b3273b"}
Jul 13 07:13:31.506075 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:31.504649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:31.529049 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:31.528987    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt" podStartSLOduration=4.042667133 podStartE2EDuration="7.528963786s" totalImagesPullingTime="3.486296653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:31.527907408 +0000 UTC m=+77.234784761" watchObservedRunningTime="2026-07-13 07:13:31.528963786 +0000 UTC m=+77.235841090"
Jul 13 07:13:32.514941 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.514904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb" event={"ID":"d6de3496-5907-4394-b4d1-fc0a19c367db","Type":"ContainerStarted","Data":"a6e118f78c3df2eee9c0f6913b8ae10b0c3f4ac98cfa233e67461fbabfd82115"}
Jul 13 07:13:32.519720 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.519678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3dc766-f0aa-4d90-b668-69c85f83b505","Type":"ContainerStarted","Data":"ad95d685e2bab18cbc885200d7d64efb8074e3f4b3ea92b680c5c9ba276995ec"}
Jul 13 07:13:32.519912 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.519757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3dc766-f0aa-4d90-b668-69c85f83b505","Type":"ContainerStarted","Data":"96c69c328f75a8d4a07cb6e3378c7caf87d39d92d041e512e6f9e2877ceb723b"}
Jul 13 07:13:32.519912 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.519798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3dc766-f0aa-4d90-b668-69c85f83b505","Type":"ContainerStarted","Data":"59b9cb5a9c440129984e995cc0ae4cddcd72f07e0d79fec764233a191b124b27"}
Jul 13 07:13:32.519912 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.519840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3dc766-f0aa-4d90-b668-69c85f83b505","Type":"ContainerStarted","Data":"8c3226b1c6b1a34e7b1dcfeb7e62c13211cad0bd6fdcb136c7b24ed060c44735"}
Jul 13 07:13:32.519912 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.519883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3dc766-f0aa-4d90-b668-69c85f83b505","Type":"ContainerStarted","Data":"b9228541d57b495212b32258912f96cef686bcc6e0d2a1b914d3210eb92e8690"}
Jul 13 07:13:32.520098 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.519922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ca3dc766-f0aa-4d90-b668-69c85f83b505","Type":"ContainerStarted","Data":"a0a52d8372b0fc45f75f66ec1dc0f8e3d9e8c7ecfdbe02bba8b82a9bb6cf788a"}
Jul 13 07:13:32.521995 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.521966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt" event={"ID":"e81adf55-2a33-491e-9828-45a71df17013","Type":"ContainerStarted","Data":"a04e4ecc8eb34485738f1dc6b90a075f79cf8caca70f3dc8c4a015f4511a1708"}
Jul 13 07:13:32.522107 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.522021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt" event={"ID":"e81adf55-2a33-491e-9828-45a71df17013","Type":"ContainerStarted","Data":"71f89f7dc506c989a117551d914d50b598bccb49fbbbcd64abcdaa30b692cede"}
Jul 13 07:13:32.522107 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.522054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt" event={"ID":"e81adf55-2a33-491e-9828-45a71df17013","Type":"ContainerStarted","Data":"4b202ea2d844944af0b48d41886efc9522ab68ce18b524dbe3fa9eafa3d2d9d7"}
Jul 13 07:13:32.523777 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.523747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl" event={"ID":"1b645680-65e7-437f-ae49-f9bc4a9c2d10","Type":"ContainerStarted","Data":"176f971ff7e691aafee98dada85a91ceceb64a5b3cace452c25d30c240bd0ad0"}
Jul 13 07:13:32.523902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.523820    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:32.529703 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.529679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl"
Jul 13 07:13:32.535682 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.535618    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb" podStartSLOduration=3.259031225 podStartE2EDuration="6.535598126s" totalImagesPullingTime="3.276566901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:32.531474205 +0000 UTC m=+78.238351536" watchObservedRunningTime="2026-07-13 07:13:32.535598126 +0000 UTC m=+78.242475430"
Jul 13 07:13:32.551753 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.551689    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9t5nl" podStartSLOduration=2.431969822 podStartE2EDuration="5.55167269s" totalImagesPullingTime="3.119702868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:32.549671633 +0000 UTC m=+78.256548959" watchObservedRunningTime="2026-07-13 07:13:32.55167269 +0000 UTC m=+78.258549994"
Jul 13 07:13:32.575904 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.575849    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.099755857 podStartE2EDuration="9.575830369s" totalImagesPullingTime="5.444251213s" totalInitContainerRuntime="31.823299ms" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:32.573816254 +0000 UTC m=+78.280693563" watchObservedRunningTime="2026-07-13 07:13:32.575830369 +0000 UTC m=+78.282707672"
Jul 13 07:13:32.594896 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:32.594840    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5fc99d999d-mh9zt" podStartSLOduration=2.352156763 podStartE2EDuration="5.59481894s" totalImagesPullingTime="3.242662177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:32.593606376 +0000 UTC m=+78.300483692" watchObservedRunningTime="2026-07-13 07:13:32.59481894 +0000 UTC m=+78.301696242"
Jul 13 07:13:33.537540 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:33.537292    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-dbc847896-2gtqt"
Jul 13 07:13:34.538738 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:34.538690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caa13f40-d33b-4661-b8da-7557ea478093","Type":"ContainerStarted","Data":"b94a4988644f738acf08eb9c88c085658034d9f23282b4486afe1d932929624b"}
Jul 13 07:13:34.539113 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:34.538783    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caa13f40-d33b-4661-b8da-7557ea478093","Type":"ContainerStarted","Data":"42553771cec61e2d89b8d397ff949352ca747c3ac30ce5ec1088c1da92821fa6"}
Jul 13 07:13:35.546912 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:35.546873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caa13f40-d33b-4661-b8da-7557ea478093","Type":"ContainerStarted","Data":"415aaddf439bb69b390af1fa09792e6c11fa7047b6f27242be20019345d0aca0"}
Jul 13 07:13:35.547308 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:35.546941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caa13f40-d33b-4661-b8da-7557ea478093","Type":"ContainerStarted","Data":"3051c22790937381be7fbe683cad2db266c13102c651ec592d3a45a3821d0d9f"}
Jul 13 07:13:35.547308 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:35.546973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caa13f40-d33b-4661-b8da-7557ea478093","Type":"ContainerStarted","Data":"07a0d30f1651be76786e7f0ca680abdb5f73b431697d88b046da31f2bfe16f46"}
Jul 13 07:13:35.547308 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:35.546998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"caa13f40-d33b-4661-b8da-7557ea478093","Type":"ContainerStarted","Data":"a33efdc36895023d1bc2a3114a759d24ed8c13d2791a63bd9db9b94983a6f8d7"}
Jul 13 07:13:35.576099 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:35.576021    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.701020368 podStartE2EDuration="7.575998497s" totalImagesPullingTime="3.836451967s" totalInitContainerRuntime="38.526162ms" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:35.573546318 +0000 UTC m=+81.280423644" watchObservedRunningTime="2026-07-13 07:13:35.575998497 +0000 UTC m=+81.282875801"
Jul 13 07:13:38.945916 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:38.945797    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:13:45.156771 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:45.156738    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b457674f5-kj4jk"]
Jul 13 07:13:47.090844 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:47.090802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:47.091228 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:47.090876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:13:56.418322 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:13:56.418288    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-459sm"
Jul 13 07:14:07.095926 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:07.095896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:14:07.104196 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:07.100056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7fcd484c5b-5s6jb"
Jul 13 07:14:10.177794 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.177735    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b457674f5-kj4jk" podUID="7d60e047-25fd-4573-9f08-311bf31494e3" containerName="console" containerID="cri-o://1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5" gracePeriod=15
Jul 13 07:14:10.424366 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.424340    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:14:10.525410 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525309    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-console-config\") pod \"7d60e047-25fd-4573-9f08-311bf31494e3\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") "
Jul 13 07:14:10.525410 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525357    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-trusted-ca-bundle\") pod \"7d60e047-25fd-4573-9f08-311bf31494e3\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") "
Jul 13 07:14:10.525670 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525421    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-oauth-config\") pod \"7d60e047-25fd-4573-9f08-311bf31494e3\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") "
Jul 13 07:14:10.525670 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phhz4\" (UniqueName: \"kubernetes.io/projected/7d60e047-25fd-4573-9f08-311bf31494e3-kube-api-access-phhz4\") pod \"7d60e047-25fd-4573-9f08-311bf31494e3\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") "
Jul 13 07:14:10.525670 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525518    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-oauth-serving-cert\") pod \"7d60e047-25fd-4573-9f08-311bf31494e3\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") "
Jul 13 07:14:10.525670 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525568    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-serving-cert\") pod \"7d60e047-25fd-4573-9f08-311bf31494e3\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") "
Jul 13 07:14:10.525670 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525584    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-service-ca\") pod \"7d60e047-25fd-4573-9f08-311bf31494e3\" (UID: \"7d60e047-25fd-4573-9f08-311bf31494e3\") "
Jul 13 07:14:10.525973 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-console-config" (OuterVolumeSpecName: "console-config") pod "7d60e047-25fd-4573-9f08-311bf31494e3" (UID: "7d60e047-25fd-4573-9f08-311bf31494e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:14:10.525973 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525805    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d60e047-25fd-4573-9f08-311bf31494e3" (UID: "7d60e047-25fd-4573-9f08-311bf31494e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:14:10.525973 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.525947    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d60e047-25fd-4573-9f08-311bf31494e3" (UID: "7d60e047-25fd-4573-9f08-311bf31494e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:14:10.526186 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.526157    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d60e047-25fd-4573-9f08-311bf31494e3" (UID: "7d60e047-25fd-4573-9f08-311bf31494e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:14:10.527834 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.527809    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d60e047-25fd-4573-9f08-311bf31494e3" (UID: "7d60e047-25fd-4573-9f08-311bf31494e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:14:10.527973 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.527951    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d60e047-25fd-4573-9f08-311bf31494e3" (UID: "7d60e047-25fd-4573-9f08-311bf31494e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:14:10.528016 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.527981    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d60e047-25fd-4573-9f08-311bf31494e3-kube-api-access-phhz4" (OuterVolumeSpecName: "kube-api-access-phhz4") pod "7d60e047-25fd-4573-9f08-311bf31494e3" (UID: "7d60e047-25fd-4573-9f08-311bf31494e3"). InnerVolumeSpecName "kube-api-access-phhz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:14:10.626678 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.626627    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-oauth-config\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:14:10.626678 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.626671    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phhz4\" (UniqueName: \"kubernetes.io/projected/7d60e047-25fd-4573-9f08-311bf31494e3-kube-api-access-phhz4\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:14:10.626678 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.626681    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-oauth-serving-cert\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:14:10.626678 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.626689    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d60e047-25fd-4573-9f08-311bf31494e3-console-serving-cert\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:14:10.626952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.626699    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:14:10.626952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.626707    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-console-config\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:14:10.626952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.626715    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d60e047-25fd-4573-9f08-311bf31494e3-trusted-ca-bundle\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:14:10.693697 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.693656    2565 generic.go:356] "Generic (PLEG): container finished" podID="7d60e047-25fd-4573-9f08-311bf31494e3" containerID="1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5" exitCode=0
Jul 13 07:14:10.693892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.693704    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b457674f5-kj4jk"
Jul 13 07:14:10.693892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.693741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b457674f5-kj4jk" event={"ID":"7d60e047-25fd-4573-9f08-311bf31494e3","Type":"ContainerDied","Data":"1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5"}
Jul 13 07:14:10.693892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.693791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b457674f5-kj4jk" event={"ID":"7d60e047-25fd-4573-9f08-311bf31494e3","Type":"ContainerDied","Data":"9fee2dc450a0cabad341719560a794ac43c3e50e5b1fece9e71443a9295f31e1"}
Jul 13 07:14:10.693892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.693812    2565 scope.go:117] "RemoveContainer" containerID="1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5"
Jul 13 07:14:10.703589 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.703565    2565 scope.go:117] "RemoveContainer" containerID="1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5"
Jul 13 07:14:10.703948 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:14:10.703927    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5\": container with ID starting with 1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5 not found: ID does not exist" containerID="1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5"
Jul 13 07:14:10.703996 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.703961    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5"} err="failed to get container status \"1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5\": rpc error: code = NotFound desc = could not find container \"1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5\": container with ID starting with 1ab6b785384ab50a1927b375e762134e9be9c750fb536847075af6e134b8e2b5 not found: ID does not exist"
Jul 13 07:14:10.715274 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.715234    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b457674f5-kj4jk"]
Jul 13 07:14:10.719459 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.719409    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b457674f5-kj4jk"]
Jul 13 07:14:10.920348 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:10.920316    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d60e047-25fd-4573-9f08-311bf31494e3" path="/var/lib/kubelet/pods/7d60e047-25fd-4573-9f08-311bf31494e3/volumes"
Jul 13 07:14:28.945936 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:28.945897    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:14:28.965699 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:28.965670    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:14:29.783876 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:14:29.783846    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 07:16:32.897454 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.897401    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cdn8q"]
Jul 13 07:16:32.897935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.897752    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d60e047-25fd-4573-9f08-311bf31494e3" containerName="console"
Jul 13 07:16:32.897935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.897764    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d60e047-25fd-4573-9f08-311bf31494e3" containerName="console"
Jul 13 07:16:32.897935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.897825    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d60e047-25fd-4573-9f08-311bf31494e3" containerName="console"
Jul 13 07:16:32.900939 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.900911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:32.904588 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.904566    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 13 07:16:32.904732 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.904603    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lt8s6\""
Jul 13 07:16:32.905942 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.905918    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 13 07:16:32.911920 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:32.911898    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cdn8q"]
Jul 13 07:16:33.037937 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:33.037896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcd3a667-07ac-4963-b10e-67e3ef7f0684-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cdn8q\" (UID: \"bcd3a667-07ac-4963-b10e-67e3ef7f0684\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:33.037937 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:33.037942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5ccj\" (UniqueName: \"kubernetes.io/projected/bcd3a667-07ac-4963-b10e-67e3ef7f0684-kube-api-access-m5ccj\") pod \"cert-manager-webhook-6486ffd997-cdn8q\" (UID: \"bcd3a667-07ac-4963-b10e-67e3ef7f0684\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:33.139054 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:33.139015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5ccj\" (UniqueName: \"kubernetes.io/projected/bcd3a667-07ac-4963-b10e-67e3ef7f0684-kube-api-access-m5ccj\") pod \"cert-manager-webhook-6486ffd997-cdn8q\" (UID: \"bcd3a667-07ac-4963-b10e-67e3ef7f0684\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:33.139224 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:33.139113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcd3a667-07ac-4963-b10e-67e3ef7f0684-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cdn8q\" (UID: \"bcd3a667-07ac-4963-b10e-67e3ef7f0684\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:33.165484 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:33.165387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcd3a667-07ac-4963-b10e-67e3ef7f0684-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cdn8q\" (UID: \"bcd3a667-07ac-4963-b10e-67e3ef7f0684\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:33.170824 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:33.170795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5ccj\" (UniqueName: \"kubernetes.io/projected/bcd3a667-07ac-4963-b10e-67e3ef7f0684-kube-api-access-m5ccj\") pod \"cert-manager-webhook-6486ffd997-cdn8q\" (UID: \"bcd3a667-07ac-4963-b10e-67e3ef7f0684\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:33.225534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:33.225500    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:33.369220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:33.369196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cdn8q"]
Jul 13 07:16:33.371662 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:16:33.371634    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcd3a667_07ac_4963_b10e_67e3ef7f0684.slice/crio-f09c24b4f4553eaf24819cffdd36f3b1db7ec7cbb3cc5dbc1144880922788da4 WatchSource:0}: Error finding container f09c24b4f4553eaf24819cffdd36f3b1db7ec7cbb3cc5dbc1144880922788da4: Status 404 returned error can't find the container with id f09c24b4f4553eaf24819cffdd36f3b1db7ec7cbb3cc5dbc1144880922788da4
Jul 13 07:16:34.259945 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:34.259878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q" event={"ID":"bcd3a667-07ac-4963-b10e-67e3ef7f0684","Type":"ContainerStarted","Data":"f09c24b4f4553eaf24819cffdd36f3b1db7ec7cbb3cc5dbc1144880922788da4"}
Jul 13 07:16:37.273915 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:37.273878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q" event={"ID":"bcd3a667-07ac-4963-b10e-67e3ef7f0684","Type":"ContainerStarted","Data":"5f3538a8b736232be622638c17d24909b6b78bfe1ade360a189b5a4cbfc9580f"}
Jul 13 07:16:37.274380 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:37.273931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:37.290353 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:37.290296    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q" podStartSLOduration=2.225359164 podStartE2EDuration="5.290276039s" totalImagesPullingTime="3.064916875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:16:37.289681218 +0000 UTC m=+262.996558521" watchObservedRunningTime="2026-07-13 07:16:37.290276039 +0000 UTC m=+262.997153342"
Jul 13 07:16:43.280380 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:43.280344    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cdn8q"
Jul 13 07:16:44.092787 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.092759    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"]
Jul 13 07:16:44.095279 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.095262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"
Jul 13 07:16:44.097913 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.097885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 07:16:44.098033 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.097920    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-j42j8\""
Jul 13 07:16:44.098838 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.098820    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 07:16:44.104460 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.104423    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"]
Jul 13 07:16:44.239812 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.239781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8mbq\" (UniqueName: \"kubernetes.io/projected/c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb-kube-api-access-z8mbq\") pod \"openshift-lws-operator-fd8ccff4c-hkltz\" (UID: \"c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"
Jul 13 07:16:44.239950 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.239818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hkltz\" (UID: \"c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"
Jul 13 07:16:44.340210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.340178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hkltz\" (UID: \"c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"
Jul 13 07:16:44.340624 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.340265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8mbq\" (UniqueName: \"kubernetes.io/projected/c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb-kube-api-access-z8mbq\") pod \"openshift-lws-operator-fd8ccff4c-hkltz\" (UID: \"c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"
Jul 13 07:16:44.340624 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.340576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hkltz\" (UID: \"c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"
Jul 13 07:16:44.351193 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.351126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8mbq\" (UniqueName: \"kubernetes.io/projected/c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb-kube-api-access-z8mbq\") pod \"openshift-lws-operator-fd8ccff4c-hkltz\" (UID: \"c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"
Jul 13 07:16:44.404973 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.404943    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"
Jul 13 07:16:44.529713 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:44.529685    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz"]
Jul 13 07:16:45.306717 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:45.306682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz" event={"ID":"c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb","Type":"ContainerStarted","Data":"8fafcc23372799e6831064688bb35a6b13b1139766569318b1f47057f37eb990"}
Jul 13 07:16:47.317320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:47.317281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz" event={"ID":"c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb","Type":"ContainerStarted","Data":"ec1445af7dabc6729285c55f4c4cbcf7aceaf7073c67b09b17a4981d4f3e3487"}
Jul 13 07:16:47.338618 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:16:47.338568    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hkltz" podStartSLOduration=0.731565045 podStartE2EDuration="3.338550503s" totalImagesPullingTime="2.606985458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:16:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:16:47.336333722 +0000 UTC m=+273.043211050" watchObservedRunningTime="2026-07-13 07:16:47.338550503 +0000 UTC m=+273.045427805"
Jul 13 07:17:02.836709 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.836674    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"]
Jul 13 07:17:02.841495 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.841473    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:02.848739 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.848713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 07:17:02.848860 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.848748    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 07:17:02.848860 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.848768    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bfvgg\""
Jul 13 07:17:02.848860 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.848775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 07:17:02.849785 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.849764    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 07:17:02.862323 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.862300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"]
Jul 13 07:17:02.907757 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.907728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:02.907946 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.907762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:02.907946 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.907785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:02.907946 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.907873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwtrt\" (UniqueName: \"kubernetes.io/projected/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-kube-api-access-cwtrt\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:02.907946 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:02.907917    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.009169 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.009128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.009169 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.009175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.009428 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.009234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwtrt\" (UniqueName: \"kubernetes.io/projected/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-kube-api-access-cwtrt\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.009428 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.009275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.009428 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.009315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.009710 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.009685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.011673 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.011652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.011767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.011730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.011825 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.011779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.018924 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.018897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwtrt\" (UniqueName: \"kubernetes.io/projected/c38903d9-ee12-4f3c-bbf9-4b58febef4a2-kube-api-access-cwtrt\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-g74mr\" (UID: \"c38903d9-ee12-4f3c-bbf9-4b58febef4a2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.151362 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.151274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:03.287919 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.287887    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"]
Jul 13 07:17:03.291042 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:17:03.291007    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38903d9_ee12_4f3c_bbf9_4b58febef4a2.slice/crio-68587e6137c3269b436c0dca9d53633bcc3fd477e32b88183de9055c30cb1e11 WatchSource:0}: Error finding container 68587e6137c3269b436c0dca9d53633bcc3fd477e32b88183de9055c30cb1e11: Status 404 returned error can't find the container with id 68587e6137c3269b436c0dca9d53633bcc3fd477e32b88183de9055c30cb1e11
Jul 13 07:17:03.387051 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:03.387016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr" event={"ID":"c38903d9-ee12-4f3c-bbf9-4b58febef4a2","Type":"ContainerStarted","Data":"68587e6137c3269b436c0dca9d53633bcc3fd477e32b88183de9055c30cb1e11"}
Jul 13 07:17:07.408395 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:07.408357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr" event={"ID":"c38903d9-ee12-4f3c-bbf9-4b58febef4a2","Type":"ContainerStarted","Data":"b3fa3c87a507953490c30611ae1320f332676d733cc08a74f95c25ff069931c0"}
Jul 13 07:17:08.414409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:08.414327    2565 generic.go:356] "Generic (PLEG): container finished" podID="c38903d9-ee12-4f3c-bbf9-4b58febef4a2" containerID="b3fa3c87a507953490c30611ae1320f332676d733cc08a74f95c25ff069931c0" exitCode=0
Jul 13 07:17:08.414767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:08.414414    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr" event={"ID":"c38903d9-ee12-4f3c-bbf9-4b58febef4a2","Type":"ContainerDied","Data":"b3fa3c87a507953490c30611ae1320f332676d733cc08a74f95c25ff069931c0"}
Jul 13 07:17:09.420554 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:09.420523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr" event={"ID":"c38903d9-ee12-4f3c-bbf9-4b58febef4a2","Type":"ContainerStarted","Data":"03339a1572624b0b2e432df84c05a55583e0c1fbe1cf3d2ccfebf179f59c1127"}
Jul 13 07:17:09.420924 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:09.420661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:09.446467 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:09.444816    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr" podStartSLOduration=2.164639669 podStartE2EDuration="7.44479102s" totalImagesPullingTime="4.209189657s" totalInitContainerRuntime="1.070961694s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:09.441759212 +0000 UTC m=+295.148636515" watchObservedRunningTime="2026-07-13 07:17:09.44479102 +0000 UTC m=+295.151668325"
Jul 13 07:17:14.732866 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:14.732840    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 07:17:20.427376 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:20.427344    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-g74mr"
Jul 13 07:17:21.501301 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.501264    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"]
Jul 13 07:17:21.503792 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.503773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.506649 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.506622    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 07:17:21.507865 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.507845    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 07:17:21.507968 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.507876    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 07:17:21.507968 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.507849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4gjfc\""
Jul 13 07:17:21.514614 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.514592    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"]
Jul 13 07:17:21.577280 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.577250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/756c2732-84df-4f56-a0ac-e5ed20151036-cert\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.577467 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.577289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zsd\" (UniqueName: \"kubernetes.io/projected/756c2732-84df-4f56-a0ac-e5ed20151036-kube-api-access-49zsd\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.577467 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.577321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/756c2732-84df-4f56-a0ac-e5ed20151036-manager-config\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.577467 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.577371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/756c2732-84df-4f56-a0ac-e5ed20151036-metrics-cert\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.678797 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.678760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/756c2732-84df-4f56-a0ac-e5ed20151036-cert\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.678980 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.678807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49zsd\" (UniqueName: \"kubernetes.io/projected/756c2732-84df-4f56-a0ac-e5ed20151036-kube-api-access-49zsd\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.678980 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.678847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/756c2732-84df-4f56-a0ac-e5ed20151036-manager-config\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.678980 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.678879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/756c2732-84df-4f56-a0ac-e5ed20151036-metrics-cert\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.679594 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.679566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/756c2732-84df-4f56-a0ac-e5ed20151036-manager-config\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.681299 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.681271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/756c2732-84df-4f56-a0ac-e5ed20151036-cert\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.681500 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.681482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/756c2732-84df-4f56-a0ac-e5ed20151036-metrics-cert\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.694083 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.694054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zsd\" (UniqueName: \"kubernetes.io/projected/756c2732-84df-4f56-a0ac-e5ed20151036-kube-api-access-49zsd\") pod \"lws-controller-manager-67b5465ff8-rhcf6\" (UID: \"756c2732-84df-4f56-a0ac-e5ed20151036\") " pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.813829 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.813796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:21.950259 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.950236    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"]
Jul 13 07:17:21.951758 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:17:21.951726    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756c2732_84df_4f56_a0ac_e5ed20151036.slice/crio-8f8f2538a759f4afaa89e2a3aadb05306d879a2f14df463353234f7e971f0559 WatchSource:0}: Error finding container 8f8f2538a759f4afaa89e2a3aadb05306d879a2f14df463353234f7e971f0559: Status 404 returned error can't find the container with id 8f8f2538a759f4afaa89e2a3aadb05306d879a2f14df463353234f7e971f0559
Jul 13 07:17:21.953794 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:21.953780    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 07:17:22.480885 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:22.480849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6" event={"ID":"756c2732-84df-4f56-a0ac-e5ed20151036","Type":"ContainerStarted","Data":"8f8f2538a759f4afaa89e2a3aadb05306d879a2f14df463353234f7e971f0559"}
Jul 13 07:17:23.487950 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:23.487920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6" event={"ID":"756c2732-84df-4f56-a0ac-e5ed20151036","Type":"ContainerStarted","Data":"2cb17ee8791835a94d855b7e101c2f21753e132d0493ed6f096d2811cdd81365"}
Jul 13 07:17:23.488343 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:23.488036    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:17:23.511108 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:23.511058    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6" podStartSLOduration=1.151183741 podStartE2EDuration="2.511042136s" totalImagesPullingTime="1.359858395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:23.508630562 +0000 UTC m=+309.215507865" watchObservedRunningTime="2026-07-13 07:17:23.511042136 +0000 UTC m=+309.217919438"
Jul 13 07:17:28.591940 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.591899    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"]
Jul 13 07:17:28.594807 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.594783    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.597728 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.597708    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 07:17:28.598810 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.598789    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 07:17:28.598924 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.598788    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 07:17:28.598924 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.598797    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vwll2\""
Jul 13 07:17:28.599051 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.598797    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 07:17:28.605637 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.605616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"]
Jul 13 07:17:28.740029 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.739987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fba178f3-1b44-4985-b1ca-9d58f363e6bb-tmp\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.740029 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.740045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzdfr\" (UniqueName: \"kubernetes.io/projected/fba178f3-1b44-4985-b1ca-9d58f363e6bb-kube-api-access-gzdfr\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.740250 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.740109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba178f3-1b44-4985-b1ca-9d58f363e6bb-tls-certs\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.841417 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.841373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fba178f3-1b44-4985-b1ca-9d58f363e6bb-tmp\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.841622 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.841430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzdfr\" (UniqueName: \"kubernetes.io/projected/fba178f3-1b44-4985-b1ca-9d58f363e6bb-kube-api-access-gzdfr\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.841622 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.841478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba178f3-1b44-4985-b1ca-9d58f363e6bb-tls-certs\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.843789 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.843718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fba178f3-1b44-4985-b1ca-9d58f363e6bb-tmp\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.844015 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.843993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba178f3-1b44-4985-b1ca-9d58f363e6bb-tls-certs\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.853759 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.853736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzdfr\" (UniqueName: \"kubernetes.io/projected/fba178f3-1b44-4985-b1ca-9d58f363e6bb-kube-api-access-gzdfr\") pod \"kube-auth-proxy-55f9f4ffd9-pf6nt\" (UID: \"fba178f3-1b44-4985-b1ca-9d58f363e6bb\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:28.904537 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:28.904510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"
Jul 13 07:17:29.065069 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:29.065037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt"]
Jul 13 07:17:29.068971 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:17:29.068947    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba178f3_1b44_4985_b1ca_9d58f363e6bb.slice/crio-e1744776656518ecbae9f2075677861a739795d4aa177fa34b898bc4df0d1c71 WatchSource:0}: Error finding container e1744776656518ecbae9f2075677861a739795d4aa177fa34b898bc4df0d1c71: Status 404 returned error can't find the container with id e1744776656518ecbae9f2075677861a739795d4aa177fa34b898bc4df0d1c71
Jul 13 07:17:29.516677 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:29.516630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt" event={"ID":"fba178f3-1b44-4985-b1ca-9d58f363e6bb","Type":"ContainerStarted","Data":"e1744776656518ecbae9f2075677861a739795d4aa177fa34b898bc4df0d1c71"}
Jul 13 07:17:32.538812 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:32.538769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt" event={"ID":"fba178f3-1b44-4985-b1ca-9d58f363e6bb","Type":"ContainerStarted","Data":"dbf70d4990fcd0d1cfdfc8ccb9619724aff18c9d997e6b512e85dbe1cf161933"}
Jul 13 07:17:32.556379 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:32.556316    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-pf6nt" podStartSLOduration=1.881173992 podStartE2EDuration="4.556295475s" totalImagesPullingTime="2.675121483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:32.555952921 +0000 UTC m=+318.262830261" watchObservedRunningTime="2026-07-13 07:17:32.556295475 +0000 UTC m=+318.263172779"
Jul 13 07:17:34.494533 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:17:34.494504    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67b5465ff8-rhcf6"
Jul 13 07:18:41.678055 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.678017    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55c7957b67-gnjgj"]
Jul 13 07:18:41.680286 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.680265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.682942 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.682920    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 07:18:41.683050 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.683001    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 07:18:41.683106 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.683006    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 07:18:41.684216 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.684198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 07:18:41.684362 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.684338    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 07:18:41.684473 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.684377    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 07:18:41.684473 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.684463    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 07:18:41.684635 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.684619    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gb2r6\""
Jul 13 07:18:41.688960 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.688938    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 07:18:41.694895 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.694875    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55c7957b67-gnjgj"]
Jul 13 07:18:41.783580 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.783546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-service-ca\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.783580 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.783584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-oauth-serving-cert\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.783795 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.783606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-console-config\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.783795 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.783686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t97bk\" (UniqueName: \"kubernetes.io/projected/a516935c-6cb8-491f-9e42-07a4858872ef-kube-api-access-t97bk\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.783795 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.783709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a516935c-6cb8-491f-9e42-07a4858872ef-console-serving-cert\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.783795 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.783770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a516935c-6cb8-491f-9e42-07a4858872ef-console-oauth-config\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.783919 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.783797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-trusted-ca-bundle\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.884247 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.884206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a516935c-6cb8-491f-9e42-07a4858872ef-console-oauth-config\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.884247 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.884246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-trusted-ca-bundle\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.884534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.884299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-service-ca\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.884534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.884319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-oauth-serving-cert\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.884534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.884336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-console-config\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.884534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.884373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t97bk\" (UniqueName: \"kubernetes.io/projected/a516935c-6cb8-491f-9e42-07a4858872ef-kube-api-access-t97bk\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.884534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.884412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a516935c-6cb8-491f-9e42-07a4858872ef-console-serving-cert\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.885168 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.885144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-console-config\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.885270 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.885167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-service-ca\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.885312 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.885267    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-oauth-serving-cert\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.885639 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.885622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a516935c-6cb8-491f-9e42-07a4858872ef-trusted-ca-bundle\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.886838 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.886815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a516935c-6cb8-491f-9e42-07a4858872ef-console-oauth-config\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.886923 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.886871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a516935c-6cb8-491f-9e42-07a4858872ef-console-serving-cert\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.892891 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.892861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t97bk\" (UniqueName: \"kubernetes.io/projected/a516935c-6cb8-491f-9e42-07a4858872ef-kube-api-access-t97bk\") pod \"console-55c7957b67-gnjgj\" (UID: \"a516935c-6cb8-491f-9e42-07a4858872ef\") " pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:41.990264 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:41.990176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:42.120737 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:42.120713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55c7957b67-gnjgj"]
Jul 13 07:18:42.123298 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:18:42.123264    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda516935c_6cb8_491f_9e42_07a4858872ef.slice/crio-6c34931d3e70d1e1cd5c848f76607e36edcd1a1e09d828aab9ddbdb85e5f754f WatchSource:0}: Error finding container 6c34931d3e70d1e1cd5c848f76607e36edcd1a1e09d828aab9ddbdb85e5f754f: Status 404 returned error can't find the container with id 6c34931d3e70d1e1cd5c848f76607e36edcd1a1e09d828aab9ddbdb85e5f754f
Jul 13 07:18:42.860276 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:42.860240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c7957b67-gnjgj" event={"ID":"a516935c-6cb8-491f-9e42-07a4858872ef","Type":"ContainerStarted","Data":"7699b3eec8e01db41ed0230368d1fdf5795d498e2d3889998b03aea2c63e7f57"}
Jul 13 07:18:42.860691 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:42.860293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55c7957b67-gnjgj" event={"ID":"a516935c-6cb8-491f-9e42-07a4858872ef","Type":"ContainerStarted","Data":"6c34931d3e70d1e1cd5c848f76607e36edcd1a1e09d828aab9ddbdb85e5f754f"}
Jul 13 07:18:42.882669 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:42.882621    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55c7957b67-gnjgj" podStartSLOduration=1.882602652 podStartE2EDuration="1.882602652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:18:42.881001355 +0000 UTC m=+388.587878674" watchObservedRunningTime="2026-07-13 07:18:42.882602652 +0000 UTC m=+388.589479954"
Jul 13 07:18:51.990592 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:51.990549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:51.990592 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:51.990606    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:51.995372 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:51.995347    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:18:52.910423 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:18:52.910397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55c7957b67-gnjgj"
Jul 13 07:19:02.340931 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.340892    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"]
Jul 13 07:19:02.343625 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.343607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.345826 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.345803    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 13 07:19:02.346955 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.346933    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 07:19:02.347095 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.346933    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 13 07:19:02.347095 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.346933    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6n99k\""
Jul 13 07:19:02.347095 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.346942    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 07:19:02.353298 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.353277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"]
Jul 13 07:19:02.472805 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.472772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dlvg\" (UniqueName: \"kubernetes.io/projected/76224c45-8dfd-4590-a3fe-dd54acb097f1-kube-api-access-9dlvg\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.472805 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.472812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/76224c45-8dfd-4590-a3fe-dd54acb097f1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.473012 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.472890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/76224c45-8dfd-4590-a3fe-dd54acb097f1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.574067 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.574032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/76224c45-8dfd-4590-a3fe-dd54acb097f1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.574256 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.574095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dlvg\" (UniqueName: \"kubernetes.io/projected/76224c45-8dfd-4590-a3fe-dd54acb097f1-kube-api-access-9dlvg\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.574256 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.574119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/76224c45-8dfd-4590-a3fe-dd54acb097f1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.574739 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.574714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/76224c45-8dfd-4590-a3fe-dd54acb097f1-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.576579 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.576556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/76224c45-8dfd-4590-a3fe-dd54acb097f1-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.582479 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.582422    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dlvg\" (UniqueName: \"kubernetes.io/projected/76224c45-8dfd-4590-a3fe-dd54acb097f1-kube-api-access-9dlvg\") pod \"kuadrant-console-plugin-66b5774985-bc5gj\" (UID: \"76224c45-8dfd-4590-a3fe-dd54acb097f1\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.653804 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.653707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"
Jul 13 07:19:02.784340 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.784317    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj"]
Jul 13 07:19:02.786420 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:19:02.786399    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76224c45_8dfd_4590_a3fe_dd54acb097f1.slice/crio-7e15efbf7bc2c1d7087e73fc24574290096bf2ca0bc572e2b682491e931ebfe8 WatchSource:0}: Error finding container 7e15efbf7bc2c1d7087e73fc24574290096bf2ca0bc572e2b682491e931ebfe8: Status 404 returned error can't find the container with id 7e15efbf7bc2c1d7087e73fc24574290096bf2ca0bc572e2b682491e931ebfe8
Jul 13 07:19:02.950398 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:02.950311    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj" event={"ID":"76224c45-8dfd-4590-a3fe-dd54acb097f1","Type":"ContainerStarted","Data":"7e15efbf7bc2c1d7087e73fc24574290096bf2ca0bc572e2b682491e931ebfe8"}
Jul 13 07:19:12.212148 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:12.212119    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"]
Jul 13 07:19:12.225302 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:12.225265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"
Jul 13 07:19:12.227484 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:12.227400    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"]
Jul 13 07:19:12.228825 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:12.228805    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9j74r\""
Jul 13 07:19:12.373008 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:12.372973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vhbk\" (UniqueName: \"kubernetes.io/projected/4abc9152-5adf-4b49-b573-55f219b811b1-kube-api-access-6vhbk\") pod \"limitador-operator-controller-manager-859d7b78bd-jc4wj\" (UID: \"4abc9152-5adf-4b49-b573-55f219b811b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"
Jul 13 07:19:12.474705 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:12.474429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vhbk\" (UniqueName: \"kubernetes.io/projected/4abc9152-5adf-4b49-b573-55f219b811b1-kube-api-access-6vhbk\") pod \"limitador-operator-controller-manager-859d7b78bd-jc4wj\" (UID: \"4abc9152-5adf-4b49-b573-55f219b811b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"
Jul 13 07:19:12.492981 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:12.492952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vhbk\" (UniqueName: \"kubernetes.io/projected/4abc9152-5adf-4b49-b573-55f219b811b1-kube-api-access-6vhbk\") pod \"limitador-operator-controller-manager-859d7b78bd-jc4wj\" (UID: \"4abc9152-5adf-4b49-b573-55f219b811b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"
Jul 13 07:19:12.539966 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:12.539930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"
Jul 13 07:19:25.450406 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:25.450374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"]
Jul 13 07:19:25.454276 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:19:25.454245    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4abc9152_5adf_4b49_b573_55f219b811b1.slice/crio-3647862e88f98d54607764e666f2f1bc3fa55c48da7a7c518be786997808daa7 WatchSource:0}: Error finding container 3647862e88f98d54607764e666f2f1bc3fa55c48da7a7c518be786997808daa7: Status 404 returned error can't find the container with id 3647862e88f98d54607764e666f2f1bc3fa55c48da7a7c518be786997808daa7
Jul 13 07:19:26.085379 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:26.085342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj" event={"ID":"4abc9152-5adf-4b49-b573-55f219b811b1","Type":"ContainerStarted","Data":"3647862e88f98d54607764e666f2f1bc3fa55c48da7a7c518be786997808daa7"}
Jul 13 07:19:26.086881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:26.086853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj" event={"ID":"76224c45-8dfd-4590-a3fe-dd54acb097f1","Type":"ContainerStarted","Data":"82a047ccbce3feb702d2ee15035b78c2da32f2a42d520c2f8e880b4040ca9c4d"}
Jul 13 07:19:26.106905 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:26.106857    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bc5gj" podStartSLOduration=1.146312594 podStartE2EDuration="24.106841684s" totalImagesPullingTime="22.96052909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:26.104625713 +0000 UTC m=+431.811503009" watchObservedRunningTime="2026-07-13 07:19:26.106841684 +0000 UTC m=+431.813718987"
Jul 13 07:19:30.110636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:30.110597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj" event={"ID":"4abc9152-5adf-4b49-b573-55f219b811b1","Type":"ContainerStarted","Data":"33e408c43c3b2e230859b501046105ee24d3361b62e0f26ce4bdd00909560bfc"}
Jul 13 07:19:30.111020 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:30.110697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"
Jul 13 07:19:30.129907 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:30.129856    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj" podStartSLOduration=14.157848121 podStartE2EDuration="18.129839287s" totalImagesPullingTime="3.971991166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:30.128695005 +0000 UTC m=+435.835572330" watchObservedRunningTime="2026-07-13 07:19:30.129839287 +0000 UTC m=+435.836716589"
Jul 13 07:19:41.117923 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:19:41.117841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jc4wj"
Jul 13 07:20:23.305663 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.305629    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-z4ppx"]
Jul 13 07:20:23.308307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.308287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:23.311012 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.310987    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 07:20:23.311235 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.311220    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 07:20:23.312129 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.312111    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hvhts\""
Jul 13 07:20:23.319667 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.319644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-z4ppx"]
Jul 13 07:20:23.428912 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.428876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjcxd\" (UniqueName: \"kubernetes.io/projected/70b74253-b826-4379-9db9-d9b5f84ddf12-kube-api-access-cjcxd\") pod \"maas-controller-ddc5ffd7c-z4ppx\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") " pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:23.429100 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.429023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert\") pod \"maas-controller-ddc5ffd7c-z4ppx\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") " pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:23.530120 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.530076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert\") pod \"maas-controller-ddc5ffd7c-z4ppx\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") " pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:23.530319 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.530146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcxd\" (UniqueName: \"kubernetes.io/projected/70b74253-b826-4379-9db9-d9b5f84ddf12-kube-api-access-cjcxd\") pod \"maas-controller-ddc5ffd7c-z4ppx\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") " pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:23.530319 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:20:23.530281    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 13 07:20:23.530474 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:20:23.530352    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert podName:70b74253-b826-4379-9db9-d9b5f84ddf12 nodeName:}" failed. No retries permitted until 2026-07-13 07:20:24.030334779 +0000 UTC m=+489.737212059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert") pod "maas-controller-ddc5ffd7c-z4ppx" (UID: "70b74253-b826-4379-9db9-d9b5f84ddf12") : secret "maas-controller-webhook-cert" not found
Jul 13 07:20:23.540855 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:23.540831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjcxd\" (UniqueName: \"kubernetes.io/projected/70b74253-b826-4379-9db9-d9b5f84ddf12-kube-api-access-cjcxd\") pod \"maas-controller-ddc5ffd7c-z4ppx\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") " pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:24.034947 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:24.034908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert\") pod \"maas-controller-ddc5ffd7c-z4ppx\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") " pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:24.037300 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:24.037280    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert\") pod \"maas-controller-ddc5ffd7c-z4ppx\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") " pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:24.219138 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:24.219098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:24.346967 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:24.346943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-z4ppx"]
Jul 13 07:20:24.349169 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:20:24.349133    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70b74253_b826_4379_9db9_d9b5f84ddf12.slice/crio-abea98a02c5a6b41f03993d195979eae764289ad0036c86d3cc58105f361f662 WatchSource:0}: Error finding container abea98a02c5a6b41f03993d195979eae764289ad0036c86d3cc58105f361f662: Status 404 returned error can't find the container with id abea98a02c5a6b41f03993d195979eae764289ad0036c86d3cc58105f361f662
Jul 13 07:20:24.367724 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:24.367692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx" event={"ID":"70b74253-b826-4379-9db9-d9b5f84ddf12","Type":"ContainerStarted","Data":"abea98a02c5a6b41f03993d195979eae764289ad0036c86d3cc58105f361f662"}
Jul 13 07:20:27.383679 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:27.383642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx" event={"ID":"70b74253-b826-4379-9db9-d9b5f84ddf12","Type":"ContainerStarted","Data":"aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85"}
Jul 13 07:20:27.384059 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:27.383790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:27.400878 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:27.400830    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx" podStartSLOduration=2.434665543 podStartE2EDuration="4.400811855s" totalImagesPullingTime="1.966146312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:20:27.400662504 +0000 UTC m=+493.107539807" watchObservedRunningTime="2026-07-13 07:20:27.400811855 +0000 UTC m=+493.107689157"
Jul 13 07:20:38.394654 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:38.394625    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:20:59.409331 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.409301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-f59f4fdbd-cgxcv"]
Jul 13 07:20:59.412604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.412586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.415017 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.414992    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 13 07:20:59.415140 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.415058    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-svhmf\""
Jul 13 07:20:59.424719 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.424608    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-f59f4fdbd-cgxcv"]
Jul 13 07:20:59.466954 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.466924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-openshift-service-ca\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.467118 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.466965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdlzr\" (UniqueName: \"kubernetes.io/projected/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-kube-api-access-qdlzr\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.467118 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.467084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-maas-api-tls\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.567966 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.567933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-openshift-service-ca\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.568151 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.567981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdlzr\" (UniqueName: \"kubernetes.io/projected/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-kube-api-access-qdlzr\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.568151 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.568063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-maas-api-tls\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.568580 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.568550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-openshift-service-ca\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.570312 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.570290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-maas-api-tls\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.576656 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.576627    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdlzr\" (UniqueName: \"kubernetes.io/projected/d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc-kube-api-access-qdlzr\") pod \"maas-api-f59f4fdbd-cgxcv\" (UID: \"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc\") " pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.724850 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.724750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:20:59.868329 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:20:59.868298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-f59f4fdbd-cgxcv"]
Jul 13 07:20:59.871710 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:20:59.871675    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cd1a4e_298d_4c6d_b6a7_e0a2df1f72cc.slice/crio-44091f20cc75b067591d558a5bf4c9c323628256b6f8654676656f510ab30478 WatchSource:0}: Error finding container 44091f20cc75b067591d558a5bf4c9c323628256b6f8654676656f510ab30478: Status 404 returned error can't find the container with id 44091f20cc75b067591d558a5bf4c9c323628256b6f8654676656f510ab30478
Jul 13 07:21:00.537274 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:00.537234    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-f59f4fdbd-cgxcv" event={"ID":"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc","Type":"ContainerStarted","Data":"44091f20cc75b067591d558a5bf4c9c323628256b6f8654676656f510ab30478"}
Jul 13 07:21:01.543733 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:01.543694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-f59f4fdbd-cgxcv" event={"ID":"d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc","Type":"ContainerStarted","Data":"5c76abeb7f6b5fcdc2b76eda4d392a6b9b706866f2ef446dc23149cfde0ab1b5"}
Jul 13 07:21:01.544160 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:01.543829    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:21:01.559581 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:01.559524    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-f59f4fdbd-cgxcv" podStartSLOduration=1.068464378 podStartE2EDuration="2.55950431s" totalImagesPullingTime="1.491039932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:21:01.559039159 +0000 UTC m=+527.265916474" watchObservedRunningTime="2026-07-13 07:21:01.55950431 +0000 UTC m=+527.266381612"
Jul 13 07:21:07.553942 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:07.553865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-f59f4fdbd-cgxcv"
Jul 13 07:21:50.720721 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.720688    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"]
Jul 13 07:21:50.724262 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.724243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.726832 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.726812    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 07:21:50.727914 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.727895    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 07:21:50.728031 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.727919    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 13 07:21:50.728031 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.727969    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kvj25\""
Jul 13 07:21:50.733601 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.733567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"]
Jul 13 07:21:50.827835 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.827792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.828018 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.827918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.828018 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.827942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0193cb39-35a6-430b-b578-e6d7ec4f53a2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.828018 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.827968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.828018 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.827983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcpmz\" (UniqueName: \"kubernetes.io/projected/0193cb39-35a6-430b-b578-e6d7ec4f53a2-kube-api-access-tcpmz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.828218 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.828037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929211 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929408 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929408 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929408 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0193cb39-35a6-430b-b578-e6d7ec4f53a2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929408 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929641 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcpmz\" (UniqueName: \"kubernetes.io/projected/0193cb39-35a6-430b-b578-e6d7ec4f53a2-kube-api-access-tcpmz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929779 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929918 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.929918 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.929825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.931859 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.931837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0193cb39-35a6-430b-b578-e6d7ec4f53a2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.931943 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.931866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0193cb39-35a6-430b-b578-e6d7ec4f53a2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:50.937641 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:50.937617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcpmz\" (UniqueName: \"kubernetes.io/projected/0193cb39-35a6-430b-b578-e6d7ec4f53a2-kube-api-access-tcpmz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh\" (UID: \"0193cb39-35a6-430b-b578-e6d7ec4f53a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:51.035913 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:51.035880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:21:51.173472 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:51.173300    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"]
Jul 13 07:21:51.176232 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:21:51.176202    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0193cb39_35a6_430b_b578_e6d7ec4f53a2.slice/crio-32e7329e766dcc534bb80c14f0805e1b8199ab06ed0910c415311a92afaa5d6a WatchSource:0}: Error finding container 32e7329e766dcc534bb80c14f0805e1b8199ab06ed0910c415311a92afaa5d6a: Status 404 returned error can't find the container with id 32e7329e766dcc534bb80c14f0805e1b8199ab06ed0910c415311a92afaa5d6a
Jul 13 07:21:51.792381 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:51.792335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh" event={"ID":"0193cb39-35a6-430b-b578-e6d7ec4f53a2","Type":"ContainerStarted","Data":"32e7329e766dcc534bb80c14f0805e1b8199ab06ed0910c415311a92afaa5d6a"}
Jul 13 07:21:52.799743 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:52.799707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh" event={"ID":"0193cb39-35a6-430b-b578-e6d7ec4f53a2","Type":"ContainerStarted","Data":"cd4b3d3ef44330549d3133ae8650ab901aaf16311c7fcb261af449e4504e8f5b"}
Jul 13 07:21:52.817364 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:21:52.817311    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh" podStartSLOduration=1.789258542 podStartE2EDuration="2.817288806s" totalImagesPullingTime="1.028030264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:21:52.81615837 +0000 UTC m=+578.523035695" watchObservedRunningTime="2026-07-13 07:21:52.817288806 +0000 UTC m=+578.524166108"
Jul 13 07:22:01.036630 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:01.036587    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:22:01.037123 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:01.036662    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:22:01.049038 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:01.049011    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:22:01.858516 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:01.858490    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh"
Jul 13 07:22:03.819598 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.819567    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"]
Jul 13 07:22:03.823456 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.823417    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:03.826330 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.826300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 13 07:22:03.833999 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.833973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"]
Jul 13 07:22:03.951175 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.951140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:03.951175 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.951180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf46d06f-3986-40e1-82c6-2764c56f9985-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:03.951380 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.951204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftmmg\" (UniqueName: \"kubernetes.io/projected/bf46d06f-3986-40e1-82c6-2764c56f9985-kube-api-access-ftmmg\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:03.951380 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.951331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:03.951491 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.951426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:03.951536 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:03.951489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.052303 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.052268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.052530 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.052496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.052605 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.052580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.052759 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.052738    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.053189 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.053165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.053353 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.053324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf46d06f-3986-40e1-82c6-2764c56f9985-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.053483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.053365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmmg\" (UniqueName: \"kubernetes.io/projected/bf46d06f-3986-40e1-82c6-2764c56f9985-kube-api-access-ftmmg\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.053557 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.053504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.053618 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.053175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.055100 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.055077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf46d06f-3986-40e1-82c6-2764c56f9985-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.055820 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.055801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf46d06f-3986-40e1-82c6-2764c56f9985-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.061855 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.061833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftmmg\" (UniqueName: \"kubernetes.io/projected/bf46d06f-3986-40e1-82c6-2764c56f9985-kube-api-access-ftmmg\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz\" (UID: \"bf46d06f-3986-40e1-82c6-2764c56f9985\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.134502 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.134397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:04.268541 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.268518    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"]
Jul 13 07:22:04.270986 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:22:04.270958    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf46d06f_3986_40e1_82c6_2764c56f9985.slice/crio-e0086dd8d9239ece22ba8c3ffb9587fa54a296c930abbbd1138ccc4c12963a1d WatchSource:0}: Error finding container e0086dd8d9239ece22ba8c3ffb9587fa54a296c930abbbd1138ccc4c12963a1d: Status 404 returned error can't find the container with id e0086dd8d9239ece22ba8c3ffb9587fa54a296c930abbbd1138ccc4c12963a1d
Jul 13 07:22:04.872732 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.872693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz" event={"ID":"bf46d06f-3986-40e1-82c6-2764c56f9985","Type":"ContainerStarted","Data":"641a4bd7617a368c15fdb3d9468bcd968f27f163b6d0202e9f8eaf64c33a81a4"}
Jul 13 07:22:04.872732 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.872731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz" event={"ID":"bf46d06f-3986-40e1-82c6-2764c56f9985","Type":"ContainerStarted","Data":"e0086dd8d9239ece22ba8c3ffb9587fa54a296c930abbbd1138ccc4c12963a1d"}
Jul 13 07:22:04.894514 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:04.894468    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz" podStartSLOduration=1.6722053940000001 podStartE2EDuration="1.89445024s" totalImagesPullingTime="222.244846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:22:04.892023353 +0000 UTC m=+590.598900656" watchObservedRunningTime="2026-07-13 07:22:04.89445024 +0000 UTC m=+590.601327542"
Jul 13 07:22:14.135499 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:14.135461    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:14.135881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:14.135526    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:14.147974 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:14.147946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:22:14.933509 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:22:14.933480    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz"
Jul 13 07:24:44.329931 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.329888    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-z4ppx"]
Jul 13 07:24:44.330545 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.330108    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx" podUID="70b74253-b826-4379-9db9-d9b5f84ddf12" containerName="manager" containerID="cri-o://aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85" gracePeriod=30
Jul 13 07:24:44.583713 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.583640    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:24:44.670464 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.670402    2565 generic.go:356] "Generic (PLEG): container finished" podID="70b74253-b826-4379-9db9-d9b5f84ddf12" containerID="aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85" exitCode=0
Jul 13 07:24:44.670464 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.670465    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx"
Jul 13 07:24:44.670721 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.670477    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx" event={"ID":"70b74253-b826-4379-9db9-d9b5f84ddf12","Type":"ContainerDied","Data":"aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85"}
Jul 13 07:24:44.670721 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.670537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddc5ffd7c-z4ppx" event={"ID":"70b74253-b826-4379-9db9-d9b5f84ddf12","Type":"ContainerDied","Data":"abea98a02c5a6b41f03993d195979eae764289ad0036c86d3cc58105f361f662"}
Jul 13 07:24:44.670721 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.670561    2565 scope.go:117] "RemoveContainer" containerID="aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85"
Jul 13 07:24:44.679206 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.679185    2565 scope.go:117] "RemoveContainer" containerID="aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85"
Jul 13 07:24:44.679517 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:24:44.679497    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85\": container with ID starting with aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85 not found: ID does not exist" containerID="aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85"
Jul 13 07:24:44.679575 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.679529    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85"} err="failed to get container status \"aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85\": rpc error: code = NotFound desc = could not find container \"aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85\": container with ID starting with aea1ff49f926446060357f025802bfa806e8b636bb2715deb1371372909f8a85 not found: ID does not exist"
Jul 13 07:24:44.766718 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.766683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjcxd\" (UniqueName: \"kubernetes.io/projected/70b74253-b826-4379-9db9-d9b5f84ddf12-kube-api-access-cjcxd\") pod \"70b74253-b826-4379-9db9-d9b5f84ddf12\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") "
Jul 13 07:24:44.766884 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.766729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert\") pod \"70b74253-b826-4379-9db9-d9b5f84ddf12\" (UID: \"70b74253-b826-4379-9db9-d9b5f84ddf12\") "
Jul 13 07:24:44.769029 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.768994    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70b74253-b826-4379-9db9-d9b5f84ddf12-kube-api-access-cjcxd" (OuterVolumeSpecName: "kube-api-access-cjcxd") pod "70b74253-b826-4379-9db9-d9b5f84ddf12" (UID: "70b74253-b826-4379-9db9-d9b5f84ddf12"). InnerVolumeSpecName "kube-api-access-cjcxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:24:44.769162 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.769076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "70b74253-b826-4379-9db9-d9b5f84ddf12" (UID: "70b74253-b826-4379-9db9-d9b5f84ddf12"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:24:44.868414 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.868315    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjcxd\" (UniqueName: \"kubernetes.io/projected/70b74253-b826-4379-9db9-d9b5f84ddf12-kube-api-access-cjcxd\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:24:44.868414 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.868348    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70b74253-b826-4379-9db9-d9b5f84ddf12-webhook-cert\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:24:44.986273 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.986238    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-z4ppx"]
Jul 13 07:24:44.992753 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:44.992725    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-z4ppx"]
Jul 13 07:24:45.723556 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.723521    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-lkr5k"]
Jul 13 07:24:45.723945 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.723920    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70b74253-b826-4379-9db9-d9b5f84ddf12" containerName="manager"
Jul 13 07:24:45.723945 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.723930    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="70b74253-b826-4379-9db9-d9b5f84ddf12" containerName="manager"
Jul 13 07:24:45.724035 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.723992    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="70b74253-b826-4379-9db9-d9b5f84ddf12" containerName="manager"
Jul 13 07:24:45.728168 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.728148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:45.731581 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.731557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 07:24:45.731717 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.731557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hvhts\""
Jul 13 07:24:45.731717 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.731564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 07:24:45.737331 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.737308    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-lkr5k"]
Jul 13 07:24:45.776153 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.776117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f-webhook-cert\") pod \"maas-controller-ddc5ffd7c-lkr5k\" (UID: \"c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f\") " pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:45.776328 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.776233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6drs\" (UniqueName: \"kubernetes.io/projected/c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f-kube-api-access-d6drs\") pod \"maas-controller-ddc5ffd7c-lkr5k\" (UID: \"c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f\") " pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:45.877627 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.877591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6drs\" (UniqueName: \"kubernetes.io/projected/c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f-kube-api-access-d6drs\") pod \"maas-controller-ddc5ffd7c-lkr5k\" (UID: \"c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f\") " pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:45.877792 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.877670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f-webhook-cert\") pod \"maas-controller-ddc5ffd7c-lkr5k\" (UID: \"c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f\") " pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:45.880033 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.880005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f-webhook-cert\") pod \"maas-controller-ddc5ffd7c-lkr5k\" (UID: \"c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f\") " pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:45.885384 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:45.885360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6drs\" (UniqueName: \"kubernetes.io/projected/c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f-kube-api-access-d6drs\") pod \"maas-controller-ddc5ffd7c-lkr5k\" (UID: \"c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f\") " pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:46.039087 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:46.039055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:46.179424 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:46.179389    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddc5ffd7c-lkr5k"]
Jul 13 07:24:46.183305 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:24:46.183270    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a6d0b3_f2c3_49b3_bbaa_1ac7aba54b2f.slice/crio-2be11dff32bea5a6f98cd0a8edacdf327174d076090f60b913f1db71436146b7 WatchSource:0}: Error finding container 2be11dff32bea5a6f98cd0a8edacdf327174d076090f60b913f1db71436146b7: Status 404 returned error can't find the container with id 2be11dff32bea5a6f98cd0a8edacdf327174d076090f60b913f1db71436146b7
Jul 13 07:24:46.184685 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:46.184663    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 07:24:46.682648 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:46.682613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k" event={"ID":"c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f","Type":"ContainerStarted","Data":"cd7e70ab603bccf98dcc38deedf9913a0b6d72fc8339ddbf241e70b21f1ac1af"}
Jul 13 07:24:46.682827 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:46.682675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k" event={"ID":"c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f","Type":"ContainerStarted","Data":"2be11dff32bea5a6f98cd0a8edacdf327174d076090f60b913f1db71436146b7"}
Jul 13 07:24:46.682827 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:46.682780    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:24:46.701451 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:46.701384    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k" podStartSLOduration=1.319183057 podStartE2EDuration="1.701363568s" totalImagesPullingTime="382.180511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:24:46.699165932 +0000 UTC m=+752.406043235" watchObservedRunningTime="2026-07-13 07:24:46.701363568 +0000 UTC m=+752.408240871"
Jul 13 07:24:46.920839 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:46.920752    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70b74253-b826-4379-9db9-d9b5f84ddf12" path="/var/lib/kubelet/pods/70b74253-b826-4379-9db9-d9b5f84ddf12/volumes"
Jul 13 07:24:57.693926 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:24:57.693894    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ddc5ffd7c-lkr5k"
Jul 13 07:36:25.654122 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.654090    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"]
Jul 13 07:36:25.657888 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.657868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.660824 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.660804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-1300621c-serving-cert\""
Jul 13 07:36:25.670449 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.670413    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"]
Jul 13 07:36:25.819051 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.819014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dcba678-25e4-440b-8cde-6cc30eff57e6-maas-api-tls\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.819221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.819086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcba678-25e4-440b-8cde-6cc30eff57e6-openshift-service-ca\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.819221 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.819113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2k6\" (UniqueName: \"kubernetes.io/projected/9dcba678-25e4-440b-8cde-6cc30eff57e6-kube-api-access-lm2k6\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.919773 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.919684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcba678-25e4-440b-8cde-6cc30eff57e6-openshift-service-ca\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.919773 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.919731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2k6\" (UniqueName: \"kubernetes.io/projected/9dcba678-25e4-440b-8cde-6cc30eff57e6-kube-api-access-lm2k6\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.919986 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.919824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dcba678-25e4-440b-8cde-6cc30eff57e6-maas-api-tls\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.920416 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.920398    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcba678-25e4-440b-8cde-6cc30eff57e6-openshift-service-ca\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.922146 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.922113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dcba678-25e4-440b-8cde-6cc30eff57e6-maas-api-tls\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.928603 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.928582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2k6\" (UniqueName: \"kubernetes.io/projected/9dcba678-25e4-440b-8cde-6cc30eff57e6-kube-api-access-lm2k6\") pod \"maas-api-e2e-ait-1300621c-744dfb4889-9rrgw\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") " pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:25.969522 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:25.969497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:26.112630 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:26.112597    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"]
Jul 13 07:36:26.114869 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:36:26.114834    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dcba678_25e4_440b_8cde_6cc30eff57e6.slice/crio-913255bf6869ae7473b33779abe105b7ed580310d9de327a4b5242048798c25f WatchSource:0}: Error finding container 913255bf6869ae7473b33779abe105b7ed580310d9de327a4b5242048798c25f: Status 404 returned error can't find the container with id 913255bf6869ae7473b33779abe105b7ed580310d9de327a4b5242048798c25f
Jul 13 07:36:26.116251 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:26.116231    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 07:36:27.091779 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:27.091749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw" event={"ID":"9dcba678-25e4-440b-8cde-6cc30eff57e6","Type":"ContainerStarted","Data":"947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e"}
Jul 13 07:36:27.092149 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:27.091796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw" event={"ID":"9dcba678-25e4-440b-8cde-6cc30eff57e6","Type":"ContainerStarted","Data":"913255bf6869ae7473b33779abe105b7ed580310d9de327a4b5242048798c25f"}
Jul 13 07:36:27.092149 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:27.091877    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:27.111426 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:27.111385    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw" podStartSLOduration=1.664179471 podStartE2EDuration="2.111371397s" totalImagesPullingTime="447.191926ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:36:27.110031195 +0000 UTC m=+1452.816908499" watchObservedRunningTime="2026-07-13 07:36:27.111371397 +0000 UTC m=+1452.818248697"
Jul 13 07:36:31.026015 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.025982    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"]
Jul 13 07:36:31.026486 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.026183    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw" podUID="9dcba678-25e4-440b-8cde-6cc30eff57e6" containerName="maas-api" containerID="cri-o://947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e" gracePeriod=30
Jul 13 07:36:31.031714 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.031693    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:31.273489 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.273462    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:31.368566 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.368528    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dcba678-25e4-440b-8cde-6cc30eff57e6-maas-api-tls\") pod \"9dcba678-25e4-440b-8cde-6cc30eff57e6\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") "
Jul 13 07:36:31.368748 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.368657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcba678-25e4-440b-8cde-6cc30eff57e6-openshift-service-ca\") pod \"9dcba678-25e4-440b-8cde-6cc30eff57e6\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") "
Jul 13 07:36:31.368748 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.368683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm2k6\" (UniqueName: \"kubernetes.io/projected/9dcba678-25e4-440b-8cde-6cc30eff57e6-kube-api-access-lm2k6\") pod \"9dcba678-25e4-440b-8cde-6cc30eff57e6\" (UID: \"9dcba678-25e4-440b-8cde-6cc30eff57e6\") "
Jul 13 07:36:31.369014 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.368982    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dcba678-25e4-440b-8cde-6cc30eff57e6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9dcba678-25e4-440b-8cde-6cc30eff57e6" (UID: "9dcba678-25e4-440b-8cde-6cc30eff57e6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:36:31.370726 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.370703    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dcba678-25e4-440b-8cde-6cc30eff57e6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9dcba678-25e4-440b-8cde-6cc30eff57e6" (UID: "9dcba678-25e4-440b-8cde-6cc30eff57e6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:36:31.370809 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.370771    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dcba678-25e4-440b-8cde-6cc30eff57e6-kube-api-access-lm2k6" (OuterVolumeSpecName: "kube-api-access-lm2k6") pod "9dcba678-25e4-440b-8cde-6cc30eff57e6" (UID: "9dcba678-25e4-440b-8cde-6cc30eff57e6"). InnerVolumeSpecName "kube-api-access-lm2k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:36:31.469851 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.469816    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm2k6\" (UniqueName: \"kubernetes.io/projected/9dcba678-25e4-440b-8cde-6cc30eff57e6-kube-api-access-lm2k6\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:36:31.469851 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.469845    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dcba678-25e4-440b-8cde-6cc30eff57e6-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:36:31.469851 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:31.469856    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dcba678-25e4-440b-8cde-6cc30eff57e6-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:36:32.116971 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.116937    2565 generic.go:356] "Generic (PLEG): container finished" podID="9dcba678-25e4-440b-8cde-6cc30eff57e6" containerID="947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e" exitCode=0
Jul 13 07:36:32.116971 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.116983    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"
Jul 13 07:36:32.117459 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.117021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw" event={"ID":"9dcba678-25e4-440b-8cde-6cc30eff57e6","Type":"ContainerDied","Data":"947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e"}
Jul 13 07:36:32.117459 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.117080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw" event={"ID":"9dcba678-25e4-440b-8cde-6cc30eff57e6","Type":"ContainerDied","Data":"913255bf6869ae7473b33779abe105b7ed580310d9de327a4b5242048798c25f"}
Jul 13 07:36:32.117459 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.117104    2565 scope.go:117] "RemoveContainer" containerID="947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e"
Jul 13 07:36:32.126220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.126204    2565 scope.go:117] "RemoveContainer" containerID="947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e"
Jul 13 07:36:32.126493 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:36:32.126473    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e\": container with ID starting with 947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e not found: ID does not exist" containerID="947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e"
Jul 13 07:36:32.126587 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.126498    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e"} err="failed to get container status \"947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e\": rpc error: code = NotFound desc = could not find container \"947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e\": container with ID starting with 947022cc8df0644b752eee86aca68a46ceb6b8c61bff4cc116d8e525e73afd6e not found: ID does not exist"
Jul 13 07:36:32.140086 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.140054    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"]
Jul 13 07:36:32.145264 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.145240    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-1300621c-744dfb4889-9rrgw"]
Jul 13 07:36:32.921004 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:32.920931    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dcba678-25e4-440b-8cde-6cc30eff57e6" path="/var/lib/kubelet/pods/9dcba678-25e4-440b-8cde-6cc30eff57e6/volumes"
Jul 13 07:36:38.026349 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.026313    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"]
Jul 13 07:36:38.026737 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.026726    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dcba678-25e4-440b-8cde-6cc30eff57e6" containerName="maas-api"
Jul 13 07:36:38.026793 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.026738    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dcba678-25e4-440b-8cde-6cc30eff57e6" containerName="maas-api"
Jul 13 07:36:38.026833 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.026816    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dcba678-25e4-440b-8cde-6cc30eff57e6" containerName="maas-api"
Jul 13 07:36:38.030167 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.030143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.033218 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.033196    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-377f9df1-serving-cert\""
Jul 13 07:36:38.044392 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.044369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"]
Jul 13 07:36:38.133420 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.133388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d995eb4c-9004-42bd-823f-5a67fd601011-maas-api-tls\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.133420 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.133422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d995eb4c-9004-42bd-823f-5a67fd601011-openshift-service-ca\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.133639 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.133481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhqkc\" (UniqueName: \"kubernetes.io/projected/d995eb4c-9004-42bd-823f-5a67fd601011-kube-api-access-fhqkc\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.234973 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.234942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d995eb4c-9004-42bd-823f-5a67fd601011-maas-api-tls\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.234973 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.234987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d995eb4c-9004-42bd-823f-5a67fd601011-openshift-service-ca\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.235232 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.235011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhqkc\" (UniqueName: \"kubernetes.io/projected/d995eb4c-9004-42bd-823f-5a67fd601011-kube-api-access-fhqkc\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.235598 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.235581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d995eb4c-9004-42bd-823f-5a67fd601011-openshift-service-ca\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.237321 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.237289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d995eb4c-9004-42bd-823f-5a67fd601011-maas-api-tls\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.250199 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.250168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhqkc\" (UniqueName: \"kubernetes.io/projected/d995eb4c-9004-42bd-823f-5a67fd601011-kube-api-access-fhqkc\") pod \"maas-api-e2e-ait-377f9df1-b64647fd4-r985c\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") " pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.344038 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.344010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:38.499401 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:38.499376    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"]
Jul 13 07:36:38.501084 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:36:38.501056    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd995eb4c_9004_42bd_823f_5a67fd601011.slice/crio-d2bbf659bc69c2792371ff680e3ef4d07df1ff8faafb851fd439cc868d46ed8f WatchSource:0}: Error finding container d2bbf659bc69c2792371ff680e3ef4d07df1ff8faafb851fd439cc868d46ed8f: Status 404 returned error can't find the container with id d2bbf659bc69c2792371ff680e3ef4d07df1ff8faafb851fd439cc868d46ed8f
Jul 13 07:36:39.151060 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:39.151029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c" event={"ID":"d995eb4c-9004-42bd-823f-5a67fd601011","Type":"ContainerStarted","Data":"3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd"}
Jul 13 07:36:39.151429 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:39.151080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c" event={"ID":"d995eb4c-9004-42bd-823f-5a67fd601011","Type":"ContainerStarted","Data":"d2bbf659bc69c2792371ff680e3ef4d07df1ff8faafb851fd439cc868d46ed8f"}
Jul 13 07:36:39.151429 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:39.151185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:39.174383 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:39.174341    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c" podStartSLOduration=0.744400839 podStartE2EDuration="1.174323778s" totalImagesPullingTime="429.922939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:36:39.17221595 +0000 UTC m=+1464.879093290" watchObservedRunningTime="2026-07-13 07:36:39.174323778 +0000 UTC m=+1464.881201084"
Jul 13 07:36:43.238648 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.238615    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"]
Jul 13 07:36:43.239070 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.238862    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c" podUID="d995eb4c-9004-42bd-823f-5a67fd601011" containerName="maas-api" containerID="cri-o://3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd" gracePeriod=30
Jul 13 07:36:43.486391 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.486365    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:43.590396 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.590366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d995eb4c-9004-42bd-823f-5a67fd601011-openshift-service-ca\") pod \"d995eb4c-9004-42bd-823f-5a67fd601011\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") "
Jul 13 07:36:43.590562 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.590407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d995eb4c-9004-42bd-823f-5a67fd601011-maas-api-tls\") pod \"d995eb4c-9004-42bd-823f-5a67fd601011\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") "
Jul 13 07:36:43.590562 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.590501    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhqkc\" (UniqueName: \"kubernetes.io/projected/d995eb4c-9004-42bd-823f-5a67fd601011-kube-api-access-fhqkc\") pod \"d995eb4c-9004-42bd-823f-5a67fd601011\" (UID: \"d995eb4c-9004-42bd-823f-5a67fd601011\") "
Jul 13 07:36:43.590758 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.590732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d995eb4c-9004-42bd-823f-5a67fd601011-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d995eb4c-9004-42bd-823f-5a67fd601011" (UID: "d995eb4c-9004-42bd-823f-5a67fd601011"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:36:43.592372 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.592356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d995eb4c-9004-42bd-823f-5a67fd601011-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d995eb4c-9004-42bd-823f-5a67fd601011" (UID: "d995eb4c-9004-42bd-823f-5a67fd601011"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:36:43.592540 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.592524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d995eb4c-9004-42bd-823f-5a67fd601011-kube-api-access-fhqkc" (OuterVolumeSpecName: "kube-api-access-fhqkc") pod "d995eb4c-9004-42bd-823f-5a67fd601011" (UID: "d995eb4c-9004-42bd-823f-5a67fd601011"). InnerVolumeSpecName "kube-api-access-fhqkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:36:43.691236 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.691209    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d995eb4c-9004-42bd-823f-5a67fd601011-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:36:43.691236 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.691233    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d995eb4c-9004-42bd-823f-5a67fd601011-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:36:43.691236 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:43.691242    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhqkc\" (UniqueName: \"kubernetes.io/projected/d995eb4c-9004-42bd-823f-5a67fd601011-kube-api-access-fhqkc\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:36:44.176130 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.176097    2565 generic.go:356] "Generic (PLEG): container finished" podID="d995eb4c-9004-42bd-823f-5a67fd601011" containerID="3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd" exitCode=0
Jul 13 07:36:44.176331 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.176149    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"
Jul 13 07:36:44.176331 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.176151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c" event={"ID":"d995eb4c-9004-42bd-823f-5a67fd601011","Type":"ContainerDied","Data":"3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd"}
Jul 13 07:36:44.176331 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.176284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c" event={"ID":"d995eb4c-9004-42bd-823f-5a67fd601011","Type":"ContainerDied","Data":"d2bbf659bc69c2792371ff680e3ef4d07df1ff8faafb851fd439cc868d46ed8f"}
Jul 13 07:36:44.176331 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.176314    2565 scope.go:117] "RemoveContainer" containerID="3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd"
Jul 13 07:36:44.188539 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.188488    2565 scope.go:117] "RemoveContainer" containerID="3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd"
Jul 13 07:36:44.188788 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:36:44.188766    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd\": container with ID starting with 3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd not found: ID does not exist" containerID="3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd"
Jul 13 07:36:44.188845 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.188801    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd"} err="failed to get container status \"3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd\": rpc error: code = NotFound desc = could not find container \"3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd\": container with ID starting with 3302bb5f9f1b1cf6381208402af63eb9f87b7cc20808590cf166ba172928d0fd not found: ID does not exist"
Jul 13 07:36:44.199539 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.199509    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"]
Jul 13 07:36:44.203700 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.203679    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-377f9df1-b64647fd4-r985c"]
Jul 13 07:36:44.921150 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:44.921118    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d995eb4c-9004-42bd-823f-5a67fd601011" path="/var/lib/kubelet/pods/d995eb4c-9004-42bd-823f-5a67fd601011/volumes"
Jul 13 07:36:56.416504 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.416473    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"]
Jul 13 07:36:56.417005 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.416865    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d995eb4c-9004-42bd-823f-5a67fd601011" containerName="maas-api"
Jul 13 07:36:56.417005 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.416876    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d995eb4c-9004-42bd-823f-5a67fd601011" containerName="maas-api"
Jul 13 07:36:56.417005 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.416954    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d995eb4c-9004-42bd-823f-5a67fd601011" containerName="maas-api"
Jul 13 07:36:56.420273 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.420257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:56.423152 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.423131    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-1d9f2735-serving-cert\""
Jul 13 07:36:56.430838 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.430789    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"]
Jul 13 07:36:56.516484 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.516449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrtdx\" (UniqueName: \"kubernetes.io/projected/6a563a3b-ddef-4b42-ab9d-10880d0ba378-kube-api-access-zrtdx\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:56.516667 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.516495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a563a3b-ddef-4b42-ab9d-10880d0ba378-openshift-service-ca\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:56.516667 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.516628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:56.617295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.617257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:56.617521 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.617360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrtdx\" (UniqueName: \"kubernetes.io/projected/6a563a3b-ddef-4b42-ab9d-10880d0ba378-kube-api-access-zrtdx\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:56.617521 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.617387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a563a3b-ddef-4b42-ab9d-10880d0ba378-openshift-service-ca\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:56.617521 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:36:56.617412    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-1d9f2735-serving-cert: secret "maas-api-e2e-derive-1d9f2735-serving-cert" not found
Jul 13 07:36:56.617521 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:36:56.617508    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls podName:6a563a3b-ddef-4b42-ab9d-10880d0ba378 nodeName:}" failed. No retries permitted until 2026-07-13 07:36:57.117490254 +0000 UTC m=+1482.824367535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls") pod "maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt" (UID: "6a563a3b-ddef-4b42-ab9d-10880d0ba378") : secret "maas-api-e2e-derive-1d9f2735-serving-cert" not found
Jul 13 07:36:56.618044 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.618022    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a563a3b-ddef-4b42-ab9d-10880d0ba378-openshift-service-ca\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:56.626257 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:56.626232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrtdx\" (UniqueName: \"kubernetes.io/projected/6a563a3b-ddef-4b42-ab9d-10880d0ba378-kube-api-access-zrtdx\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:57.121923 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:57.121887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:57.124184 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:57.124155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls\") pod \"maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") " pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:57.332173 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:57.332137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:57.465605 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:57.465581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"]
Jul 13 07:36:57.467587 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:36:57.467560    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a563a3b_ddef_4b42_ab9d_10880d0ba378.slice/crio-129a76d872a98d0bdbe4fa4e46987763999ba8d67fa3d771c72b2b3f857b4022 WatchSource:0}: Error finding container 129a76d872a98d0bdbe4fa4e46987763999ba8d67fa3d771c72b2b3f857b4022: Status 404 returned error can't find the container with id 129a76d872a98d0bdbe4fa4e46987763999ba8d67fa3d771c72b2b3f857b4022
Jul 13 07:36:58.244861 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:58.244767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt" event={"ID":"6a563a3b-ddef-4b42-ab9d-10880d0ba378","Type":"ContainerStarted","Data":"7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d"}
Jul 13 07:36:58.244861 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:58.244826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt" event={"ID":"6a563a3b-ddef-4b42-ab9d-10880d0ba378","Type":"ContainerStarted","Data":"129a76d872a98d0bdbe4fa4e46987763999ba8d67fa3d771c72b2b3f857b4022"}
Jul 13 07:36:58.244861 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:58.244853    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:36:58.262253 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:36:58.262203    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt" podStartSLOduration=1.928944311 podStartE2EDuration="2.262185373s" totalImagesPullingTime="333.241062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:36:58.260626373 +0000 UTC m=+1483.967503698" watchObservedRunningTime="2026-07-13 07:36:58.262185373 +0000 UTC m=+1483.969062677"
Jul 13 07:37:01.158814 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.158780    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"]
Jul 13 07:37:01.159321 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.159286    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt" podUID="6a563a3b-ddef-4b42-ab9d-10880d0ba378" containerName="maas-api" containerID="cri-o://7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d" gracePeriod=30
Jul 13 07:37:01.404522 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.404497    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:37:01.563249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.563214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls\") pod \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") "
Jul 13 07:37:01.563420 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.563286    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrtdx\" (UniqueName: \"kubernetes.io/projected/6a563a3b-ddef-4b42-ab9d-10880d0ba378-kube-api-access-zrtdx\") pod \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") "
Jul 13 07:37:01.563420 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.563353    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a563a3b-ddef-4b42-ab9d-10880d0ba378-openshift-service-ca\") pod \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\" (UID: \"6a563a3b-ddef-4b42-ab9d-10880d0ba378\") "
Jul 13 07:37:01.563747 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.563720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a563a3b-ddef-4b42-ab9d-10880d0ba378-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a563a3b-ddef-4b42-ab9d-10880d0ba378" (UID: "6a563a3b-ddef-4b42-ab9d-10880d0ba378"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:37:01.565337 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.565314    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a563a3b-ddef-4b42-ab9d-10880d0ba378" (UID: "6a563a3b-ddef-4b42-ab9d-10880d0ba378"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:37:01.565420 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.565349    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a563a3b-ddef-4b42-ab9d-10880d0ba378-kube-api-access-zrtdx" (OuterVolumeSpecName: "kube-api-access-zrtdx") pod "6a563a3b-ddef-4b42-ab9d-10880d0ba378" (UID: "6a563a3b-ddef-4b42-ab9d-10880d0ba378"). InnerVolumeSpecName "kube-api-access-zrtdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:37:01.664546 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.664511    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a563a3b-ddef-4b42-ab9d-10880d0ba378-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:37:01.664546 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.664541    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a563a3b-ddef-4b42-ab9d-10880d0ba378-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:37:01.664546 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:01.664550    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrtdx\" (UniqueName: \"kubernetes.io/projected/6a563a3b-ddef-4b42-ab9d-10880d0ba378-kube-api-access-zrtdx\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:37:02.263752 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.263719    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a563a3b-ddef-4b42-ab9d-10880d0ba378" containerID="7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d" exitCode=0
Jul 13 07:37:02.264146 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.263771    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"
Jul 13 07:37:02.264146 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.263777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt" event={"ID":"6a563a3b-ddef-4b42-ab9d-10880d0ba378","Type":"ContainerDied","Data":"7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d"}
Jul 13 07:37:02.264146 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.263818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt" event={"ID":"6a563a3b-ddef-4b42-ab9d-10880d0ba378","Type":"ContainerDied","Data":"129a76d872a98d0bdbe4fa4e46987763999ba8d67fa3d771c72b2b3f857b4022"}
Jul 13 07:37:02.264146 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.263839    2565 scope.go:117] "RemoveContainer" containerID="7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d"
Jul 13 07:37:02.273118 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.273101    2565 scope.go:117] "RemoveContainer" containerID="7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d"
Jul 13 07:37:02.273399 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:37:02.273381    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d\": container with ID starting with 7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d not found: ID does not exist" containerID="7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d"
Jul 13 07:37:02.273470 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.273407    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d"} err="failed to get container status \"7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d\": rpc error: code = NotFound desc = could not find container \"7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d\": container with ID starting with 7011e8abf7b45f0e1e6cd0b18a8db6687e69f02480b760859c2c2f9dffc12a9d not found: ID does not exist"
Jul 13 07:37:02.285215 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.285189    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"]
Jul 13 07:37:02.289468 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.289431    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-1d9f2735-66fcb9dd6c-gnpnt"]
Jul 13 07:37:02.920429 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:37:02.920401    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a563a3b-ddef-4b42-ab9d-10880d0ba378" path="/var/lib/kubelet/pods/6a563a3b-ddef-4b42-ab9d-10880d0ba378/volumes"
Jul 13 07:38:45.806234 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.806191    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"]
Jul 13 07:38:45.806892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.806613    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a563a3b-ddef-4b42-ab9d-10880d0ba378" containerName="maas-api"
Jul 13 07:38:45.806892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.806625    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a563a3b-ddef-4b42-ab9d-10880d0ba378" containerName="maas-api"
Jul 13 07:38:45.806892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.806683    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a563a3b-ddef-4b42-ab9d-10880d0ba378" containerName="maas-api"
Jul 13 07:38:45.809732 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.809711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:45.812489 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.812466    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-f7d6162d-serving-cert\""
Jul 13 07:38:45.820174 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.820143    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"]
Jul 13 07:38:45.923799 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.923766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc13044-51bf-44a0-a223-4075fd8ab26b-openshift-service-ca\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:45.923972 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.923855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bxg9\" (UniqueName: \"kubernetes.io/projected/9bc13044-51bf-44a0-a223-4075fd8ab26b-kube-api-access-2bxg9\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:45.923972 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:45.923890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bc13044-51bf-44a0-a223-4075fd8ab26b-maas-api-tls\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:46.025082 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.025041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc13044-51bf-44a0-a223-4075fd8ab26b-openshift-service-ca\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:46.025303 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.025207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bxg9\" (UniqueName: \"kubernetes.io/projected/9bc13044-51bf-44a0-a223-4075fd8ab26b-kube-api-access-2bxg9\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:46.025303 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.025255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bc13044-51bf-44a0-a223-4075fd8ab26b-maas-api-tls\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:46.025979 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.025952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc13044-51bf-44a0-a223-4075fd8ab26b-openshift-service-ca\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:46.027702 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.027682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bc13044-51bf-44a0-a223-4075fd8ab26b-maas-api-tls\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:46.033816 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.033790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bxg9\" (UniqueName: \"kubernetes.io/projected/9bc13044-51bf-44a0-a223-4075fd8ab26b-kube-api-access-2bxg9\") pod \"maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") " pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:46.120995 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.120916    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:46.255725 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.255662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"]
Jul 13 07:38:46.258141 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:38:46.258113    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc13044_51bf_44a0_a223_4075fd8ab26b.slice/crio-656d3910e6d70fd8863f46801c560470701d0db678e6c68b8d514fd6211a0724 WatchSource:0}: Error finding container 656d3910e6d70fd8863f46801c560470701d0db678e6c68b8d514fd6211a0724: Status 404 returned error can't find the container with id 656d3910e6d70fd8863f46801c560470701d0db678e6c68b8d514fd6211a0724
Jul 13 07:38:46.772056 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:46.772027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r" event={"ID":"9bc13044-51bf-44a0-a223-4075fd8ab26b","Type":"ContainerStarted","Data":"656d3910e6d70fd8863f46801c560470701d0db678e6c68b8d514fd6211a0724"}
Jul 13 07:38:47.785046 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:47.784990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r" event={"ID":"9bc13044-51bf-44a0-a223-4075fd8ab26b","Type":"ContainerStarted","Data":"d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067"}
Jul 13 07:38:47.785473 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:47.785098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:47.803689 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:47.803635    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r" podStartSLOduration=2.243889467 podStartE2EDuration="2.803615568s" totalImagesPullingTime="559.726101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:38:47.801797366 +0000 UTC m=+1593.508674690" watchObservedRunningTime="2026-07-13 07:38:47.803615568 +0000 UTC m=+1593.510492885"
Jul 13 07:38:53.795066 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:53.795035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:57.829210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:57.829172    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"]
Jul 13 07:38:57.829641 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:57.829397    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r" podUID="9bc13044-51bf-44a0-a223-4075fd8ab26b" containerName="maas-api" containerID="cri-o://d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067" gracePeriod=30
Jul 13 07:38:58.078255 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.078229    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:58.240940 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.240850    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc13044-51bf-44a0-a223-4075fd8ab26b-openshift-service-ca\") pod \"9bc13044-51bf-44a0-a223-4075fd8ab26b\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") "
Jul 13 07:38:58.240940 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.240923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bxg9\" (UniqueName: \"kubernetes.io/projected/9bc13044-51bf-44a0-a223-4075fd8ab26b-kube-api-access-2bxg9\") pod \"9bc13044-51bf-44a0-a223-4075fd8ab26b\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") "
Jul 13 07:38:58.240940 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.240939    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bc13044-51bf-44a0-a223-4075fd8ab26b-maas-api-tls\") pod \"9bc13044-51bf-44a0-a223-4075fd8ab26b\" (UID: \"9bc13044-51bf-44a0-a223-4075fd8ab26b\") "
Jul 13 07:38:58.241225 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.241201    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bc13044-51bf-44a0-a223-4075fd8ab26b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9bc13044-51bf-44a0-a223-4075fd8ab26b" (UID: "9bc13044-51bf-44a0-a223-4075fd8ab26b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:38:58.243055 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.243024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc13044-51bf-44a0-a223-4075fd8ab26b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9bc13044-51bf-44a0-a223-4075fd8ab26b" (UID: "9bc13044-51bf-44a0-a223-4075fd8ab26b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:38:58.243150 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.243055    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc13044-51bf-44a0-a223-4075fd8ab26b-kube-api-access-2bxg9" (OuterVolumeSpecName: "kube-api-access-2bxg9") pod "9bc13044-51bf-44a0-a223-4075fd8ab26b" (UID: "9bc13044-51bf-44a0-a223-4075fd8ab26b"). InnerVolumeSpecName "kube-api-access-2bxg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:38:58.341569 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.341536    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bc13044-51bf-44a0-a223-4075fd8ab26b-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:38:58.341569 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.341563    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bxg9\" (UniqueName: \"kubernetes.io/projected/9bc13044-51bf-44a0-a223-4075fd8ab26b-kube-api-access-2bxg9\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:38:58.341569 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.341572    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bc13044-51bf-44a0-a223-4075fd8ab26b-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:38:58.837227 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.837195    2565 generic.go:356] "Generic (PLEG): container finished" podID="9bc13044-51bf-44a0-a223-4075fd8ab26b" containerID="d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067" exitCode=0
Jul 13 07:38:58.837705 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.837235    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"
Jul 13 07:38:58.837705 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.837241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r" event={"ID":"9bc13044-51bf-44a0-a223-4075fd8ab26b","Type":"ContainerDied","Data":"d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067"}
Jul 13 07:38:58.837705 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.837290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r" event={"ID":"9bc13044-51bf-44a0-a223-4075fd8ab26b","Type":"ContainerDied","Data":"656d3910e6d70fd8863f46801c560470701d0db678e6c68b8d514fd6211a0724"}
Jul 13 07:38:58.837705 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.837311    2565 scope.go:117] "RemoveContainer" containerID="d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067"
Jul 13 07:38:58.848061 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.848041    2565 scope.go:117] "RemoveContainer" containerID="d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067"
Jul 13 07:38:58.848321 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:38:58.848305    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067\": container with ID starting with d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067 not found: ID does not exist" containerID="d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067"
Jul 13 07:38:58.848384 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.848328    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067"} err="failed to get container status \"d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067\": rpc error: code = NotFound desc = could not find container \"d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067\": container with ID starting with d57135a36fc3127ecc348ee91a00b856e1348eeef52c71ab3bb6466339bb7067 not found: ID does not exist"
Jul 13 07:38:58.906297 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.906263    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"]
Jul 13 07:38:58.910326 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.910300    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-f7d6162d-6b5bb5d7d6-vpd9r"]
Jul 13 07:38:58.921237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:38:58.921212    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bc13044-51bf-44a0-a223-4075fd8ab26b" path="/var/lib/kubelet/pods/9bc13044-51bf-44a0-a223-4075fd8ab26b/volumes"
Jul 13 07:39:28.197028 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.197000    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"]
Jul 13 07:39:28.197550 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.197410    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc13044-51bf-44a0-a223-4075fd8ab26b" containerName="maas-api"
Jul 13 07:39:28.197550 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.197422    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc13044-51bf-44a0-a223-4075fd8ab26b" containerName="maas-api"
Jul 13 07:39:28.197550 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.197515    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc13044-51bf-44a0-a223-4075fd8ab26b" containerName="maas-api"
Jul 13 07:39:28.200726 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.200711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.203275 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.203252    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-3ec805da-serving-cert\""
Jul 13 07:39:28.217012 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.216966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"]
Jul 13 07:39:28.326369 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.326339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-maas-api-tls\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.326569 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.326387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-openshift-service-ca\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.326569 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.326410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqkf\" (UniqueName: \"kubernetes.io/projected/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-kube-api-access-qcqkf\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.427678 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.427645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-maas-api-tls\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.427856 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.427689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-openshift-service-ca\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.427856 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.427715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqkf\" (UniqueName: \"kubernetes.io/projected/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-kube-api-access-qcqkf\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.428317 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.428292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-openshift-service-ca\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.430085 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.430063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-maas-api-tls\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.437025 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.436998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqkf\" (UniqueName: \"kubernetes.io/projected/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-kube-api-access-qcqkf\") pod \"maas-api-e2e-mt-3ec805da-8477b77547-r576h\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") " pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.510980 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.510902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:28.657732 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.657711    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"]
Jul 13 07:39:28.660024 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:39:28.659996    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2567cbb1_9eef_4bf0_8caf_ded98b2f4743.slice/crio-69212c0348a7b5b8eea49443ab55be3e11ff89587f99c44c7b27f9d73331047f WatchSource:0}: Error finding container 69212c0348a7b5b8eea49443ab55be3e11ff89587f99c44c7b27f9d73331047f: Status 404 returned error can't find the container with id 69212c0348a7b5b8eea49443ab55be3e11ff89587f99c44c7b27f9d73331047f
Jul 13 07:39:28.980226 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:28.980196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h" event={"ID":"2567cbb1-9eef-4bf0-8caf-ded98b2f4743","Type":"ContainerStarted","Data":"69212c0348a7b5b8eea49443ab55be3e11ff89587f99c44c7b27f9d73331047f"}
Jul 13 07:39:29.985695 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:29.985654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h" event={"ID":"2567cbb1-9eef-4bf0-8caf-ded98b2f4743","Type":"ContainerStarted","Data":"bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7"}
Jul 13 07:39:29.986058 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:29.985714    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:30.003801 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:30.003759    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h" podStartSLOduration=1.70233652 podStartE2EDuration="2.003746058s" totalImagesPullingTime="301.409538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:39:30.002568429 +0000 UTC m=+1635.709445751" watchObservedRunningTime="2026-07-13 07:39:30.003746058 +0000 UTC m=+1635.710623359"
Jul 13 07:39:35.996075 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:35.996048    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:39:51.139295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.139258    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"]
Jul 13 07:39:51.142863 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.142834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.147736 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.147713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3ec805da\"/\"default-dockercfg-rjz8n\""
Jul 13 07:39:51.147863 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.147715    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3ec805da\"/\"openshift-service-ca.crt\""
Jul 13 07:39:51.147863 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.147715    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3ec805da\"/\"kube-root-ca.crt\""
Jul 13 07:39:51.147863 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.147719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3ec805da\"/\"e2e-lifecycle-model-3ec805da-kserve-self-signed-certs\""
Jul 13 07:39:51.153649 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.153629    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"]
Jul 13 07:39:51.243852 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.243826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-tmp-dir\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.244017 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.243867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hskr5\" (UniqueName: \"kubernetes.io/projected/6bf4f261-9293-482b-a185-90812f3f395f-kube-api-access-hskr5\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.244017 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.243985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-home\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.244088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.244020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-dshm\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.244088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.244048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-model-cache\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.244151 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.244130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bf4f261-9293-482b-a185-90812f3f395f-tls-certs\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345216 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-home\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-dshm\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-model-cache\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bf4f261-9293-482b-a185-90812f3f395f-tls-certs\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-tmp-dir\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hskr5\" (UniqueName: \"kubernetes.io/projected/6bf4f261-9293-482b-a185-90812f3f395f-kube-api-access-hskr5\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345640    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-home\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-model-cache\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.345792 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.345774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-tmp-dir\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.347491 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.347472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-dshm\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.347653 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.347639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bf4f261-9293-482b-a185-90812f3f395f-tls-certs\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.354290 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.354270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hskr5\" (UniqueName: \"kubernetes.io/projected/6bf4f261-9293-482b-a185-90812f3f395f-kube-api-access-hskr5\") pod \"e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") " pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.454105 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.454023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:39:51.586685 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:51.586576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"]
Jul 13 07:39:51.588933 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:39:51.588905    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf4f261_9293_482b_a185_90812f3f395f.slice/crio-7858aae501be22260d0edfe7111a470cab9b1d304cf97937d08806db001f793a WatchSource:0}: Error finding container 7858aae501be22260d0edfe7111a470cab9b1d304cf97937d08806db001f793a: Status 404 returned error can't find the container with id 7858aae501be22260d0edfe7111a470cab9b1d304cf97937d08806db001f793a
Jul 13 07:39:52.096687 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:52.096645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj" event={"ID":"6bf4f261-9293-482b-a185-90812f3f395f","Type":"ContainerStarted","Data":"42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6"}
Jul 13 07:39:52.096856 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:52.096696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj" event={"ID":"6bf4f261-9293-482b-a185-90812f3f395f","Type":"ContainerStarted","Data":"7858aae501be22260d0edfe7111a470cab9b1d304cf97937d08806db001f793a"}
Jul 13 07:39:52.113971 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:39:52.113919    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj" podStartSLOduration=1.113878992 podStartE2EDuration="1.113878992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:39:52.112431507 +0000 UTC m=+1657.819308827" watchObservedRunningTime="2026-07-13 07:39:52.113878992 +0000 UTC m=+1657.820756294"
Jul 13 07:40:01.454403 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:01.454357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:40:01.454902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:01.454424    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:40:01.466535 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:01.466511    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:40:02.153169 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:02.153142    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:40:10.654758 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:10.654723    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"]
Jul 13 07:40:10.655129 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:10.654965    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h" podUID="2567cbb1-9eef-4bf0-8caf-ded98b2f4743" containerName="maas-api" containerID="cri-o://bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7" gracePeriod=30
Jul 13 07:40:10.900467 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:10.900393    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:40:11.042096 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.042067    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcqkf\" (UniqueName: \"kubernetes.io/projected/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-kube-api-access-qcqkf\") pod \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") "
Jul 13 07:40:11.042249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.042203    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-openshift-service-ca\") pod \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") "
Jul 13 07:40:11.042249 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.042233    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-maas-api-tls\") pod \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\" (UID: \"2567cbb1-9eef-4bf0-8caf-ded98b2f4743\") "
Jul 13 07:40:11.042574 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.042547    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2567cbb1-9eef-4bf0-8caf-ded98b2f4743" (UID: "2567cbb1-9eef-4bf0-8caf-ded98b2f4743"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:40:11.044110 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.044089    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-kube-api-access-qcqkf" (OuterVolumeSpecName: "kube-api-access-qcqkf") pod "2567cbb1-9eef-4bf0-8caf-ded98b2f4743" (UID: "2567cbb1-9eef-4bf0-8caf-ded98b2f4743"). InnerVolumeSpecName "kube-api-access-qcqkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:40:11.044177 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.044124    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2567cbb1-9eef-4bf0-8caf-ded98b2f4743" (UID: "2567cbb1-9eef-4bf0-8caf-ded98b2f4743"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:40:11.143493 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.143424    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:11.143493 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.143487    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:11.143493 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.143498    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcqkf\" (UniqueName: \"kubernetes.io/projected/2567cbb1-9eef-4bf0-8caf-ded98b2f4743-kube-api-access-qcqkf\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:11.185537 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.185501    2565 generic.go:356] "Generic (PLEG): container finished" podID="2567cbb1-9eef-4bf0-8caf-ded98b2f4743" containerID="bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7" exitCode=0
Jul 13 07:40:11.185704 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.185545    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"
Jul 13 07:40:11.185704 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.185584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h" event={"ID":"2567cbb1-9eef-4bf0-8caf-ded98b2f4743","Type":"ContainerDied","Data":"bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7"}
Jul 13 07:40:11.185704 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.185635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h" event={"ID":"2567cbb1-9eef-4bf0-8caf-ded98b2f4743","Type":"ContainerDied","Data":"69212c0348a7b5b8eea49443ab55be3e11ff89587f99c44c7b27f9d73331047f"}
Jul 13 07:40:11.185704 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.185656    2565 scope.go:117] "RemoveContainer" containerID="bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7"
Jul 13 07:40:11.194522 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.194505    2565 scope.go:117] "RemoveContainer" containerID="bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7"
Jul 13 07:40:11.194772 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:40:11.194751    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7\": container with ID starting with bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7 not found: ID does not exist" containerID="bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7"
Jul 13 07:40:11.194829 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.194781    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7"} err="failed to get container status \"bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7\": rpc error: code = NotFound desc = could not find container \"bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7\": container with ID starting with bdff4d1a64aa23dc704c95516b18e5d853f8a2c028e8a6c779519e00b73c71f7 not found: ID does not exist"
Jul 13 07:40:11.204576 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.204554    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"]
Jul 13 07:40:11.207738 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:11.207716    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-3ec805da-8477b77547-r576h"]
Jul 13 07:40:12.920567 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:12.920537    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2567cbb1-9eef-4bf0-8caf-ded98b2f4743" path="/var/lib/kubelet/pods/2567cbb1-9eef-4bf0-8caf-ded98b2f4743/volumes"
Jul 13 07:40:20.939473 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:20.939425    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"]
Jul 13 07:40:35.959297 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:35.959256    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj" podUID="6bf4f261-9293-482b-a185-90812f3f395f" containerName="main" containerID="cri-o://42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6" gracePeriod=45
Jul 13 07:40:36.209572 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.209515    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:40:36.274570 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.274532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-dshm\") pod \"6bf4f261-9293-482b-a185-90812f3f395f\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") "
Jul 13 07:40:36.274742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.274581    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-model-cache\") pod \"6bf4f261-9293-482b-a185-90812f3f395f\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") "
Jul 13 07:40:36.274742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.274657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hskr5\" (UniqueName: \"kubernetes.io/projected/6bf4f261-9293-482b-a185-90812f3f395f-kube-api-access-hskr5\") pod \"6bf4f261-9293-482b-a185-90812f3f395f\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") "
Jul 13 07:40:36.274742 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.274721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-tmp-dir\") pod \"6bf4f261-9293-482b-a185-90812f3f395f\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") "
Jul 13 07:40:36.274915 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.274785    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-home\") pod \"6bf4f261-9293-482b-a185-90812f3f395f\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") "
Jul 13 07:40:36.274915 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.274809    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bf4f261-9293-482b-a185-90812f3f395f-tls-certs\") pod \"6bf4f261-9293-482b-a185-90812f3f395f\" (UID: \"6bf4f261-9293-482b-a185-90812f3f395f\") "
Jul 13 07:40:36.274915 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.274873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-model-cache" (OuterVolumeSpecName: "model-cache") pod "6bf4f261-9293-482b-a185-90812f3f395f" (UID: "6bf4f261-9293-482b-a185-90812f3f395f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:40:36.275056 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.275008    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6bf4f261-9293-482b-a185-90812f3f395f" (UID: "6bf4f261-9293-482b-a185-90812f3f395f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:40:36.275114 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.275066    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-home" (OuterVolumeSpecName: "home") pod "6bf4f261-9293-482b-a185-90812f3f395f" (UID: "6bf4f261-9293-482b-a185-90812f3f395f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:40:36.275228 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.275210    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-home\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:36.275309 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.275230    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-model-cache\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:36.275309 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.275241    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-tmp-dir\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:36.276827 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.276805    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-dshm" (OuterVolumeSpecName: "dshm") pod "6bf4f261-9293-482b-a185-90812f3f395f" (UID: "6bf4f261-9293-482b-a185-90812f3f395f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:40:36.276935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.276803    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bf4f261-9293-482b-a185-90812f3f395f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6bf4f261-9293-482b-a185-90812f3f395f" (UID: "6bf4f261-9293-482b-a185-90812f3f395f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:40:36.276935 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.276854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf4f261-9293-482b-a185-90812f3f395f-kube-api-access-hskr5" (OuterVolumeSpecName: "kube-api-access-hskr5") pod "6bf4f261-9293-482b-a185-90812f3f395f" (UID: "6bf4f261-9293-482b-a185-90812f3f395f"). InnerVolumeSpecName "kube-api-access-hskr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:40:36.308275 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.308241    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bf4f261-9293-482b-a185-90812f3f395f" containerID="42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6" exitCode=0
Jul 13 07:40:36.308404 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.308290    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"
Jul 13 07:40:36.308404 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.308289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj" event={"ID":"6bf4f261-9293-482b-a185-90812f3f395f","Type":"ContainerDied","Data":"42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6"}
Jul 13 07:40:36.308553 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.308404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj" event={"ID":"6bf4f261-9293-482b-a185-90812f3f395f","Type":"ContainerDied","Data":"7858aae501be22260d0edfe7111a470cab9b1d304cf97937d08806db001f793a"}
Jul 13 07:40:36.308553 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.308425    2565 scope.go:117] "RemoveContainer" containerID="42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6"
Jul 13 07:40:36.318036 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.318015    2565 scope.go:117] "RemoveContainer" containerID="42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6"
Jul 13 07:40:36.318293 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:40:36.318275    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6\": container with ID starting with 42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6 not found: ID does not exist" containerID="42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6"
Jul 13 07:40:36.318359 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.318299    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6"} err="failed to get container status \"42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6\": rpc error: code = NotFound desc = could not find container \"42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6\": container with ID starting with 42abdf3f083a223a46ad4564118cc3497e277c49b1bf5d998a21e1e714ab5bb6 not found: ID does not exist"
Jul 13 07:40:36.329460 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.329422    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"]
Jul 13 07:40:36.331848 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.331827    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3ec805da/e2e-lifecycle-model-3ec805da-kserve-69678646c-6hnzj"]
Jul 13 07:40:36.376142 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.376113    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hskr5\" (UniqueName: \"kubernetes.io/projected/6bf4f261-9293-482b-a185-90812f3f395f-kube-api-access-hskr5\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:36.376142 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.376138    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bf4f261-9293-482b-a185-90812f3f395f-tls-certs\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:36.376142 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.376148    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bf4f261-9293-482b-a185-90812f3f395f-dshm\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:40:36.922288 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:40:36.922256    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bf4f261-9293-482b-a185-90812f3f395f" path="/var/lib/kubelet/pods/6bf4f261-9293-482b-a185-90812f3f395f/volumes"
Jul 13 07:42:00.829326 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.829289    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"]
Jul 13 07:42:00.829766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.829687    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf4f261-9293-482b-a185-90812f3f395f" containerName="main"
Jul 13 07:42:00.829766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.829698    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf4f261-9293-482b-a185-90812f3f395f" containerName="main"
Jul 13 07:42:00.829766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.829719    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2567cbb1-9eef-4bf0-8caf-ded98b2f4743" containerName="maas-api"
Jul 13 07:42:00.829766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.829726    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2567cbb1-9eef-4bf0-8caf-ded98b2f4743" containerName="maas-api"
Jul 13 07:42:00.829943 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.829812    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2567cbb1-9eef-4bf0-8caf-ded98b2f4743" containerName="maas-api"
Jul 13 07:42:00.829943 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.829822    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf4f261-9293-482b-a185-90812f3f395f" containerName="main"
Jul 13 07:42:00.832971 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.832957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:00.835768 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.835747    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-7d46e0-serving-cert\""
Jul 13 07:42:00.845530 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.845509    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"]
Jul 13 07:42:00.961774 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.961743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:00.961944 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.961865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9jrh\" (UniqueName: \"kubernetes.io/projected/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-kube-api-access-l9jrh\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:00.961944 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:00.961920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.063402 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.063362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9jrh\" (UniqueName: \"kubernetes.io/projected/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-kube-api-access-l9jrh\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.063608 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.063506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.063777 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.063750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.063923 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:42:01.063885    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-7d46e0-serving-cert: secret "maas-api-e2e-inf-a-7d46e0-serving-cert" not found
Jul 13 07:42:01.063978 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:42:01.063942    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls podName:6bdd6fa1-f057-4b00-9ef1-b7efa483450f nodeName:}" failed. No retries permitted until 2026-07-13 07:42:01.563924431 +0000 UTC m=+1787.270801716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls") pod "maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47" (UID: "6bdd6fa1-f057-4b00-9ef1-b7efa483450f") : secret "maas-api-e2e-inf-a-7d46e0-serving-cert" not found
Jul 13 07:42:01.064213 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.064196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.073147 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.073117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9jrh\" (UniqueName: \"kubernetes.io/projected/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-kube-api-access-l9jrh\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.568809 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.568773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.571164 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.571144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls\") pod \"maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") " pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.742909 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.742873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:01.879448 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.879411    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"]
Jul 13 07:42:01.881602 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:42:01.881566    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bdd6fa1_f057_4b00_9ef1_b7efa483450f.slice/crio-f90926c7a235f60ff2b40728a12242725d4347d7eb057425379cbc29eed83493 WatchSource:0}: Error finding container f90926c7a235f60ff2b40728a12242725d4347d7eb057425379cbc29eed83493: Status 404 returned error can't find the container with id f90926c7a235f60ff2b40728a12242725d4347d7eb057425379cbc29eed83493
Jul 13 07:42:01.882928 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:01.882912    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 07:42:02.731705 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:02.731612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47" event={"ID":"6bdd6fa1-f057-4b00-9ef1-b7efa483450f","Type":"ContainerStarted","Data":"3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb"}
Jul 13 07:42:02.731705 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:02.731660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47" event={"ID":"6bdd6fa1-f057-4b00-9ef1-b7efa483450f","Type":"ContainerStarted","Data":"f90926c7a235f60ff2b40728a12242725d4347d7eb057425379cbc29eed83493"}
Jul 13 07:42:02.731906 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:02.731728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:02.750248 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:02.750197    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47" podStartSLOduration=2.248052053 podStartE2EDuration="2.750180203s" totalImagesPullingTime="502.12815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:42:02.748274377 +0000 UTC m=+1788.455151682" watchObservedRunningTime="2026-07-13 07:42:02.750180203 +0000 UTC m=+1788.457057504"
Jul 13 07:42:08.742010 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:08.741935    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:42:08.839514 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:08.839481    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"]
Jul 13 07:42:08.844042 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:08.844018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:08.847368 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:08.847343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-6d9a89-serving-cert\""
Jul 13 07:42:08.855409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:08.855383    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"]
Jul 13 07:42:08.939752 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:08.939720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1dbd41-ea97-4352-920c-80f3c851142c-maas-api-tls\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:08.939927 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:08.939813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1dbd41-ea97-4352-920c-80f3c851142c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:08.939927 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:08.939846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s59wh\" (UniqueName: \"kubernetes.io/projected/9a1dbd41-ea97-4352-920c-80f3c851142c-kube-api-access-s59wh\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.040822 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.040789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1dbd41-ea97-4352-920c-80f3c851142c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.041006 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.040831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s59wh\" (UniqueName: \"kubernetes.io/projected/9a1dbd41-ea97-4352-920c-80f3c851142c-kube-api-access-s59wh\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.041006 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.040882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1dbd41-ea97-4352-920c-80f3c851142c-maas-api-tls\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.041431 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.041406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1dbd41-ea97-4352-920c-80f3c851142c-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.043254 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.043232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1dbd41-ea97-4352-920c-80f3c851142c-maas-api-tls\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.054954 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.054929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s59wh\" (UniqueName: \"kubernetes.io/projected/9a1dbd41-ea97-4352-920c-80f3c851142c-kube-api-access-s59wh\") pod \"maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") " pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.155007 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.154975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.291666 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.291643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"]
Jul 13 07:42:09.293627 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:42:09.293597    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1dbd41_ea97_4352_920c_80f3c851142c.slice/crio-61faad6ef0670abd266652dc9ccf61f761591cd322a2e803edaf48efc9f4807c WatchSource:0}: Error finding container 61faad6ef0670abd266652dc9ccf61f761591cd322a2e803edaf48efc9f4807c: Status 404 returned error can't find the container with id 61faad6ef0670abd266652dc9ccf61f761591cd322a2e803edaf48efc9f4807c
Jul 13 07:42:09.768212 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.768179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69" event={"ID":"9a1dbd41-ea97-4352-920c-80f3c851142c","Type":"ContainerStarted","Data":"48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7"}
Jul 13 07:42:09.768627 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.768241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69" event={"ID":"9a1dbd41-ea97-4352-920c-80f3c851142c","Type":"ContainerStarted","Data":"61faad6ef0670abd266652dc9ccf61f761591cd322a2e803edaf48efc9f4807c"}
Jul 13 07:42:09.768627 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.768268    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:09.785399 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:09.785327    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69" podStartSLOduration=1.443157024 podStartE2EDuration="1.785309376s" totalImagesPullingTime="342.152352ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:42:09.783273182 +0000 UTC m=+1795.490150519" watchObservedRunningTime="2026-07-13 07:42:09.785309376 +0000 UTC m=+1795.492186677"
Jul 13 07:42:15.779075 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:15.779038    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:42:42.332198 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.332147    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"]
Jul 13 07:42:42.338469 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.338429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.343021 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.342995    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6d9a89\"/\"default-dockercfg-jjznq\""
Jul 13 07:42:42.343163 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.343021    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6d9a89\"/\"kube-root-ca.crt\""
Jul 13 07:42:42.343163 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.343133    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6d9a89\"/\"test-model-6d9a89-kserve-self-signed-certs\""
Jul 13 07:42:42.343291 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.343039    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6d9a89\"/\"openshift-service-ca.crt\""
Jul 13 07:42:42.344590 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.344570    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"]
Jul 13 07:42:42.471222 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.471182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-model-cache\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.471222 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.471221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a87222e-f08f-4535-9167-cff8a8648f81-tls-certs\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.471518 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.471295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-dshm\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.471518 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.471320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpmpx\" (UniqueName: \"kubernetes.io/projected/2a87222e-f08f-4535-9167-cff8a8648f81-kube-api-access-dpmpx\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.471518 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.471379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-tmp-dir\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.471518 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.471459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-home\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572044 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-tmp-dir\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572044 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-home\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572283 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-model-cache\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572283 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a87222e-f08f-4535-9167-cff8a8648f81-tls-certs\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572283 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-dshm\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572283 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpmpx\" (UniqueName: \"kubernetes.io/projected/2a87222e-f08f-4535-9167-cff8a8648f81-kube-api-access-dpmpx\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-model-cache\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572534 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-tmp-dir\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.572626 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.572542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-home\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.574488 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.574466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-dshm\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.574680 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.574661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a87222e-f08f-4535-9167-cff8a8648f81-tls-certs\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.589929 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.589864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpmpx\" (UniqueName: \"kubernetes.io/projected/2a87222e-f08f-4535-9167-cff8a8648f81-kube-api-access-dpmpx\") pod \"test-model-6d9a89-kserve-78484f7d7f-sgcwp\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") " pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.649115 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.649076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:42.791412 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.791382    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"]
Jul 13 07:42:42.793373 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:42:42.793350    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a87222e_f08f_4535_9167_cff8a8648f81.slice/crio-c3783b8f983fcd27b56f3e4731f7052f69716a033320da7f4814fb158e62f616 WatchSource:0}: Error finding container c3783b8f983fcd27b56f3e4731f7052f69716a033320da7f4814fb158e62f616: Status 404 returned error can't find the container with id c3783b8f983fcd27b56f3e4731f7052f69716a033320da7f4814fb158e62f616
Jul 13 07:42:42.939258 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.939224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp" event={"ID":"2a87222e-f08f-4535-9167-cff8a8648f81","Type":"ContainerStarted","Data":"01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b"}
Jul 13 07:42:42.939258 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.939263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp" event={"ID":"2a87222e-f08f-4535-9167-cff8a8648f81","Type":"ContainerStarted","Data":"c3783b8f983fcd27b56f3e4731f7052f69716a033320da7f4814fb158e62f616"}
Jul 13 07:42:42.961655 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:42.961603    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp" podStartSLOduration=0.961588581 podStartE2EDuration="961.588581ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:42:42.959196543 +0000 UTC m=+1828.666073859" watchObservedRunningTime="2026-07-13 07:42:42.961588581 +0000 UTC m=+1828.668465883"
Jul 13 07:42:52.649626 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:52.649582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:52.650092 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:52.649639    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:52.662137 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:52.662106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:42:52.998630 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:42:52.998537    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:43:02.310055 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:02.310021    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"]
Jul 13 07:43:03.168803 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.168768    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"]
Jul 13 07:43:03.169000 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.168976    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47" podUID="6bdd6fa1-f057-4b00-9ef1-b7efa483450f" containerName="maas-api" containerID="cri-o://3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb" gracePeriod=30
Jul 13 07:43:03.414668 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.414637    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:43:03.466698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.466606    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls\") pod \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") "
Jul 13 07:43:03.466870 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.466717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-openshift-service-ca\") pod \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") "
Jul 13 07:43:03.466870 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.466764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9jrh\" (UniqueName: \"kubernetes.io/projected/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-kube-api-access-l9jrh\") pod \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\" (UID: \"6bdd6fa1-f057-4b00-9ef1-b7efa483450f\") "
Jul 13 07:43:03.467140 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.467110    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6bdd6fa1-f057-4b00-9ef1-b7efa483450f" (UID: "6bdd6fa1-f057-4b00-9ef1-b7efa483450f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:43:03.468770 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.468738    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6bdd6fa1-f057-4b00-9ef1-b7efa483450f" (UID: "6bdd6fa1-f057-4b00-9ef1-b7efa483450f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:43:03.468912 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.468885    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-kube-api-access-l9jrh" (OuterVolumeSpecName: "kube-api-access-l9jrh") pod "6bdd6fa1-f057-4b00-9ef1-b7efa483450f" (UID: "6bdd6fa1-f057-4b00-9ef1-b7efa483450f"). InnerVolumeSpecName "kube-api-access-l9jrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:43:03.568250 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.568214    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:03.568250 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.568243    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9jrh\" (UniqueName: \"kubernetes.io/projected/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-kube-api-access-l9jrh\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:03.568250 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:03.568255    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6bdd6fa1-f057-4b00-9ef1-b7efa483450f-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:04.042191 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.042157    2565 generic.go:356] "Generic (PLEG): container finished" podID="6bdd6fa1-f057-4b00-9ef1-b7efa483450f" containerID="3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb" exitCode=0
Jul 13 07:43:04.042371 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.042211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47" event={"ID":"6bdd6fa1-f057-4b00-9ef1-b7efa483450f","Type":"ContainerDied","Data":"3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb"}
Jul 13 07:43:04.042371 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.042213    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"
Jul 13 07:43:04.042371 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.042262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47" event={"ID":"6bdd6fa1-f057-4b00-9ef1-b7efa483450f","Type":"ContainerDied","Data":"f90926c7a235f60ff2b40728a12242725d4347d7eb057425379cbc29eed83493"}
Jul 13 07:43:04.042371 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.042286    2565 scope.go:117] "RemoveContainer" containerID="3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb"
Jul 13 07:43:04.052669 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.052647    2565 scope.go:117] "RemoveContainer" containerID="3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb"
Jul 13 07:43:04.052948 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:43:04.052927    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb\": container with ID starting with 3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb not found: ID does not exist" containerID="3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb"
Jul 13 07:43:04.053011 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.052955    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb"} err="failed to get container status \"3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb\": rpc error: code = NotFound desc = could not find container \"3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb\": container with ID starting with 3b70414fcc5359702b0b8f99dab8dbfd2d701e6521b7039126a047ee50982feb not found: ID does not exist"
Jul 13 07:43:04.071748 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.071712    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"]
Jul 13 07:43:04.076025 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.076001    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-7d46e0-548d4f859d-bwp47"]
Jul 13 07:43:04.921548 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:04.921512    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bdd6fa1-f057-4b00-9ef1-b7efa483450f" path="/var/lib/kubelet/pods/6bdd6fa1-f057-4b00-9ef1-b7efa483450f/volumes"
Jul 13 07:43:17.332506 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.332466    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp" podUID="2a87222e-f08f-4535-9167-cff8a8648f81" containerName="main" containerID="cri-o://01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b" gracePeriod=45
Jul 13 07:43:17.583762 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.583690    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:43:17.697043 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697012    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-model-cache\") pod \"2a87222e-f08f-4535-9167-cff8a8648f81\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") "
Jul 13 07:43:17.697207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697073    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-tmp-dir\") pod \"2a87222e-f08f-4535-9167-cff8a8648f81\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") "
Jul 13 07:43:17.697207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697118    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpmpx\" (UniqueName: \"kubernetes.io/projected/2a87222e-f08f-4535-9167-cff8a8648f81-kube-api-access-dpmpx\") pod \"2a87222e-f08f-4535-9167-cff8a8648f81\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") "
Jul 13 07:43:17.697207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-dshm\") pod \"2a87222e-f08f-4535-9167-cff8a8648f81\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") "
Jul 13 07:43:17.697207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a87222e-f08f-4535-9167-cff8a8648f81-tls-certs\") pod \"2a87222e-f08f-4535-9167-cff8a8648f81\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") "
Jul 13 07:43:17.697207 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-home\") pod \"2a87222e-f08f-4535-9167-cff8a8648f81\" (UID: \"2a87222e-f08f-4535-9167-cff8a8648f81\") "
Jul 13 07:43:17.697496 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697344    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a87222e-f08f-4535-9167-cff8a8648f81" (UID: "2a87222e-f08f-4535-9167-cff8a8648f81"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:43:17.697496 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697376    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a87222e-f08f-4535-9167-cff8a8648f81" (UID: "2a87222e-f08f-4535-9167-cff8a8648f81"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:43:17.697613 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697505    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-model-cache\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:17.697613 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697522    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-tmp-dir\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:17.697613 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.697574    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-home" (OuterVolumeSpecName: "home") pod "2a87222e-f08f-4535-9167-cff8a8648f81" (UID: "2a87222e-f08f-4535-9167-cff8a8648f81"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:43:17.699369 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.699342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a87222e-f08f-4535-9167-cff8a8648f81-kube-api-access-dpmpx" (OuterVolumeSpecName: "kube-api-access-dpmpx") pod "2a87222e-f08f-4535-9167-cff8a8648f81" (UID: "2a87222e-f08f-4535-9167-cff8a8648f81"). InnerVolumeSpecName "kube-api-access-dpmpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:43:17.699369 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.699363    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a87222e-f08f-4535-9167-cff8a8648f81-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a87222e-f08f-4535-9167-cff8a8648f81" (UID: "2a87222e-f08f-4535-9167-cff8a8648f81"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:43:17.699577 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.699366    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-dshm" (OuterVolumeSpecName: "dshm") pod "2a87222e-f08f-4535-9167-cff8a8648f81" (UID: "2a87222e-f08f-4535-9167-cff8a8648f81"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:43:17.798172 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.798140    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpmpx\" (UniqueName: \"kubernetes.io/projected/2a87222e-f08f-4535-9167-cff8a8648f81-kube-api-access-dpmpx\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:17.798172 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.798167    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-dshm\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:17.798172 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.798177    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a87222e-f08f-4535-9167-cff8a8648f81-tls-certs\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:17.798377 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:17.798185    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a87222e-f08f-4535-9167-cff8a8648f81-home\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:18.122907 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.122876    2565 generic.go:356] "Generic (PLEG): container finished" podID="2a87222e-f08f-4535-9167-cff8a8648f81" containerID="01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b" exitCode=0
Jul 13 07:43:18.123105 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.122923    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"
Jul 13 07:43:18.123105 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.122927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp" event={"ID":"2a87222e-f08f-4535-9167-cff8a8648f81","Type":"ContainerDied","Data":"01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b"}
Jul 13 07:43:18.123105 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.123044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp" event={"ID":"2a87222e-f08f-4535-9167-cff8a8648f81","Type":"ContainerDied","Data":"c3783b8f983fcd27b56f3e4731f7052f69716a033320da7f4814fb158e62f616"}
Jul 13 07:43:18.123105 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.123064    2565 scope.go:117] "RemoveContainer" containerID="01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b"
Jul 13 07:43:18.132562 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.132544    2565 scope.go:117] "RemoveContainer" containerID="01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b"
Jul 13 07:43:18.132812 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:43:18.132794    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b\": container with ID starting with 01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b not found: ID does not exist" containerID="01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b"
Jul 13 07:43:18.132867 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.132820    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b"} err="failed to get container status \"01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b\": rpc error: code = NotFound desc = could not find container \"01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b\": container with ID starting with 01cf20a2749e1646a0d084a7c81d6593e52045c4bed7a3bb8cfc1443144f924b not found: ID does not exist"
Jul 13 07:43:18.145182 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.145157    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"]
Jul 13 07:43:18.152594 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.152573    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6d9a89/test-model-6d9a89-kserve-78484f7d7f-sgcwp"]
Jul 13 07:43:18.921104 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:18.921068    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a87222e-f08f-4535-9167-cff8a8648f81" path="/var/lib/kubelet/pods/2a87222e-f08f-4535-9167-cff8a8648f81/volumes"
Jul 13 07:43:46.212888 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.212805    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"]
Jul 13 07:43:46.213410 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.213011    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69" podUID="9a1dbd41-ea97-4352-920c-80f3c851142c" containerName="maas-api" containerID="cri-o://48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7" gracePeriod=30
Jul 13 07:43:46.464934 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.464867    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:43:46.577751 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.577713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1dbd41-ea97-4352-920c-80f3c851142c-openshift-service-ca\") pod \"9a1dbd41-ea97-4352-920c-80f3c851142c\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") "
Jul 13 07:43:46.577953 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.577776    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s59wh\" (UniqueName: \"kubernetes.io/projected/9a1dbd41-ea97-4352-920c-80f3c851142c-kube-api-access-s59wh\") pod \"9a1dbd41-ea97-4352-920c-80f3c851142c\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") "
Jul 13 07:43:46.577953 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.577822    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1dbd41-ea97-4352-920c-80f3c851142c-maas-api-tls\") pod \"9a1dbd41-ea97-4352-920c-80f3c851142c\" (UID: \"9a1dbd41-ea97-4352-920c-80f3c851142c\") "
Jul 13 07:43:46.578163 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.578138    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a1dbd41-ea97-4352-920c-80f3c851142c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a1dbd41-ea97-4352-920c-80f3c851142c" (UID: "9a1dbd41-ea97-4352-920c-80f3c851142c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:43:46.579964 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.579936    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1dbd41-ea97-4352-920c-80f3c851142c-kube-api-access-s59wh" (OuterVolumeSpecName: "kube-api-access-s59wh") pod "9a1dbd41-ea97-4352-920c-80f3c851142c" (UID: "9a1dbd41-ea97-4352-920c-80f3c851142c"). InnerVolumeSpecName "kube-api-access-s59wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:43:46.580070 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.579973    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a1dbd41-ea97-4352-920c-80f3c851142c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a1dbd41-ea97-4352-920c-80f3c851142c" (UID: "9a1dbd41-ea97-4352-920c-80f3c851142c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:43:46.679232 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.679197    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a1dbd41-ea97-4352-920c-80f3c851142c-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:46.679232 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.679230    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a1dbd41-ea97-4352-920c-80f3c851142c-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:46.679232 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:46.679241    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s59wh\" (UniqueName: \"kubernetes.io/projected/9a1dbd41-ea97-4352-920c-80f3c851142c-kube-api-access-s59wh\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:43:47.265965 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.265868    2565 generic.go:356] "Generic (PLEG): container finished" podID="9a1dbd41-ea97-4352-920c-80f3c851142c" containerID="48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7" exitCode=0
Jul 13 07:43:47.265965 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.265938    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"
Jul 13 07:43:47.265965 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.265953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69" event={"ID":"9a1dbd41-ea97-4352-920c-80f3c851142c","Type":"ContainerDied","Data":"48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7"}
Jul 13 07:43:47.266562 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.266009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69" event={"ID":"9a1dbd41-ea97-4352-920c-80f3c851142c","Type":"ContainerDied","Data":"61faad6ef0670abd266652dc9ccf61f761591cd322a2e803edaf48efc9f4807c"}
Jul 13 07:43:47.266562 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.266032    2565 scope.go:117] "RemoveContainer" containerID="48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7"
Jul 13 07:43:47.274610 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.274589    2565 scope.go:117] "RemoveContainer" containerID="48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7"
Jul 13 07:43:47.274895 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:43:47.274877    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7\": container with ID starting with 48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7 not found: ID does not exist" containerID="48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7"
Jul 13 07:43:47.274934 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.274904    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7"} err="failed to get container status \"48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7\": rpc error: code = NotFound desc = could not find container \"48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7\": container with ID starting with 48a477ed03af18b5855c26bba8b6fb8ea83ed048660329446ba01498df9a4cc7 not found: ID does not exist"
Jul 13 07:43:47.283819 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.283792    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"]
Jul 13 07:43:47.287415 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:47.287393    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-6d9a89-8f656c98-m5z69"]
Jul 13 07:43:48.921881 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:48.921844    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a1dbd41-ea97-4352-920c-80f3c851142c" path="/var/lib/kubelet/pods/9a1dbd41-ea97-4352-920c-80f3c851142c/volumes"
Jul 13 07:43:53.003464 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.003416    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"]
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.003876    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1dbd41-ea97-4352-920c-80f3c851142c" containerName="maas-api"
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.003889    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1dbd41-ea97-4352-920c-80f3c851142c" containerName="maas-api"
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.003907    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bdd6fa1-f057-4b00-9ef1-b7efa483450f" containerName="maas-api"
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.003912    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bdd6fa1-f057-4b00-9ef1-b7efa483450f" containerName="maas-api"
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.003926    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a87222e-f08f-4535-9167-cff8a8648f81" containerName="main"
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.003931    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a87222e-f08f-4535-9167-cff8a8648f81" containerName="main"
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.003998    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a87222e-f08f-4535-9167-cff8a8648f81" containerName="main"
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.004007    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bdd6fa1-f057-4b00-9ef1-b7efa483450f" containerName="maas-api"
Jul 13 07:43:53.004237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.004013    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a1dbd41-ea97-4352-920c-80f3c851142c" containerName="maas-api"
Jul 13 07:43:53.007545 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.007524    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.010144 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.010122    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-88ad28-openshift-default-dockercfg-g24nx\""
Jul 13 07:43:53.010349 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.010335    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 07:43:53.021108 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.021083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"]
Jul 13 07:43:53.143553 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8544v\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-kube-api-access-8544v\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.143553 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-certs\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.143766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-istio-token\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.143766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-envoy\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.143766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-data\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.143766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691dd4bb-e991-47a8-83dc-9d452433528b-istio-podinfo\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.143766 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691dd4bb-e991-47a8-83dc-9d452433528b-istiod-ca-cert\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.143946 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-socket\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.143946 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.143789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-credential-socket\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.244982 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.244951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-socket\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.244982 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.244984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-credential-socket\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245191 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8544v\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-kube-api-access-8544v\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245191 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-certs\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245191 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-istio-token\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245191 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-envoy\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245403 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-data\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245403 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691dd4bb-e991-47a8-83dc-9d452433528b-istio-podinfo\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245403 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691dd4bb-e991-47a8-83dc-9d452433528b-istiod-ca-cert\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245591 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-socket\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245591 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-credential-socket\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245662 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245615    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-certs\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245662 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-data\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.245903 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.245884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691dd4bb-e991-47a8-83dc-9d452433528b-istiod-ca-cert\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.247655 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.247605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-envoy\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.248088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.248065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691dd4bb-e991-47a8-83dc-9d452433528b-istio-podinfo\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.254008 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.253944    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8544v\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-kube-api-access-8544v\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.254371 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.254352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-istio-token\") pod \"e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") " pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.318612 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.318573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:53.467233 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:53.467203    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"]
Jul 13 07:43:53.470003 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:43:53.469965    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691dd4bb_e991_47a8_83dc_9d452433528b.slice/crio-79ef8186c674b66c5411c07ecde0b81afd337cffa089e67a289d6ac5f3791da0 WatchSource:0}: Error finding container 79ef8186c674b66c5411c07ecde0b81afd337cffa089e67a289d6ac5f3791da0: Status 404 returned error can't find the container with id 79ef8186c674b66c5411c07ecde0b81afd337cffa089e67a289d6ac5f3791da0
Jul 13 07:43:54.305085 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:54.304997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" event={"ID":"691dd4bb-e991-47a8-83dc-9d452433528b","Type":"ContainerStarted","Data":"79ef8186c674b66c5411c07ecde0b81afd337cffa089e67a289d6ac5f3791da0"}
Jul 13 07:43:55.983855 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:55.983815    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:43:55.984152 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:55.983896    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:43:55.984152 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:55.983930    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:43:56.319106 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:56.319073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" event={"ID":"691dd4bb-e991-47a8-83dc-9d452433528b","Type":"ContainerStarted","Data":"360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7"}
Jul 13 07:43:56.340558 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:56.340499    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" podStartSLOduration=1.8289187949999999 podStartE2EDuration="4.340477437s" totalImagesPullingTime="2.511558642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:43:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:43:56.339086666 +0000 UTC m=+1902.045963990" watchObservedRunningTime="2026-07-13 07:43:56.340477437 +0000 UTC m=+1902.047354740"
Jul 13 07:43:57.319048 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:57.319004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:57.324582 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:57.324554    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:58.303717 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.303682    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"]
Jul 13 07:43:58.307474 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.307426    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.311166 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.311148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-88ad28-serving-cert\""
Jul 13 07:43:58.325602 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.325564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"]
Jul 13 07:43:58.330182 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.330140    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:58.331251 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.331228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:43:58.396528 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.396489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/459986eb-e7a9-4812-9ef8-a1be97e604cb-maas-api-tls\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.396717 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.396683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/459986eb-e7a9-4812-9ef8-a1be97e604cb-openshift-service-ca\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.396784 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.396718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67fvv\" (UniqueName: \"kubernetes.io/projected/459986eb-e7a9-4812-9ef8-a1be97e604cb-kube-api-access-67fvv\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.498294 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.498251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/459986eb-e7a9-4812-9ef8-a1be97e604cb-openshift-service-ca\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.498294 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.498294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67fvv\" (UniqueName: \"kubernetes.io/projected/459986eb-e7a9-4812-9ef8-a1be97e604cb-kube-api-access-67fvv\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.498609 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.498351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/459986eb-e7a9-4812-9ef8-a1be97e604cb-maas-api-tls\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.499045 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.499020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/459986eb-e7a9-4812-9ef8-a1be97e604cb-openshift-service-ca\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.500716 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.500695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/459986eb-e7a9-4812-9ef8-a1be97e604cb-maas-api-tls\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.513966 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.513935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67fvv\" (UniqueName: \"kubernetes.io/projected/459986eb-e7a9-4812-9ef8-a1be97e604cb-kube-api-access-67fvv\") pod \"maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") " pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.618283 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.618190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:58.764043 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:58.764018    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"]
Jul 13 07:43:58.766172 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:43:58.766142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod459986eb_e7a9_4812_9ef8_a1be97e604cb.slice/crio-b86b65d073c0e78f7e7df7f41cc555839706641917c5c0c6adcf7e50116ae5b3 WatchSource:0}: Error finding container b86b65d073c0e78f7e7df7f41cc555839706641917c5c0c6adcf7e50116ae5b3: Status 404 returned error can't find the container with id b86b65d073c0e78f7e7df7f41cc555839706641917c5c0c6adcf7e50116ae5b3
Jul 13 07:43:59.336457 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:59.336399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd" event={"ID":"459986eb-e7a9-4812-9ef8-a1be97e604cb","Type":"ContainerStarted","Data":"9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388"}
Jul 13 07:43:59.336902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:59.336638    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:43:59.336902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:59.336684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd" event={"ID":"459986eb-e7a9-4812-9ef8-a1be97e604cb","Type":"ContainerStarted","Data":"b86b65d073c0e78f7e7df7f41cc555839706641917c5c0c6adcf7e50116ae5b3"}
Jul 13 07:43:59.355560 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:43:59.355502    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd" podStartSLOduration=0.972876637 podStartE2EDuration="1.355486905s" totalImagesPullingTime="382.610268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:43:59.35334168 +0000 UTC m=+1905.060219005" watchObservedRunningTime="2026-07-13 07:43:59.355486905 +0000 UTC m=+1905.062364208"
Jul 13 07:44:05.347416 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:05.347376    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:44:06.637778 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.637735    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"]
Jul 13 07:44:06.641789 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.641767    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.645116 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.645079    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-464dbd-serving-cert\""
Jul 13 07:44:06.656193 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.656168    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"]
Jul 13 07:44:06.791049 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.791011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aea086-0642-4d54-87e2-ad4f15ff1266-maas-api-tls\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.791243 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.791074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aea086-0642-4d54-87e2-ad4f15ff1266-openshift-service-ca\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.791243 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.791210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whzwh\" (UniqueName: \"kubernetes.io/projected/93aea086-0642-4d54-87e2-ad4f15ff1266-kube-api-access-whzwh\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.892509 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.892400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aea086-0642-4d54-87e2-ad4f15ff1266-maas-api-tls\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.892509 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.892496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aea086-0642-4d54-87e2-ad4f15ff1266-openshift-service-ca\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.892738 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.892548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whzwh\" (UniqueName: \"kubernetes.io/projected/93aea086-0642-4d54-87e2-ad4f15ff1266-kube-api-access-whzwh\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.893361 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.893335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aea086-0642-4d54-87e2-ad4f15ff1266-openshift-service-ca\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.894842 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.894820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aea086-0642-4d54-87e2-ad4f15ff1266-maas-api-tls\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.901266 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.901235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whzwh\" (UniqueName: \"kubernetes.io/projected/93aea086-0642-4d54-87e2-ad4f15ff1266-kube-api-access-whzwh\") pod \"maas-api-e2e-api-b-464dbd-6c946df48-zw4lq\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") " pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:06.954411 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:06.954370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:07.119557 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:07.119527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"]
Jul 13 07:44:07.122059 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:44:07.122030    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93aea086_0642_4d54_87e2_ad4f15ff1266.slice/crio-fbe6de81571d79d2c51b3d272d73456dd2dffaa108dc8a0b374c3998d382b8fd WatchSource:0}: Error finding container fbe6de81571d79d2c51b3d272d73456dd2dffaa108dc8a0b374c3998d382b8fd: Status 404 returned error can't find the container with id fbe6de81571d79d2c51b3d272d73456dd2dffaa108dc8a0b374c3998d382b8fd
Jul 13 07:44:07.387391 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:07.387351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq" event={"ID":"93aea086-0642-4d54-87e2-ad4f15ff1266","Type":"ContainerStarted","Data":"fbe6de81571d79d2c51b3d272d73456dd2dffaa108dc8a0b374c3998d382b8fd"}
Jul 13 07:44:08.395581 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:08.395543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq" event={"ID":"93aea086-0642-4d54-87e2-ad4f15ff1266","Type":"ContainerStarted","Data":"dcf6ba9f033e1ea654afdda1d17b3640f1c17fa8f31a787f5eed7534890c6172"}
Jul 13 07:44:08.396062 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:08.395721    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:08.420829 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:08.420774    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq" podStartSLOduration=2.090056103 podStartE2EDuration="2.420756401s" totalImagesPullingTime="330.700298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:44:08.418200545 +0000 UTC m=+1914.125077900" watchObservedRunningTime="2026-07-13 07:44:08.420756401 +0000 UTC m=+1914.127633704"
Jul 13 07:44:10.408403 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:10.408367    2565 generic.go:356] "Generic (PLEG): container finished" podID="691dd4bb-e991-47a8-83dc-9d452433528b" containerID="360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7" exitCode=0
Jul 13 07:44:10.409063 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:10.408420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" event={"ID":"691dd4bb-e991-47a8-83dc-9d452433528b","Type":"ContainerDied","Data":"360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7"}
Jul 13 07:44:10.409063 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:10.408859    2565 scope.go:117] "RemoveContainer" containerID="360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7"
Jul 13 07:44:10.411091 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:10.411059    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:10.411196 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:10.411134    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:10.411196 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:10.411172    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:11.415750 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:11.415714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" event={"ID":"691dd4bb-e991-47a8-83dc-9d452433528b","Type":"ContainerStarted","Data":"37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f"}
Jul 13 07:44:12.318880 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:12.318846    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:44:12.319821 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:12.319793    2565 patch_prober.go:28] interesting pod/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 13 07:44:12.319914 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:12.319849    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 13 07:44:13.319880 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:13.319844    2565 patch_prober.go:28] interesting pod/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 13 07:44:13.320383 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:13.319919    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 13 07:44:13.330541 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:13.330508    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:44:14.319260 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:14.319220    2565 patch_prober.go:28] interesting pod/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 13 07:44:14.319496 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:14.319294    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 13 07:44:14.407118 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:14.407090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:15.323713 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:15.323680    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:44:15.324722 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:15.324702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:44:19.568379 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.568331    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"]
Jul 13 07:44:19.568930 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.568607    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd" podUID="459986eb-e7a9-4812-9ef8-a1be97e604cb" containerName="maas-api" containerID="cri-o://9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388" gracePeriod=30
Jul 13 07:44:19.830560 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.830484    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:44:19.942062 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.942027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/459986eb-e7a9-4812-9ef8-a1be97e604cb-maas-api-tls\") pod \"459986eb-e7a9-4812-9ef8-a1be97e604cb\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") "
Jul 13 07:44:19.942062 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.942067    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/459986eb-e7a9-4812-9ef8-a1be97e604cb-openshift-service-ca\") pod \"459986eb-e7a9-4812-9ef8-a1be97e604cb\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") "
Jul 13 07:44:19.942392 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.942092    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67fvv\" (UniqueName: \"kubernetes.io/projected/459986eb-e7a9-4812-9ef8-a1be97e604cb-kube-api-access-67fvv\") pod \"459986eb-e7a9-4812-9ef8-a1be97e604cb\" (UID: \"459986eb-e7a9-4812-9ef8-a1be97e604cb\") "
Jul 13 07:44:19.942503 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.942480    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/459986eb-e7a9-4812-9ef8-a1be97e604cb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "459986eb-e7a9-4812-9ef8-a1be97e604cb" (UID: "459986eb-e7a9-4812-9ef8-a1be97e604cb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:44:19.944224 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.944196    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/459986eb-e7a9-4812-9ef8-a1be97e604cb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "459986eb-e7a9-4812-9ef8-a1be97e604cb" (UID: "459986eb-e7a9-4812-9ef8-a1be97e604cb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:44:19.944325 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:19.944219    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459986eb-e7a9-4812-9ef8-a1be97e604cb-kube-api-access-67fvv" (OuterVolumeSpecName: "kube-api-access-67fvv") pod "459986eb-e7a9-4812-9ef8-a1be97e604cb" (UID: "459986eb-e7a9-4812-9ef8-a1be97e604cb"). InnerVolumeSpecName "kube-api-access-67fvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:44:20.043920 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.043881    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/459986eb-e7a9-4812-9ef8-a1be97e604cb-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:20.043920 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.043916    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/459986eb-e7a9-4812-9ef8-a1be97e604cb-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:20.043920 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.043930    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67fvv\" (UniqueName: \"kubernetes.io/projected/459986eb-e7a9-4812-9ef8-a1be97e604cb-kube-api-access-67fvv\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:20.464873 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.464833    2565 generic.go:356] "Generic (PLEG): container finished" podID="459986eb-e7a9-4812-9ef8-a1be97e604cb" containerID="9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388" exitCode=0
Jul 13 07:44:20.465059 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.464886    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"
Jul 13 07:44:20.465059 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.464926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd" event={"ID":"459986eb-e7a9-4812-9ef8-a1be97e604cb","Type":"ContainerDied","Data":"9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388"}
Jul 13 07:44:20.465059 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.464981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd" event={"ID":"459986eb-e7a9-4812-9ef8-a1be97e604cb","Type":"ContainerDied","Data":"b86b65d073c0e78f7e7df7f41cc555839706641917c5c0c6adcf7e50116ae5b3"}
Jul 13 07:44:20.465059 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.465005    2565 scope.go:117] "RemoveContainer" containerID="9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388"
Jul 13 07:44:20.474776 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.474756    2565 scope.go:117] "RemoveContainer" containerID="9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388"
Jul 13 07:44:20.475088 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:44:20.475066    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388\": container with ID starting with 9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388 not found: ID does not exist" containerID="9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388"
Jul 13 07:44:20.475134 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.475098    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388"} err="failed to get container status \"9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388\": rpc error: code = NotFound desc = could not find container \"9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388\": container with ID starting with 9074a5c3911683888cae16cce3e8c371b42f6bc3b9481dc42a7f8312269fb388 not found: ID does not exist"
Jul 13 07:44:20.488214 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.488179    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"]
Jul 13 07:44:20.492668 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.492637    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-88ad28-5846d8fdd8-q67vd"]
Jul 13 07:44:20.922057 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:20.922022    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="459986eb-e7a9-4812-9ef8-a1be97e604cb" path="/var/lib/kubelet/pods/459986eb-e7a9-4812-9ef8-a1be97e604cb/volumes"
Jul 13 07:44:25.220209 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:25.220168    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"]
Jul 13 07:44:25.221159 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:25.221113    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy" containerID="cri-o://37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f" gracePeriod=30
Jul 13 07:44:26.297503 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.297472    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"]
Jul 13 07:44:26.297993 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.297717    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq" podUID="93aea086-0642-4d54-87e2-ad4f15ff1266" containerName="maas-api" containerID="cri-o://dcf6ba9f033e1ea654afdda1d17b3640f1c17fa8f31a787f5eed7534890c6172" gracePeriod=30
Jul 13 07:44:26.501993 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.501953    2565 generic.go:356] "Generic (PLEG): container finished" podID="93aea086-0642-4d54-87e2-ad4f15ff1266" containerID="dcf6ba9f033e1ea654afdda1d17b3640f1c17fa8f31a787f5eed7534890c6172" exitCode=0
Jul 13 07:44:26.501993 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.501991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq" event={"ID":"93aea086-0642-4d54-87e2-ad4f15ff1266","Type":"ContainerDied","Data":"dcf6ba9f033e1ea654afdda1d17b3640f1c17fa8f31a787f5eed7534890c6172"}
Jul 13 07:44:26.550282 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.550223    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:26.613952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.613919    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aea086-0642-4d54-87e2-ad4f15ff1266-maas-api-tls\") pod \"93aea086-0642-4d54-87e2-ad4f15ff1266\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") "
Jul 13 07:44:26.614124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.613966    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whzwh\" (UniqueName: \"kubernetes.io/projected/93aea086-0642-4d54-87e2-ad4f15ff1266-kube-api-access-whzwh\") pod \"93aea086-0642-4d54-87e2-ad4f15ff1266\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") "
Jul 13 07:44:26.614124 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.614006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aea086-0642-4d54-87e2-ad4f15ff1266-openshift-service-ca\") pod \"93aea086-0642-4d54-87e2-ad4f15ff1266\" (UID: \"93aea086-0642-4d54-87e2-ad4f15ff1266\") "
Jul 13 07:44:26.614427 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.614401    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93aea086-0642-4d54-87e2-ad4f15ff1266-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93aea086-0642-4d54-87e2-ad4f15ff1266" (UID: "93aea086-0642-4d54-87e2-ad4f15ff1266"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:44:26.616057 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.616033    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93aea086-0642-4d54-87e2-ad4f15ff1266-kube-api-access-whzwh" (OuterVolumeSpecName: "kube-api-access-whzwh") pod "93aea086-0642-4d54-87e2-ad4f15ff1266" (UID: "93aea086-0642-4d54-87e2-ad4f15ff1266"). InnerVolumeSpecName "kube-api-access-whzwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:44:26.616057 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.616047    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93aea086-0642-4d54-87e2-ad4f15ff1266-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93aea086-0642-4d54-87e2-ad4f15ff1266" (UID: "93aea086-0642-4d54-87e2-ad4f15ff1266"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:44:26.715386 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.715349    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93aea086-0642-4d54-87e2-ad4f15ff1266-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:26.715386 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.715381    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93aea086-0642-4d54-87e2-ad4f15ff1266-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:26.715386 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:26.715391    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whzwh\" (UniqueName: \"kubernetes.io/projected/93aea086-0642-4d54-87e2-ad4f15ff1266-kube-api-access-whzwh\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:27.508374 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:27.508347    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"
Jul 13 07:44:27.508816 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:27.508386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq" event={"ID":"93aea086-0642-4d54-87e2-ad4f15ff1266","Type":"ContainerDied","Data":"fbe6de81571d79d2c51b3d272d73456dd2dffaa108dc8a0b374c3998d382b8fd"}
Jul 13 07:44:27.508816 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:27.508470    2565 scope.go:117] "RemoveContainer" containerID="dcf6ba9f033e1ea654afdda1d17b3640f1c17fa8f31a787f5eed7534890c6172"
Jul 13 07:44:27.524858 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:27.524832    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"]
Jul 13 07:44:27.528040 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:27.528017    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-464dbd-6c946df48-zw4lq"]
Jul 13 07:44:28.921166 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:28.921131    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93aea086-0642-4d54-87e2-ad4f15ff1266" path="/var/lib/kubelet/pods/93aea086-0642-4d54-87e2-ad4f15ff1266/volumes"
Jul 13 07:44:30.326055 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.326016    2565 patch_prober.go:28] interesting pod/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 13 07:44:30.326407 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.326084    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 13 07:44:30.482572 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.482547    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:44:30.525600 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.525505    2565 generic.go:356] "Generic (PLEG): container finished" podID="691dd4bb-e991-47a8-83dc-9d452433528b" containerID="37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f" exitCode=0
Jul 13 07:44:30.525600 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.525554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" event={"ID":"691dd4bb-e991-47a8-83dc-9d452433528b","Type":"ContainerDied","Data":"37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f"}
Jul 13 07:44:30.525600 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.525572    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"
Jul 13 07:44:30.525875 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.525651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4" event={"ID":"691dd4bb-e991-47a8-83dc-9d452433528b","Type":"ContainerDied","Data":"79ef8186c674b66c5411c07ecde0b81afd337cffa089e67a289d6ac5f3791da0"}
Jul 13 07:44:30.525875 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.525686    2565 scope.go:117] "RemoveContainer" containerID="37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f"
Jul 13 07:44:30.534648 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.534630    2565 scope.go:117] "RemoveContainer" containerID="360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7"
Jul 13 07:44:30.542753 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.542736    2565 scope.go:117] "RemoveContainer" containerID="37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f"
Jul 13 07:44:30.542997 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:44:30.542974    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f\": container with ID starting with 37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f not found: ID does not exist" containerID="37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f"
Jul 13 07:44:30.543050 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.543007    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f"} err="failed to get container status \"37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f\": rpc error: code = NotFound desc = could not find container \"37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f\": container with ID starting with 37b9c8664b61353da82a054a98121772c6d566f8b48b345adbf7d2f8f59d6f8f not found: ID does not exist"
Jul 13 07:44:30.543050 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.543024    2565 scope.go:117] "RemoveContainer" containerID="360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7"
Jul 13 07:44:30.543283 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:44:30.543265    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7\": container with ID starting with 360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7 not found: ID does not exist" containerID="360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7"
Jul 13 07:44:30.543332 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.543289    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7"} err="failed to get container status \"360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7\": rpc error: code = NotFound desc = could not find container \"360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7\": container with ID starting with 360a8d6ec3c2a6dcbcb7a4fadc53038640989ddb46f354c625e54ed9d47c81d7 not found: ID does not exist"
Jul 13 07:44:30.551618 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691dd4bb-e991-47a8-83dc-9d452433528b-istio-podinfo\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.551706 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551631    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-data\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.551706 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551668    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-certs\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.551706 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551693    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-credential-socket\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.551808 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551719    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-socket\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.551808 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551782    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-istio-token\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.551902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551819    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-envoy\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.551902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551888    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691dd4bb-e991-47a8-83dc-9d452433528b-istiod-ca-cert\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.552007 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.551913    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8544v\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-kube-api-access-8544v\") pod \"691dd4bb-e991-47a8-83dc-9d452433528b\" (UID: \"691dd4bb-e991-47a8-83dc-9d452433528b\") "
Jul 13 07:44:30.552068 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.552000    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:44:30.552068 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.552022    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:44:30.552358 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.552328    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-certs\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.552462 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.552364    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-credential-socket\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.552462 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.552368    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:44:30.552620 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.552596    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-data" (OuterVolumeSpecName: "istio-data") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:44:30.552730 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.552607    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/691dd4bb-e991-47a8-83dc-9d452433528b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:44:30.554192 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.554170    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-kube-api-access-8544v" (OuterVolumeSpecName: "kube-api-access-8544v") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "kube-api-access-8544v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:44:30.554285 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.554195    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/691dd4bb-e991-47a8-83dc-9d452433528b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 07:44:30.554285 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.554201    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-istio-token" (OuterVolumeSpecName: "istio-token") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:44:30.554285 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.554247    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "691dd4bb-e991-47a8-83dc-9d452433528b" (UID: "691dd4bb-e991-47a8-83dc-9d452433528b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:44:30.653336 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.653302    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-istio-token\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.653336 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.653335    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-envoy\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.653575 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.653346    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691dd4bb-e991-47a8-83dc-9d452433528b-istiod-ca-cert\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.653575 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.653359    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8544v\" (UniqueName: \"kubernetes.io/projected/691dd4bb-e991-47a8-83dc-9d452433528b-kube-api-access-8544v\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.653575 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.653372    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691dd4bb-e991-47a8-83dc-9d452433528b-istio-podinfo\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.653575 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.653384    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-istio-data\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.653575 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.653396    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691dd4bb-e991-47a8-83dc-9d452433528b-workload-socket\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:44:30.850365 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.850326    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"]
Jul 13 07:44:30.855508 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.855481    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-88ad28-openshift-default-649668c68f-8kcj4"]
Jul 13 07:44:30.921417 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:30.921382    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" path="/var/lib/kubelet/pods/691dd4bb-e991-47a8-83dc-9d452433528b/volumes"
Jul 13 07:44:35.626521 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.626485    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"]
Jul 13 07:44:35.627057 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627034    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="459986eb-e7a9-4812-9ef8-a1be97e604cb" containerName="maas-api"
Jul 13 07:44:35.627231 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627081    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="459986eb-e7a9-4812-9ef8-a1be97e604cb" containerName="maas-api"
Jul 13 07:44:35.627231 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627102    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy"
Jul 13 07:44:35.627231 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627111    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy"
Jul 13 07:44:35.627231 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627172    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy"
Jul 13 07:44:35.627231 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627182    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy"
Jul 13 07:44:35.627231 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627191    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93aea086-0642-4d54-87e2-ad4f15ff1266" containerName="maas-api"
Jul 13 07:44:35.627231 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627199    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="93aea086-0642-4d54-87e2-ad4f15ff1266" containerName="maas-api"
Jul 13 07:44:35.627631 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627318    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="93aea086-0642-4d54-87e2-ad4f15ff1266" containerName="maas-api"
Jul 13 07:44:35.627631 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627331    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy"
Jul 13 07:44:35.627631 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627341    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="691dd4bb-e991-47a8-83dc-9d452433528b" containerName="istio-proxy"
Jul 13 07:44:35.627631 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.627351    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="459986eb-e7a9-4812-9ef8-a1be97e604cb" containerName="maas-api"
Jul 13 07:44:35.632065 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.632043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:35.634662 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.634631    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-db7d2d-serving-cert\""
Jul 13 07:44:35.641069 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.641035    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"]
Jul 13 07:44:35.703853 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.703810    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:35.703853 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.703860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hgpw\" (UniqueName: \"kubernetes.io/projected/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-kube-api-access-4hgpw\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:35.704067 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.703936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:35.804866 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.804826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:35.805058 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.804871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hgpw\" (UniqueName: \"kubernetes.io/projected/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-kube-api-access-4hgpw\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:35.805058 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.804941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:35.805058 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:44:35.804977    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-db7d2d-serving-cert: secret "maas-api-e2e-shared-a-db7d2d-serving-cert" not found
Jul 13 07:44:35.805058 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:44:35.805056    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls podName:fbe5e335-95dc-4698-bc2d-40f9b0d296f0 nodeName:}" failed. No retries permitted until 2026-07-13 07:44:36.305038416 +0000 UTC m=+1942.011915697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls") pod "maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972" (UID: "fbe5e335-95dc-4698-bc2d-40f9b0d296f0") : secret "maas-api-e2e-shared-a-db7d2d-serving-cert" not found
Jul 13 07:44:35.805593 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.805577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:35.820010 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:35.819982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hgpw\" (UniqueName: \"kubernetes.io/projected/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-kube-api-access-4hgpw\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:36.311095 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:36.311055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:36.313552 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:36.313529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls\") pod \"maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") " pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:36.545247 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:36.545216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:36.686108 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:36.686081    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"]
Jul 13 07:44:36.687945 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:44:36.687911    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe5e335_95dc_4698_bc2d_40f9b0d296f0.slice/crio-b08720907a31a694e2831858ec328d63308d90e8f093e7bbc4c80796fc8c0ad7 WatchSource:0}: Error finding container b08720907a31a694e2831858ec328d63308d90e8f093e7bbc4c80796fc8c0ad7: Status 404 returned error can't find the container with id b08720907a31a694e2831858ec328d63308d90e8f093e7bbc4c80796fc8c0ad7
Jul 13 07:44:37.567642 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:37.567604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972" event={"ID":"fbe5e335-95dc-4698-bc2d-40f9b0d296f0","Type":"ContainerStarted","Data":"33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581"}
Jul 13 07:44:37.567842 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:37.567660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972" event={"ID":"fbe5e335-95dc-4698-bc2d-40f9b0d296f0","Type":"ContainerStarted","Data":"b08720907a31a694e2831858ec328d63308d90e8f093e7bbc4c80796fc8c0ad7"}
Jul 13 07:44:37.567842 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:37.567793    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:37.588143 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:37.588092    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972" podStartSLOduration=2.233190853 podStartE2EDuration="2.588077201s" totalImagesPullingTime="354.886348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:44:37.586632381 +0000 UTC m=+1943.293509701" watchObservedRunningTime="2026-07-13 07:44:37.588077201 +0000 UTC m=+1943.294954504"
Jul 13 07:44:40.620607 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.620572    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"]
Jul 13 07:44:40.624469 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.624429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.627308 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.627288    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-da56f9-openshift-default-dockercfg-n5nwl\""
Jul 13 07:44:40.627458 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.627323    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 07:44:40.638973 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.638944    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"]
Jul 13 07:44:40.755411 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-data\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.755615 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-socket\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.755615 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-certs\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.755615 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-podinfo\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.755615 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-envoy\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.755752 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755625    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istiod-ca-cert\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.755752 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-credential-socket\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.755752 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vc48\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-kube-api-access-5vc48\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.755850 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.755751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-token\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856545 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-certs\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856724 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-podinfo\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856724 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-envoy\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856724 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istiod-ca-cert\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-credential-socket\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vc48\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-kube-api-access-5vc48\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-token\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-data\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.856902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-socket\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.857163 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.856946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-certs\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.857163 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.857089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-credential-socket\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.857276 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.857167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-socket\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.857387 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.857361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-data\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.857491 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.857475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istiod-ca-cert\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.858934 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.858913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-envoy\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.859135 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.859117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-podinfo\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.865690 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.865659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-token\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.865859 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.865844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vc48\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-kube-api-access-5vc48\") pod \"e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") " pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:40.935190 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:40.935102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:41.082782 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:41.082749    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"]
Jul 13 07:44:41.083898 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:44:41.083870    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df93d0d_bbec_4b8d_bec0_e6d19c2a7e3b.slice/crio-f2328a5475069694cb924d32af08d67e005445b32c664d3b51dd2131d1d25773 WatchSource:0}: Error finding container f2328a5475069694cb924d32af08d67e005445b32c664d3b51dd2131d1d25773: Status 404 returned error can't find the container with id f2328a5475069694cb924d32af08d67e005445b32c664d3b51dd2131d1d25773
Jul 13 07:44:41.086224 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:41.086184    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:41.086308 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:41.086277    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:41.086348 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:41.086325    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:41.591722 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:41.591688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" event={"ID":"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b","Type":"ContainerStarted","Data":"7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129"}
Jul 13 07:44:41.591899 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:41.591743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" event={"ID":"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b","Type":"ContainerStarted","Data":"f2328a5475069694cb924d32af08d67e005445b32c664d3b51dd2131d1d25773"}
Jul 13 07:44:41.613577 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:41.613524    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" podStartSLOduration=1.613507727 podStartE2EDuration="1.613507727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:44:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:44:41.610531119 +0000 UTC m=+1947.317408455" watchObservedRunningTime="2026-07-13 07:44:41.613507727 +0000 UTC m=+1947.320385031"
Jul 13 07:44:41.935837 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:41.935758    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:42.940883 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:42.940855    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:43.579222 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.579194    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:44:43.601358 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.601327    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:43.602146 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.602127    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:43.632518 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.632490    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"]
Jul 13 07:44:43.636269 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.636249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:43.639645 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.639588    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-da56f9-serving-cert\""
Jul 13 07:44:43.652020 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.651995    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"]
Jul 13 07:44:43.784011 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.783971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmnwc\" (UniqueName: \"kubernetes.io/projected/e4b5536a-6a91-4518-86c5-2caee9d89bce-kube-api-access-tmnwc\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:43.784237 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.784104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5536a-6a91-4518-86c5-2caee9d89bce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:43.784320 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.784230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:43.885682 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.885603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:43.885830 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.885689    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmnwc\" (UniqueName: \"kubernetes.io/projected/e4b5536a-6a91-4518-86c5-2caee9d89bce-kube-api-access-tmnwc\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:43.885830 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.885746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5536a-6a91-4518-86c5-2caee9d89bce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:43.885830 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:44:43.885751    2565 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-da56f9-serving-cert: secret "maas-api-e2e-shared-b-da56f9-serving-cert" not found
Jul 13 07:44:43.885830 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:44:43.885810    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls podName:e4b5536a-6a91-4518-86c5-2caee9d89bce nodeName:}" failed. No retries permitted until 2026-07-13 07:44:44.385792918 +0000 UTC m=+1950.092670199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls") pod "maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr" (UID: "e4b5536a-6a91-4518-86c5-2caee9d89bce") : secret "maas-api-e2e-shared-b-da56f9-serving-cert" not found
Jul 13 07:44:43.886393 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.886375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5536a-6a91-4518-86c5-2caee9d89bce-openshift-service-ca\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:43.896712 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:43.896689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmnwc\" (UniqueName: \"kubernetes.io/projected/e4b5536a-6a91-4518-86c5-2caee9d89bce-kube-api-access-tmnwc\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:44.390298 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:44.390266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:44.392628 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:44.392602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls\") pod \"maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") " pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:44.551483 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:44.551414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:44.690835 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:44.690809    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"]
Jul 13 07:44:44.693119 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:44:44.693088    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b5536a_6a91_4518_86c5_2caee9d89bce.slice/crio-63ba54d166e9acff2bac2de9f32dc9b17df7537016a6c6b7bf43868f1edfd424 WatchSource:0}: Error finding container 63ba54d166e9acff2bac2de9f32dc9b17df7537016a6c6b7bf43868f1edfd424: Status 404 returned error can't find the container with id 63ba54d166e9acff2bac2de9f32dc9b17df7537016a6c6b7bf43868f1edfd424
Jul 13 07:44:45.623848 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:45.623812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr" event={"ID":"e4b5536a-6a91-4518-86c5-2caee9d89bce","Type":"ContainerStarted","Data":"d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974"}
Jul 13 07:44:45.624271 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:45.623892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr" event={"ID":"e4b5536a-6a91-4518-86c5-2caee9d89bce","Type":"ContainerStarted","Data":"63ba54d166e9acff2bac2de9f32dc9b17df7537016a6c6b7bf43868f1edfd424"}
Jul 13 07:44:45.624271 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:45.624058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:45.645455 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:45.645395    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr" podStartSLOduration=2.232379746 podStartE2EDuration="2.645376184s" totalImagesPullingTime="412.996438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:44:45.642868097 +0000 UTC m=+1951.349745420" watchObservedRunningTime="2026-07-13 07:44:45.645376184 +0000 UTC m=+1951.352253490"
Jul 13 07:44:51.635451 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:51.635412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:44:56.683924 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:56.683890    2565 generic.go:356] "Generic (PLEG): container finished" podID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerID="7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129" exitCode=0
Jul 13 07:44:56.684364 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:56.683961    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" event={"ID":"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b","Type":"ContainerDied","Data":"7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129"}
Jul 13 07:44:56.684410 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:56.684388    2565 scope.go:117] "RemoveContainer" containerID="7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129"
Jul 13 07:44:56.685456 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:56.685417    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:56.685526 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:56.685497    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:56.685566 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:56.685530    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 13 07:44:57.691638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:57.691604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" event={"ID":"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b","Type":"ContainerStarted","Data":"96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966"}
Jul 13 07:44:57.935548 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:57.935517    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:57.936698 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:57.936669    2565 patch_prober.go:28] interesting pod/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 13 07:44:57.936848 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:57.936719    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 13 07:44:58.601869 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:58.601830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:44:58.935950 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:58.935863    2565 patch_prober.go:28] interesting pod/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 13 07:44:58.935950 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:58.935914    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 13 07:44:59.935710 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:59.935675    2565 patch_prober.go:28] interesting pod/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 13 07:44:59.935954 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:44:59.935739    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 13 07:45:00.936224 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:00.936186    2565 patch_prober.go:28] interesting pod/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 13 07:45:00.936726 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:00.936257    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 13 07:45:01.939429 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:01.939398    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:45:01.940489 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:01.940468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:45:51.129358 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.129325    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"]
Jul 13 07:45:51.131860 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.131841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.134470 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.134449    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"kube-root-ca.crt\""
Jul 13 07:45:51.135467 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.135420    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"auth-test-model-da56f9-kserve-self-signed-certs\""
Jul 13 07:45:51.135581 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.135558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"default-dockercfg-kwv9t\""
Jul 13 07:45:51.135645 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.135585    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-da56f9\"/\"openshift-service-ca.crt\""
Jul 13 07:45:51.143206 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.143177    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"]
Jul 13 07:45:51.160823 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.160786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpcrv\" (UniqueName: \"kubernetes.io/projected/ea364173-47da-488d-90c3-7cd233c25bcb-kube-api-access-xpcrv\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.161223 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.161193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-tmp-dir\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.161409 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.161392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-dshm\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.161528 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.161506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-model-cache\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.161642 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.161625    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-home\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.161795 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.161721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea364173-47da-488d-90c3-7cd233c25bcb-tls-certs\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.262902 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.262868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea364173-47da-488d-90c3-7cd233c25bcb-tls-certs\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.263088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.262915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpcrv\" (UniqueName: \"kubernetes.io/projected/ea364173-47da-488d-90c3-7cd233c25bcb-kube-api-access-xpcrv\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.263088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.262953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-tmp-dir\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.263088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.262978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-dshm\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.263088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.262998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-model-cache\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.263088 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.263039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-home\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.263491 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.263418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-home\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.263585 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.263501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-tmp-dir\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.263625 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.263552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-model-cache\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.265298 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.265263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-dshm\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.265421 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.265401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea364173-47da-488d-90c3-7cd233c25bcb-tls-certs\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.271638 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.271617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpcrv\" (UniqueName: \"kubernetes.io/projected/ea364173-47da-488d-90c3-7cd233c25bcb-kube-api-access-xpcrv\") pod \"auth-test-model-da56f9-kserve-8649f47b8c-glm9q\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") " pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.441937 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.441843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:45:51.576096 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.576071    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"]
Jul 13 07:45:51.578186 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:45:51.578156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea364173_47da_488d_90c3_7cd233c25bcb.slice/crio-f10071e050bf6c8107dccc4a5f492f4d41694efdc7b083be6eeb79d7926ffa1f WatchSource:0}: Error finding container f10071e050bf6c8107dccc4a5f492f4d41694efdc7b083be6eeb79d7926ffa1f: Status 404 returned error can't find the container with id f10071e050bf6c8107dccc4a5f492f4d41694efdc7b083be6eeb79d7926ffa1f
Jul 13 07:45:51.969020 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.968988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q" event={"ID":"ea364173-47da-488d-90c3-7cd233c25bcb","Type":"ContainerStarted","Data":"c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89"}
Jul 13 07:45:51.969199 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.969029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q" event={"ID":"ea364173-47da-488d-90c3-7cd233c25bcb","Type":"ContainerStarted","Data":"f10071e050bf6c8107dccc4a5f492f4d41694efdc7b083be6eeb79d7926ffa1f"}
Jul 13 07:45:51.988224 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:45:51.988180    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q" podStartSLOduration=0.988164879 podStartE2EDuration="988.164879ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:45:51.985230862 +0000 UTC m=+2017.692108165" watchObservedRunningTime="2026-07-13 07:45:51.988164879 +0000 UTC m=+2017.695042181"
Jul 13 07:46:01.442679 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:46:01.442643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:46:01.443130 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:46:01.442931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:46:01.455455 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:46:01.455406    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:46:02.031865 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:46:02.031835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:47:39.817629 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:39.817594    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"]
Jul 13 07:47:54.837048 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:54.837001    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q" podUID="ea364173-47da-488d-90c3-7cd233c25bcb" containerName="main" containerID="cri-o://c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89" gracePeriod=45
Jul 13 07:47:55.088210 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.088153    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:47:55.187198 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-home\") pod \"ea364173-47da-488d-90c3-7cd233c25bcb\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") "
Jul 13 07:47:55.187386 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187233    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-dshm\") pod \"ea364173-47da-488d-90c3-7cd233c25bcb\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") "
Jul 13 07:47:55.187386 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187249    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-model-cache\") pod \"ea364173-47da-488d-90c3-7cd233c25bcb\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") "
Jul 13 07:47:55.187386 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-tmp-dir\") pod \"ea364173-47da-488d-90c3-7cd233c25bcb\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") "
Jul 13 07:47:55.187386 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea364173-47da-488d-90c3-7cd233c25bcb-tls-certs\") pod \"ea364173-47da-488d-90c3-7cd233c25bcb\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") "
Jul 13 07:47:55.187637 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187414    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpcrv\" (UniqueName: \"kubernetes.io/projected/ea364173-47da-488d-90c3-7cd233c25bcb-kube-api-access-xpcrv\") pod \"ea364173-47da-488d-90c3-7cd233c25bcb\" (UID: \"ea364173-47da-488d-90c3-7cd233c25bcb\") "
Jul 13 07:47:55.187637 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187486    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-home" (OuterVolumeSpecName: "home") pod "ea364173-47da-488d-90c3-7cd233c25bcb" (UID: "ea364173-47da-488d-90c3-7cd233c25bcb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:47:55.187637 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187535    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-model-cache" (OuterVolumeSpecName: "model-cache") pod "ea364173-47da-488d-90c3-7cd233c25bcb" (UID: "ea364173-47da-488d-90c3-7cd233c25bcb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:47:55.187637 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187620    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ea364173-47da-488d-90c3-7cd233c25bcb" (UID: "ea364173-47da-488d-90c3-7cd233c25bcb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:47:55.187795 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187781    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-model-cache\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:47:55.187837 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187798    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-tmp-dir\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:47:55.187837 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.187806    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-home\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:47:55.189606 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.189582    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-dshm" (OuterVolumeSpecName: "dshm") pod "ea364173-47da-488d-90c3-7cd233c25bcb" (UID: "ea364173-47da-488d-90c3-7cd233c25bcb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:47:55.189606 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.189593    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea364173-47da-488d-90c3-7cd233c25bcb-kube-api-access-xpcrv" (OuterVolumeSpecName: "kube-api-access-xpcrv") pod "ea364173-47da-488d-90c3-7cd233c25bcb" (UID: "ea364173-47da-488d-90c3-7cd233c25bcb"). InnerVolumeSpecName "kube-api-access-xpcrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:47:55.189762 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.189598    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea364173-47da-488d-90c3-7cd233c25bcb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ea364173-47da-488d-90c3-7cd233c25bcb" (UID: "ea364173-47da-488d-90c3-7cd233c25bcb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:47:55.288885 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.288849    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpcrv\" (UniqueName: \"kubernetes.io/projected/ea364173-47da-488d-90c3-7cd233c25bcb-kube-api-access-xpcrv\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:47:55.288885 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.288878    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea364173-47da-488d-90c3-7cd233c25bcb-dshm\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:47:55.288885 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.288888    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea364173-47da-488d-90c3-7cd233c25bcb-tls-certs\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:47:55.597382 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.597345    2565 generic.go:356] "Generic (PLEG): container finished" podID="ea364173-47da-488d-90c3-7cd233c25bcb" containerID="c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89" exitCode=0
Jul 13 07:47:55.597595 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.597388    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"
Jul 13 07:47:55.597595 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.597431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q" event={"ID":"ea364173-47da-488d-90c3-7cd233c25bcb","Type":"ContainerDied","Data":"c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89"}
Jul 13 07:47:55.597595 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.597496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q" event={"ID":"ea364173-47da-488d-90c3-7cd233c25bcb","Type":"ContainerDied","Data":"f10071e050bf6c8107dccc4a5f492f4d41694efdc7b083be6eeb79d7926ffa1f"}
Jul 13 07:47:55.597595 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.597521    2565 scope.go:117] "RemoveContainer" containerID="c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89"
Jul 13 07:47:55.606747 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.606727    2565 scope.go:117] "RemoveContainer" containerID="c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89"
Jul 13 07:47:55.606993 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:47:55.606974    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89\": container with ID starting with c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89 not found: ID does not exist" containerID="c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89"
Jul 13 07:47:55.607039 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.607002    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89"} err="failed to get container status \"c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89\": rpc error: code = NotFound desc = could not find container \"c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89\": container with ID starting with c6378872912c527303eb8106538b19f19a0d286dc4b61b6e1849d0adc49b2b89 not found: ID does not exist"
Jul 13 07:47:55.618854 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.618833    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"]
Jul 13 07:47:55.622298 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:55.622277    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-da56f9/auth-test-model-da56f9-kserve-8649f47b8c-glm9q"]
Jul 13 07:47:56.921474 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:47:56.921421    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea364173-47da-488d-90c3-7cd233c25bcb" path="/var/lib/kubelet/pods/ea364173-47da-488d-90c3-7cd233c25bcb/volumes"
Jul 13 07:49:09.215256 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.215221    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"]
Jul 13 07:49:09.215693 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.215665    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea364173-47da-488d-90c3-7cd233c25bcb" containerName="main"
Jul 13 07:49:09.215693 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.215678    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea364173-47da-488d-90c3-7cd233c25bcb" containerName="main"
Jul 13 07:49:09.215767 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.215751    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea364173-47da-488d-90c3-7cd233c25bcb" containerName="main"
Jul 13 07:49:09.219058 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.219042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.232009 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.231986    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"openshift-service-ca.crt\""
Jul 13 07:49:09.232009 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.232001    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"default-dockercfg-88xvx\""
Jul 13 07:49:09.232184 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.232056    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"rate-test-model-db7d2d-kserve-self-signed-certs\""
Jul 13 07:49:09.232184 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.232118    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-db7d2d\"/\"kube-root-ca.crt\""
Jul 13 07:49:09.254214 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.254191    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"]
Jul 13 07:49:09.315533 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.315494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spgq7\" (UniqueName: \"kubernetes.io/projected/4a736be3-e215-4573-a240-8b7687fbe495-kube-api-access-spgq7\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.315692 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.315614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-dshm\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.315692 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.315666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a736be3-e215-4573-a240-8b7687fbe495-tls-certs\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.315803 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.315737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-tmp-dir\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.315803 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.315779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-home\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.315803 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.315796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-model-cache\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417118 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spgq7\" (UniqueName: \"kubernetes.io/projected/4a736be3-e215-4573-a240-8b7687fbe495-kube-api-access-spgq7\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-dshm\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a736be3-e215-4573-a240-8b7687fbe495-tls-certs\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-tmp-dir\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-home\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417307 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-model-cache\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417759 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-home\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417919 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-model-cache\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.417919 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.417799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-tmp-dir\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.419527 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.419502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-dshm\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.419853 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.419833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a736be3-e215-4573-a240-8b7687fbe495-tls-certs\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.426807 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.426781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spgq7\" (UniqueName: \"kubernetes.io/projected/4a736be3-e215-4573-a240-8b7687fbe495-kube-api-access-spgq7\") pod \"rate-test-model-db7d2d-kserve-674f7dbf59-pht5n\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") " pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.528503 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.528402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:09.671577 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.671553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"]
Jul 13 07:49:09.674381 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:49:09.674357    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a736be3_e215_4573_a240_8b7687fbe495.slice/crio-f264d57503a28d412f666ba07a3073a20116d259ce6171f343633955bc226c31 WatchSource:0}: Error finding container f264d57503a28d412f666ba07a3073a20116d259ce6171f343633955bc226c31: Status 404 returned error can't find the container with id f264d57503a28d412f666ba07a3073a20116d259ce6171f343633955bc226c31
Jul 13 07:49:09.960858 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.960823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n" event={"ID":"4a736be3-e215-4573-a240-8b7687fbe495","Type":"ContainerStarted","Data":"42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f"}
Jul 13 07:49:09.961041 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.960870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n" event={"ID":"4a736be3-e215-4573-a240-8b7687fbe495","Type":"ContainerStarted","Data":"f264d57503a28d412f666ba07a3073a20116d259ce6171f343633955bc226c31"}
Jul 13 07:49:09.983308 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:09.983217    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n" podStartSLOduration=0.983196988 podStartE2EDuration="983.196988ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:49:09.982802052 +0000 UTC m=+2215.689679359" watchObservedRunningTime="2026-07-13 07:49:09.983196988 +0000 UTC m=+2215.690074292"
Jul 13 07:49:19.529394 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:19.529359    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:19.529394 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:19.529402    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:19.541773 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:19.541750    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:49:20.023085 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:49:20.023053    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:50:15.780456 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:15.780407    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"]
Jul 13 07:50:18.502370 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.502335    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"]
Jul 13 07:50:18.502872 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.502612    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972" podUID="fbe5e335-95dc-4698-bc2d-40f9b0d296f0" containerName="maas-api" containerID="cri-o://33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581" gracePeriod=30
Jul 13 07:50:18.574305 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.574261    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972" podUID="fbe5e335-95dc-4698-bc2d-40f9b0d296f0" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.45:8443/health\": dial tcp 10.134.0.45:8443: connect: connection refused"
Jul 13 07:50:18.751975 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.751943    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:50:18.906887 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.906857    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hgpw\" (UniqueName: \"kubernetes.io/projected/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-kube-api-access-4hgpw\") pod \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") "
Jul 13 07:50:18.907089 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.906944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-openshift-service-ca\") pod \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") "
Jul 13 07:50:18.907089 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.906981    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls\") pod \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\" (UID: \"fbe5e335-95dc-4698-bc2d-40f9b0d296f0\") "
Jul 13 07:50:18.907325 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.907298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbe5e335-95dc-4698-bc2d-40f9b0d296f0" (UID: "fbe5e335-95dc-4698-bc2d-40f9b0d296f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:50:18.909001 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.908979    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbe5e335-95dc-4698-bc2d-40f9b0d296f0" (UID: "fbe5e335-95dc-4698-bc2d-40f9b0d296f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:50:18.909128 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:18.909108    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-kube-api-access-4hgpw" (OuterVolumeSpecName: "kube-api-access-4hgpw") pod "fbe5e335-95dc-4698-bc2d-40f9b0d296f0" (UID: "fbe5e335-95dc-4698-bc2d-40f9b0d296f0"). InnerVolumeSpecName "kube-api-access-4hgpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:50:19.007897 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.007853    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:19.008074 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.007916    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hgpw\" (UniqueName: \"kubernetes.io/projected/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-kube-api-access-4hgpw\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:19.008074 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.007930    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe5e335-95dc-4698-bc2d-40f9b0d296f0-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:19.316690 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.316654    2565 generic.go:356] "Generic (PLEG): container finished" podID="fbe5e335-95dc-4698-bc2d-40f9b0d296f0" containerID="33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581" exitCode=0
Jul 13 07:50:19.316862 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.316709    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"
Jul 13 07:50:19.316862 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.316736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972" event={"ID":"fbe5e335-95dc-4698-bc2d-40f9b0d296f0","Type":"ContainerDied","Data":"33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581"}
Jul 13 07:50:19.316862 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.316793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972" event={"ID":"fbe5e335-95dc-4698-bc2d-40f9b0d296f0","Type":"ContainerDied","Data":"b08720907a31a694e2831858ec328d63308d90e8f093e7bbc4c80796fc8c0ad7"}
Jul 13 07:50:19.316862 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.316814    2565 scope.go:117] "RemoveContainer" containerID="33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581"
Jul 13 07:50:19.325577 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.325559    2565 scope.go:117] "RemoveContainer" containerID="33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581"
Jul 13 07:50:19.325836 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:50:19.325818    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581\": container with ID starting with 33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581 not found: ID does not exist" containerID="33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581"
Jul 13 07:50:19.325896 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.325843    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581"} err="failed to get container status \"33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581\": rpc error: code = NotFound desc = could not find container \"33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581\": container with ID starting with 33808cf7508d4a0e085aebd7f08af059425c75677ef4f7f9daf82ff142cb2581 not found: ID does not exist"
Jul 13 07:50:19.333586 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.333564    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"]
Jul 13 07:50:19.337487 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:19.337465    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-db7d2d-84b9765fb5-t9972"]
Jul 13 07:50:20.921849 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:20.921813    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbe5e335-95dc-4698-bc2d-40f9b0d296f0" path="/var/lib/kubelet/pods/fbe5e335-95dc-4698-bc2d-40f9b0d296f0/volumes"
Jul 13 07:50:30.800666 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:30.800619    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n" podUID="4a736be3-e215-4573-a240-8b7687fbe495" containerName="main" containerID="cri-o://42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f" gracePeriod=45
Jul 13 07:50:31.050949 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.050887    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:50:31.127960 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.127926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-model-cache\") pod \"4a736be3-e215-4573-a240-8b7687fbe495\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") "
Jul 13 07:50:31.128134 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128017    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-dshm\") pod \"4a736be3-e215-4573-a240-8b7687fbe495\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") "
Jul 13 07:50:31.128134 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128053    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-tmp-dir\") pod \"4a736be3-e215-4573-a240-8b7687fbe495\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") "
Jul 13 07:50:31.128134 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128083    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-home\") pod \"4a736be3-e215-4573-a240-8b7687fbe495\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") "
Jul 13 07:50:31.128134 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128102    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spgq7\" (UniqueName: \"kubernetes.io/projected/4a736be3-e215-4573-a240-8b7687fbe495-kube-api-access-spgq7\") pod \"4a736be3-e215-4573-a240-8b7687fbe495\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") "
Jul 13 07:50:31.128134 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128126    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a736be3-e215-4573-a240-8b7687fbe495-tls-certs\") pod \"4a736be3-e215-4573-a240-8b7687fbe495\" (UID: \"4a736be3-e215-4573-a240-8b7687fbe495\") "
Jul 13 07:50:31.128422 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128213    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a736be3-e215-4573-a240-8b7687fbe495" (UID: "4a736be3-e215-4573-a240-8b7687fbe495"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:50:31.128422 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a736be3-e215-4573-a240-8b7687fbe495" (UID: "4a736be3-e215-4573-a240-8b7687fbe495"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:50:31.128422 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128345    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-home" (OuterVolumeSpecName: "home") pod "4a736be3-e215-4573-a240-8b7687fbe495" (UID: "4a736be3-e215-4573-a240-8b7687fbe495"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:50:31.128609 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128532    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-home\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:31.128609 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128553    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-model-cache\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:31.128609 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.128567    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-tmp-dir\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:31.130378 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.130355    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a736be3-e215-4573-a240-8b7687fbe495-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a736be3-e215-4573-a240-8b7687fbe495" (UID: "4a736be3-e215-4573-a240-8b7687fbe495"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:50:31.130474 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.130355    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-dshm" (OuterVolumeSpecName: "dshm") pod "4a736be3-e215-4573-a240-8b7687fbe495" (UID: "4a736be3-e215-4573-a240-8b7687fbe495"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:50:31.130530 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.130481    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a736be3-e215-4573-a240-8b7687fbe495-kube-api-access-spgq7" (OuterVolumeSpecName: "kube-api-access-spgq7") pod "4a736be3-e215-4573-a240-8b7687fbe495" (UID: "4a736be3-e215-4573-a240-8b7687fbe495"). InnerVolumeSpecName "kube-api-access-spgq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:50:31.229418 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.229384    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a736be3-e215-4573-a240-8b7687fbe495-dshm\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:31.229418 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.229413    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spgq7\" (UniqueName: \"kubernetes.io/projected/4a736be3-e215-4573-a240-8b7687fbe495-kube-api-access-spgq7\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:31.229418 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.229424    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a736be3-e215-4573-a240-8b7687fbe495-tls-certs\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:50:31.386809 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.386718    2565 generic.go:356] "Generic (PLEG): container finished" podID="4a736be3-e215-4573-a240-8b7687fbe495" containerID="42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f" exitCode=0
Jul 13 07:50:31.386809 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.386762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n" event={"ID":"4a736be3-e215-4573-a240-8b7687fbe495","Type":"ContainerDied","Data":"42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f"}
Jul 13 07:50:31.386809 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.386784    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"
Jul 13 07:50:31.386809 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.386799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n" event={"ID":"4a736be3-e215-4573-a240-8b7687fbe495","Type":"ContainerDied","Data":"f264d57503a28d412f666ba07a3073a20116d259ce6171f343633955bc226c31"}
Jul 13 07:50:31.387098 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.386817    2565 scope.go:117] "RemoveContainer" containerID="42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f"
Jul 13 07:50:31.396302 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.396287    2565 scope.go:117] "RemoveContainer" containerID="42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f"
Jul 13 07:50:31.396622 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:50:31.396601    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f\": container with ID starting with 42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f not found: ID does not exist" containerID="42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f"
Jul 13 07:50:31.396688 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.396631    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f"} err="failed to get container status \"42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f\": rpc error: code = NotFound desc = could not find container \"42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f\": container with ID starting with 42f1f68bbda338cf2a5736aa9db0504eb64d0c8493e6e19c48022a7449ce393f not found: ID does not exist"
Jul 13 07:50:31.408182 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.408155    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"]
Jul 13 07:50:31.410090 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:31.410065    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-db7d2d/rate-test-model-db7d2d-kserve-674f7dbf59-pht5n"]
Jul 13 07:50:32.921892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:50:32.921860    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a736be3-e215-4573-a240-8b7687fbe495" path="/var/lib/kubelet/pods/4a736be3-e215-4573-a240-8b7687fbe495/volumes"
Jul 13 07:51:02.196308 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.196269    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"]
Jul 13 07:51:02.196956 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.196535    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr" podUID="e4b5536a-6a91-4518-86c5-2caee9d89bce" containerName="maas-api" containerID="cri-o://d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974" gracePeriod=30
Jul 13 07:51:02.256319 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:51:02.256275    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b5536a_6a91_4518_86c5_2caee9d89bce.slice/crio-conmon-d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974.scope\": RecentStats: unable to find data in memory cache]"
Jul 13 07:51:02.449858 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.449780    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:51:02.535374 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.535344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls\") pod \"e4b5536a-6a91-4518-86c5-2caee9d89bce\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") "
Jul 13 07:51:02.535592 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.535390    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmnwc\" (UniqueName: \"kubernetes.io/projected/e4b5536a-6a91-4518-86c5-2caee9d89bce-kube-api-access-tmnwc\") pod \"e4b5536a-6a91-4518-86c5-2caee9d89bce\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") "
Jul 13 07:51:02.535592 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.535495    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5536a-6a91-4518-86c5-2caee9d89bce-openshift-service-ca\") pod \"e4b5536a-6a91-4518-86c5-2caee9d89bce\" (UID: \"e4b5536a-6a91-4518-86c5-2caee9d89bce\") "
Jul 13 07:51:02.535867 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.535843    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4b5536a-6a91-4518-86c5-2caee9d89bce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e4b5536a-6a91-4518-86c5-2caee9d89bce" (UID: "e4b5536a-6a91-4518-86c5-2caee9d89bce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:51:02.537508 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.537484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4b5536a-6a91-4518-86c5-2caee9d89bce-kube-api-access-tmnwc" (OuterVolumeSpecName: "kube-api-access-tmnwc") pod "e4b5536a-6a91-4518-86c5-2caee9d89bce" (UID: "e4b5536a-6a91-4518-86c5-2caee9d89bce"). InnerVolumeSpecName "kube-api-access-tmnwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:51:02.537588 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.537566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e4b5536a-6a91-4518-86c5-2caee9d89bce" (UID: "e4b5536a-6a91-4518-86c5-2caee9d89bce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 07:51:02.548376 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.548342    2565 generic.go:356] "Generic (PLEG): container finished" podID="e4b5536a-6a91-4518-86c5-2caee9d89bce" containerID="d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974" exitCode=0
Jul 13 07:51:02.548632 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.548373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr" event={"ID":"e4b5536a-6a91-4518-86c5-2caee9d89bce","Type":"ContainerDied","Data":"d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974"}
Jul 13 07:51:02.548632 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.548393    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"
Jul 13 07:51:02.548632 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.548485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr" event={"ID":"e4b5536a-6a91-4518-86c5-2caee9d89bce","Type":"ContainerDied","Data":"63ba54d166e9acff2bac2de9f32dc9b17df7537016a6c6b7bf43868f1edfd424"}
Jul 13 07:51:02.548632 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.548518    2565 scope.go:117] "RemoveContainer" containerID="d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974"
Jul 13 07:51:02.558369 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.558341    2565 scope.go:117] "RemoveContainer" containerID="d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974"
Jul 13 07:51:02.558719 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:51:02.558700    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974\": container with ID starting with d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974 not found: ID does not exist" containerID="d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974"
Jul 13 07:51:02.558780 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.558730    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974"} err="failed to get container status \"d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974\": rpc error: code = NotFound desc = could not find container \"d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974\": container with ID starting with d2674d655b5c85d4855be8ba49875a19fbca8fc5395a478f84488107814b2974 not found: ID does not exist"
Jul 13 07:51:02.572042 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.572010    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"]
Jul 13 07:51:02.576933 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.576901    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-da56f9-5b5cf7f858-6mbfr"]
Jul 13 07:51:02.636296 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.636255    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b5536a-6a91-4518-86c5-2caee9d89bce-openshift-service-ca\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:02.636296 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.636289    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e4b5536a-6a91-4518-86c5-2caee9d89bce-maas-api-tls\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:02.636296 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.636300    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmnwc\" (UniqueName: \"kubernetes.io/projected/e4b5536a-6a91-4518-86c5-2caee9d89bce-kube-api-access-tmnwc\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:02.921243 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:02.921210    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4b5536a-6a91-4518-86c5-2caee9d89bce" path="/var/lib/kubelet/pods/e4b5536a-6a91-4518-86c5-2caee9d89bce/volumes"
Jul 13 07:51:08.197955 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:08.197858    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"]
Jul 13 07:51:08.198389 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:08.198168    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy" containerID="cri-o://96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966" gracePeriod=30
Jul 13 07:51:13.458128 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.458101    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:51:13.547979 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.547944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-certs\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.547979 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.547985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-envoy\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.548244 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548018    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-data\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.548244 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548056    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-credential-socket\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.548244 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548093    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-token\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.548244 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548148    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istiod-ca-cert\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.548244 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548210    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vc48\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-kube-api-access-5vc48\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.548604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-socket\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.548604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548283    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:51:13.548604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548303    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-podinfo\") pod \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\" (UID: \"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b\") "
Jul 13 07:51:13.548604 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548384    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:51:13.548785 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548630    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:51:13.548785 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548679    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-certs\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.548785 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548699    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-credential-socket\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.548785 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.548712    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 07:51:13.549130 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.549102    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:51:13.550636 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.550613    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:51:13.550734 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.550716    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 07:51:13.550793 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.550726    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 07:51:13.550793 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.550766    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-kube-api-access-5vc48" (OuterVolumeSpecName: "kube-api-access-5vc48") pod "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" (UID: "9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b"). InnerVolumeSpecName "kube-api-access-5vc48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 07:51:13.607749 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.607715    2565 generic.go:356] "Generic (PLEG): container finished" podID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerID="96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966" exitCode=0
Jul 13 07:51:13.607917 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.607763    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"
Jul 13 07:51:13.607917 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.607803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" event={"ID":"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b","Type":"ContainerDied","Data":"96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966"}
Jul 13 07:51:13.607917 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.607863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w" event={"ID":"9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b","Type":"ContainerDied","Data":"f2328a5475069694cb924d32af08d67e005445b32c664d3b51dd2131d1d25773"}
Jul 13 07:51:13.607917 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.607885    2565 scope.go:117] "RemoveContainer" containerID="96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966"
Jul 13 07:51:13.617541 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.617513    2565 scope.go:117] "RemoveContainer" containerID="7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129"
Jul 13 07:51:13.626355 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.626335    2565 scope.go:117] "RemoveContainer" containerID="96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966"
Jul 13 07:51:13.626629 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:51:13.626615    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966\": container with ID starting with 96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966 not found: ID does not exist" containerID="96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966"
Jul 13 07:51:13.626680 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.626638    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966"} err="failed to get container status \"96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966\": rpc error: code = NotFound desc = could not find container \"96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966\": container with ID starting with 96ae51ac96ff9e5fdfb1f72a6152029a71680bb8691fcafa5a398113d81a5966 not found: ID does not exist"
Jul 13 07:51:13.626680 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.626655    2565 scope.go:117] "RemoveContainer" containerID="7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129"
Jul 13 07:51:13.626889 ip-10-0-130-143 kubenswrapper[2565]: E0713 07:51:13.626867    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129\": container with ID starting with 7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129 not found: ID does not exist" containerID="7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129"
Jul 13 07:51:13.626927 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.626898    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129"} err="failed to get container status \"7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129\": rpc error: code = NotFound desc = could not find container \"7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129\": container with ID starting with 7bb4209f2d8d93a67431a41252de962f8891b2079c6f3453809fae4ccc55e129 not found: ID does not exist"
Jul 13 07:51:13.631591 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.631565    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"]
Jul 13 07:51:13.633941 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.633918    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-da56f9-openshift-default-78cbdd7cf9-zsl7w"]
Jul 13 07:51:13.650045 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.650025    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-envoy\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.650045 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.650047    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-data\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.650177 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.650056    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-token\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.650177 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.650064    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istiod-ca-cert\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.650177 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.650072    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vc48\" (UniqueName: \"kubernetes.io/projected/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-kube-api-access-5vc48\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.650177 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.650084    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-workload-socket\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.650177 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.650095    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b-istio-podinfo\") on node \"ip-10-0-130-143.ec2.internal\" DevicePath \"\""
Jul 13 07:51:13.712265 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:13.712212    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-f59f4fdbd-cgxcv_d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc/maas-api/0.log"
Jul 13 07:51:14.065568 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:14.065538    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ddc5ffd7c-lkr5k_c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f/manager/0.log"
Jul 13 07:51:14.438282 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:14.438205    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-g74mr_c38903d9-ee12-4f3c-bbf9-4b58febef4a2/copy-manifests/0.log"
Jul 13 07:51:14.445622 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:14.445572    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-g74mr_c38903d9-ee12-4f3c-bbf9-4b58febef4a2/manager/0.log"
Jul 13 07:51:14.921598 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:14.921569    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" path="/var/lib/kubelet/pods/9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b/volumes"
Jul 13 07:51:16.499691 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:16.499662    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bc5gj_76224c45-8dfd-4590-a3fe-dd54acb097f1/kuadrant-console-plugin/0.log"
Jul 13 07:51:16.993814 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:16.993782    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jc4wj_4abc9152-5adf-4b49-b573-55f219b811b1/manager/0.log"
Jul 13 07:51:17.692030 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:17.692006    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f9f4ffd9-pf6nt_fba178f3-1b44-4985-b1ca-9d58f363e6bb/kube-auth-proxy/0.log"
Jul 13 07:51:18.908213 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:18.908183    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmjpqh_0193cb39-35a6-430b-b578-e6d7ec4f53a2/main/0.log"
Jul 13 07:51:19.142283 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:19.142254    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-nd5tz_bf46d06f-3986-40e1-82c6-2764c56f9985/main/0.log"
Jul 13 07:51:26.077496 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:26.077461    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6gdkr_a07db2fc-5703-4db6-b9b1-93486b584ec4/global-pull-secret-syncer/0.log"
Jul 13 07:51:26.309051 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:26.309023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q5whj_b3fb64be-7807-4db6-872b-9efab6a90d01/konnectivity-agent/0.log"
Jul 13 07:51:26.334951 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:26.334867    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-143.ec2.internal_b12fa66d6056d22316fd135bb16dacac/haproxy/0.log"
Jul 13 07:51:32.052756 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:32.052724    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bc5gj_76224c45-8dfd-4590-a3fe-dd54acb097f1/kuadrant-console-plugin/0.log"
Jul 13 07:51:32.293671 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:32.293640    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jc4wj_4abc9152-5adf-4b49-b573-55f219b811b1/manager/0.log"
Jul 13 07:51:33.916786 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:33.916761    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca3dc766-f0aa-4d90-b668-69c85f83b505/alertmanager/0.log"
Jul 13 07:51:33.946501 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:33.946417    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca3dc766-f0aa-4d90-b668-69c85f83b505/config-reloader/0.log"
Jul 13 07:51:33.977719 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:33.977694    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca3dc766-f0aa-4d90-b668-69c85f83b505/kube-rbac-proxy-web/0.log"
Jul 13 07:51:34.005956 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.005931    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca3dc766-f0aa-4d90-b668-69c85f83b505/kube-rbac-proxy/0.log"
Jul 13 07:51:34.032991 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.032966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca3dc766-f0aa-4d90-b668-69c85f83b505/kube-rbac-proxy-metric/0.log"
Jul 13 07:51:34.062768 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.062736    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca3dc766-f0aa-4d90-b668-69c85f83b505/prom-label-proxy/0.log"
Jul 13 07:51:34.091898 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.091872    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ca3dc766-f0aa-4d90-b668-69c85f83b505/init-config-reloader/0.log"
Jul 13 07:51:34.202030 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.201935    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gxgjq_3366b9b6-ea5b-4e73-8e77-5a562c1be2ec/kube-state-metrics/0.log"
Jul 13 07:51:34.229849 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.229819    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gxgjq_3366b9b6-ea5b-4e73-8e77-5a562c1be2ec/kube-rbac-proxy-main/0.log"
Jul 13 07:51:34.260782 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.260757    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-gxgjq_3366b9b6-ea5b-4e73-8e77-5a562c1be2ec/kube-rbac-proxy-self/0.log"
Jul 13 07:51:34.311900 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.311858    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7fcd484c5b-5s6jb_d6de3496-5907-4394-b4d1-fc0a19c367db/metrics-server/0.log"
Jul 13 07:51:34.372610 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.372573    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-9t5nl_1b645680-65e7-437f-ae49-f9bc4a9c2d10/monitoring-plugin/0.log"
Jul 13 07:51:34.539339 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.539315    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rggb_ba66db81-908a-47ba-975d-159f1ac2b204/node-exporter/0.log"
Jul 13 07:51:34.565424 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.565402    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rggb_ba66db81-908a-47ba-975d-159f1ac2b204/kube-rbac-proxy/0.log"
Jul 13 07:51:34.590388 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.590367    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7rggb_ba66db81-908a-47ba-975d-159f1ac2b204/init-textfile/0.log"
Jul 13 07:51:34.706519 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.706490    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-spnpt_fd6e2ed6-ab73-4057-9f69-af85280dcdb0/kube-rbac-proxy-main/0.log"
Jul 13 07:51:34.734259 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.734235    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-spnpt_fd6e2ed6-ab73-4057-9f69-af85280dcdb0/kube-rbac-proxy-self/0.log"
Jul 13 07:51:34.767930 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.767863    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-spnpt_fd6e2ed6-ab73-4057-9f69-af85280dcdb0/openshift-state-metrics/0.log"
Jul 13 07:51:34.803129 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.803102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caa13f40-d33b-4661-b8da-7557ea478093/prometheus/0.log"
Jul 13 07:51:34.831072 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.831040    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caa13f40-d33b-4661-b8da-7557ea478093/config-reloader/0.log"
Jul 13 07:51:34.856731 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.856707    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caa13f40-d33b-4661-b8da-7557ea478093/thanos-sidecar/0.log"
Jul 13 07:51:34.884021 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.883993    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caa13f40-d33b-4661-b8da-7557ea478093/kube-rbac-proxy-web/0.log"
Jul 13 07:51:34.911496 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.911470    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caa13f40-d33b-4661-b8da-7557ea478093/kube-rbac-proxy/0.log"
Jul 13 07:51:34.939101 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.939075    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caa13f40-d33b-4661-b8da-7557ea478093/kube-rbac-proxy-thanos/0.log"
Jul 13 07:51:34.964608 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.964587    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_caa13f40-d33b-4661-b8da-7557ea478093/init-config-reloader/0.log"
Jul 13 07:51:34.995760 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:34.995730    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xspkh_7a8c30a1-30d8-49e4-8535-40222abb4019/prometheus-operator/0.log"
Jul 13 07:51:35.018304 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.018234    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xspkh_7a8c30a1-30d8-49e4-8535-40222abb4019/kube-rbac-proxy/0.log"
Jul 13 07:51:35.054820 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.054793    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-7rd95_5df22173-d341-4b19-8eb0-4ee42c660574/prometheus-operator-admission-webhook/0.log"
Jul 13 07:51:35.102909 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.102884    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc99d999d-mh9zt_e81adf55-2a33-491e-9828-45a71df17013/telemeter-client/0.log"
Jul 13 07:51:35.132778 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.132754    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc99d999d-mh9zt_e81adf55-2a33-491e-9828-45a71df17013/reload/0.log"
Jul 13 07:51:35.162705 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.162679    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5fc99d999d-mh9zt_e81adf55-2a33-491e-9828-45a71df17013/kube-rbac-proxy/0.log"
Jul 13 07:51:35.202536 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.202510    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc847896-2gtqt_6d3e825c-5ae2-4265-a86e-a681f5aca448/thanos-query/0.log"
Jul 13 07:51:35.229690 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.229668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc847896-2gtqt_6d3e825c-5ae2-4265-a86e-a681f5aca448/kube-rbac-proxy-web/0.log"
Jul 13 07:51:35.256791 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.256761    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc847896-2gtqt_6d3e825c-5ae2-4265-a86e-a681f5aca448/kube-rbac-proxy/0.log"
Jul 13 07:51:35.282424 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.282401    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc847896-2gtqt_6d3e825c-5ae2-4265-a86e-a681f5aca448/prom-label-proxy/0.log"
Jul 13 07:51:35.308283 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.308253    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc847896-2gtqt_6d3e825c-5ae2-4265-a86e-a681f5aca448/kube-rbac-proxy-rules/0.log"
Jul 13 07:51:35.338157 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:35.338131    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-dbc847896-2gtqt_6d3e825c-5ae2-4265-a86e-a681f5aca448/kube-rbac-proxy-metrics/0.log"
Jul 13 07:51:36.235583 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.235551    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"]
Jul 13 07:51:36.236142 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236083    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbe5e335-95dc-4698-bc2d-40f9b0d296f0" containerName="maas-api"
Jul 13 07:51:36.236142 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236108    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbe5e335-95dc-4698-bc2d-40f9b0d296f0" containerName="maas-api"
Jul 13 07:51:36.236142 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236123    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy"
Jul 13 07:51:36.236142 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236131    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236167    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b5536a-6a91-4518-86c5-2caee9d89bce" containerName="maas-api"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236176    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b5536a-6a91-4518-86c5-2caee9d89bce" containerName="maas-api"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236189    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a736be3-e215-4573-a240-8b7687fbe495" containerName="main"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236195    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a736be3-e215-4573-a240-8b7687fbe495" containerName="main"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236308    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236321    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df93d0d-bbec-4b8d-bec0-e6d19c2a7e3b" containerName="istio-proxy"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236332    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4b5536a-6a91-4518-86c5-2caee9d89bce" containerName="maas-api"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236344    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbe5e335-95dc-4698-bc2d-40f9b0d296f0" containerName="maas-api"
Jul 13 07:51:36.236476 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.236354    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a736be3-e215-4573-a240-8b7687fbe495" containerName="main"
Jul 13 07:51:36.239887 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.239871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.242578 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.242562    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzdq9\"/\"openshift-service-ca.crt\""
Jul 13 07:51:36.242694 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.242657    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tzdq9\"/\"default-dockercfg-ngqlr\""
Jul 13 07:51:36.243551 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.243536    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzdq9\"/\"kube-root-ca.crt\""
Jul 13 07:51:36.249700 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.249676    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"]
Jul 13 07:51:36.261668 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.261644    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-sys\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.261818 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.261678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-proc\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.261818 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.261709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-podres\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.261952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.261871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsbm\" (UniqueName: \"kubernetes.io/projected/7001d1f6-b5f4-497f-807b-5e6330983b4e-kube-api-access-zfsbm\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.261952 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.261920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-lib-modules\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363346 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsbm\" (UniqueName: \"kubernetes.io/projected/7001d1f6-b5f4-497f-807b-5e6330983b4e-kube-api-access-zfsbm\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363563 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-lib-modules\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363563 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-sys\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363563 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-proc\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363563 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-podres\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363720 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-sys\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363720 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-lib-modules\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363720 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-proc\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.363720 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.363686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7001d1f6-b5f4-497f-807b-5e6330983b4e-podres\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.372763 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.372734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsbm\" (UniqueName: \"kubernetes.io/projected/7001d1f6-b5f4-497f-807b-5e6330983b4e-kube-api-access-zfsbm\") pod \"perf-node-gather-daemonset-bbs5s\" (UID: \"7001d1f6-b5f4-497f-807b-5e6330983b4e\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.551047 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.551015    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:36.686530 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.686503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"]
Jul 13 07:51:36.687640 ip-10-0-130-143 kubenswrapper[2565]: W0713 07:51:36.687616    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7001d1f6_b5f4_497f_807b_5e6330983b4e.slice/crio-c37dbac48ca22fc0174de42cbc6259e22116cb90f9ee6f14e98ebeca87bb1695 WatchSource:0}: Error finding container c37dbac48ca22fc0174de42cbc6259e22116cb90f9ee6f14e98ebeca87bb1695: Status 404 returned error can't find the container with id c37dbac48ca22fc0174de42cbc6259e22116cb90f9ee6f14e98ebeca87bb1695
Jul 13 07:51:36.723907 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:36.723878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s" event={"ID":"7001d1f6-b5f4-497f-807b-5e6330983b4e","Type":"ContainerStarted","Data":"c37dbac48ca22fc0174de42cbc6259e22116cb90f9ee6f14e98ebeca87bb1695"}
Jul 13 07:51:37.730547 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:37.730512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s" event={"ID":"7001d1f6-b5f4-497f-807b-5e6330983b4e","Type":"ContainerStarted","Data":"9dca4051000d05481eb7e2f0e1b37b0522b615716ff17c39ce7549b132e0b942"}
Jul 13 07:51:37.730954 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:37.730650    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:37.748595 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:37.748548    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s" podStartSLOduration=1.748534668 podStartE2EDuration="1.748534668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:51:37.747427384 +0000 UTC m=+2363.454304719" watchObservedRunningTime="2026-07-13 07:51:37.748534668 +0000 UTC m=+2363.455411970"
Jul 13 07:51:37.790560 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:37.790531    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55c7957b67-gnjgj_a516935c-6cb8-491f-9e42-07a4858872ef/console/0.log"
Jul 13 07:51:39.592646 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:39.592614    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-652tj_52ec54b3-77a3-4621-84c2-389b259e09a3/dns/0.log"
Jul 13 07:51:39.621893 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:39.621848    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-652tj_52ec54b3-77a3-4621-84c2-389b259e09a3/kube-rbac-proxy/0.log"
Jul 13 07:51:39.793897 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:39.793874    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mz4lc_c8c26a1d-921b-489c-9928-40aa9b17cb16/dns-node-resolver/0.log"
Jul 13 07:51:40.497303 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:40.497271    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qklsz_3f3811e3-9b16-4cb2-b09e-2d4786a481b3/node-ca/0.log"
Jul 13 07:51:41.772830 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:41.772805    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f9f4ffd9-pf6nt_fba178f3-1b44-4985-b1ca-9d58f363e6bb/kube-auth-proxy/0.log"
Jul 13 07:51:42.771913 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:42.771887    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wvfbf_0b0a7b50-64d9-449a-bd65-75da8a38e2fe/serve-healthcheck-canary/0.log"
Jul 13 07:51:43.423850 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:43.423824    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dh42w_8bd1f393-12a6-4a56-8605-4c2f0c3def97/kube-rbac-proxy/0.log"
Jul 13 07:51:43.465630 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:43.465604    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dh42w_8bd1f393-12a6-4a56-8605-4c2f0c3def97/exporter/0.log"
Jul 13 07:51:43.507220 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:43.507198    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dh42w_8bd1f393-12a6-4a56-8605-4c2f0c3def97/extractor/0.log"
Jul 13 07:51:43.746081 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:43.745997    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-bbs5s"
Jul 13 07:51:46.314807 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:46.314775    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-f59f4fdbd-cgxcv_d0cd1a4e-298d-4c6d-b6a7-e0a2df1f72cc/maas-api/0.log"
Jul 13 07:51:46.469892 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:46.469820    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ddc5ffd7c-lkr5k_c9a6d0b3-f2c3-49b3-bbaa-1ac7aba54b2f/manager/0.log"
Jul 13 07:51:46.599266 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:46.599240    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-g74mr_c38903d9-ee12-4f3c-bbf9-4b58febef4a2/manager/0.log"
Jul 13 07:51:46.624487 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:46.624465    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-g74mr_c38903d9-ee12-4f3c-bbf9-4b58febef4a2/copy-manifests/0.log"
Jul 13 07:51:47.878822 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:47.878796    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f9f4ffd9-pf6nt_fba178f3-1b44-4985-b1ca-9d58f363e6bb/kube-auth-proxy/0.log"
Jul 13 07:51:48.276492 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:48.276462    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67b5465ff8-rhcf6_756c2732-84df-4f56-a0ac-e5ed20151036/manager/0.log"
Jul 13 07:51:48.346066 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:48.345979    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hkltz_c7ce0f70-7ee0-4fc8-af75-50d0d21d29cb/openshift-lws-operator/0.log"
Jul 13 07:51:49.350295 ip-10-0-130-143 kubenswrapper[2565]: I0713 07:51:49.350266    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f9f4ffd9-pf6nt_fba178f3-1b44-4985-b1ca-9d58f363e6bb/kube-auth-proxy/0.log"