Jul 07 14:05:01.531589 ip-10-0-132-63 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 14:05:01.531600 ip-10-0-132-63 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 14:05:01.531607 ip-10-0-132-63 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 14:05:01.531826 ip-10-0-132-63 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 14:05:11.750189 ip-10-0-132-63 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 14:05:11.750207 ip-10-0-132-63 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ddbd3ac96ddb4405904a78fa7894a278 --
Jul 07 14:07:15.054943 ip-10-0-132-63 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 14:07:15.414367 ip-10-0-132-63 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:07:15.414367 ip-10-0-132-63 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 14:07:15.414367 ip-10-0-132-63 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:07:15.414367 ip-10-0-132-63 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 14:07:15.414367 ip-10-0-132-63 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:07:15.415912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.415823    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 14:07:15.421366 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421339    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:07:15.421366 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421361    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:07:15.421366 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421369    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:07:15.421366 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421372    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421377    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421381    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421385    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421388    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421394    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421399    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421403    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421408    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421412    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421416    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421420    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421425    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421428    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421432    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421436    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421440    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421444    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421448    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:07:15.421623 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421452    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421456    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421460    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421463    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421467    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421471    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421476    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421480    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421483    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421491    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421495    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421499    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421503    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421507    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421513    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421517    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421522    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421526    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421540    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:07:15.422409 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421546    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421552    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421556    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421561    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421566    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421570    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421575    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421580    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421584    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421590    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421594    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421599    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421603    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421607    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421611    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421616    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421620    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421624    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421648    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:07:15.423221 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421654    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421658    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421662    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421666    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421670    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421675    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421679    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421683    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421689    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421693    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421697    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421701    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421706    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421710    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421714    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421718    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421722    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421726    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421731    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421735    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:07:15.424023 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421741    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421745    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421749    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421756    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421761    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421766    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421769    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421774    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421780    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421786    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421791    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421795    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421800    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421805    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421809    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421813    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421818    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421822    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.421827    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423020    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:07:15.424915 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423030    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423035    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423040    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423044    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423049    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423053    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423058    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423062    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423067    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423071    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423076    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423080    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423084    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423088    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423092    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423096    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423102    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423106    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423110    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423115    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:07:15.425775 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423119    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423123    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423127    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423132    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423136    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423140    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423145    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423149    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423153    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423157    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423161    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423166    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423173    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423178    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423183    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423188    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423192    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423200    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423204    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423208    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:07:15.426462 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423213    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423217    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423221    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423225    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423228    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423233    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423237    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423241    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423246    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423252    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423256    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423261    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423266    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423278    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423282    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423286    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423291    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423296    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423301    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:07:15.427058 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423305    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423309    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423313    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423317    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423322    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423326    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423330    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423334    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423339    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423344    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423351    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423356    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423360    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423364    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423368    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423372    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423376    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423380    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423387    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:07:15.427527 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423393    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423397    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423402    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423406    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423413    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423418    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423423    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423427    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423431    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423435    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423440    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423444    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423449    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423453    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423457    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423461    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423466    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423471    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423475    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.423479    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:07:15.428258 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424133    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424141    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424146    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424153    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424158    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424163    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424167    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424171    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424175    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424180    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424184    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424189    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424193    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424197    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424201    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424205    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424210    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424215    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424219    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424223    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:07:15.428797 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424227    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424232    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424236    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424240    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424244    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424248    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424253    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424257    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424261    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424265    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424270    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424274    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424278    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424282    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424286    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424292    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424296    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424301    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424305    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:07:15.429307 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424309    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424316    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424323    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424327    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424332    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424337    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424343    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424348    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424353    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424357    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424362    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424368    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424372    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424376    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424380    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424384    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424388    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424393    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424397    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:07:15.429992 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424402    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424408    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424413    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424418    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424423    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424427    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424432    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424437    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424441    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424447    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424451    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424456    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424460    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424464    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424468    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424482    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424486    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424493    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424498    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:07:15.430469 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424502    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424506    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424511    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424514    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424518    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424527    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424532    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424536    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424540    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424544    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424548    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424552    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424556    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424561    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424564    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424569    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424573    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424578    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424581    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424586    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:07:15.430955 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424590    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.424594    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424719    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424731    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424741    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424748    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424754    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424759    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424766    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424773    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424778    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424783    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424788    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424793    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424801    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424806    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424811    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424816    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424821    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424826    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424832    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424837    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424842    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424847    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 14:07:15.431471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424852    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424858    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424863    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424867    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424872    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424877    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424882    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424887    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424892    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424897    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424905    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424910    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424914    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424918    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424922    2564 flags.go:64] FLAG: --enable-server="true"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424927    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424936    2564 flags.go:64] FLAG: --event-burst="100"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424941    2564 flags.go:64] FLAG: --event-qps="50"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424945    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424950    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424955    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424961    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424968    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424973    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424978    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 07 14:07:15.432056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424982    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424986    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424992    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.424997    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425002    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425007    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425011    2564 flags.go:64] FLAG: --feature-gates=""
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425018    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425022    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425027    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425033    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425037    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425042    2564 flags.go:64] FLAG: --help="false"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425047    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425052    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425057    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425062    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425068    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425074    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425079    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425083    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425088    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425092    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 14:07:15.432754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425097    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425102    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425106    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425111    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425115    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425120    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425126    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425131    2564 flags.go:64] FLAG: --lock-file=""
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425136    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425140    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425145    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425154    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425160    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425165    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425169    2564 flags.go:64] FLAG: --logging-format="text"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425174    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425179    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425184    2564 flags.go:64] FLAG: --manifest-url=""
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425188    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425195    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425200    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425207    2564 flags.go:64] FLAG: --max-pods="110"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425212    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425217    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425222    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 14:07:15.433355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425226    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425231    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425236    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425241    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425253    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425258    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425262    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425267    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425271    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425280    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425285    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425290    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425294    2564 flags.go:64] FLAG: --port="10250"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425299    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425305    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0da90e0d4c6544406"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425311    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425316    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425320    2564 flags.go:64] FLAG: --register-node="true"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425325    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425331    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425336    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425341    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425345    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425352    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425356    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 14:07:15.434043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425361    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425366    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425370    2564 flags.go:64] FLAG: --runonce="false"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425375    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425380    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425384    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425389    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425393    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425399    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425403    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425408    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425413    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425418    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425422    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425426    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425431    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425436    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425441    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425449    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425453    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425458    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425466    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425470    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425475    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425479    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 14:07:15.434660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425484    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425489    2564 flags.go:64] FLAG: --v="2"
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425495    2564 flags.go:64] FLAG: --version="false"
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425503    2564 flags.go:64] FLAG: --vmodule=""
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425508    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.425513    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425724    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425731    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425735    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425741    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425746    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425751    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425755    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425760    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425764    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425769    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425773    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425777    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425780    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425784    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425788    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:07:15.435303 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425792    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425796    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425800    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425805    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425809    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425813    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425818    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425824    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425828    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425832    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425837    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425841    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425845    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425849    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425856    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425863    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425868    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425876    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425880    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425885    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:07:15.435827 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425889    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425894    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425898    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425902    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425907    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425912    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425916    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425921    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425925    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425929    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425933    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425937    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425941    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425946    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425950    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425954    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425958    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425962    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425966    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:07:15.436305 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425972    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425976    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425981    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425986    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425990    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425994    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.425998    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426005    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426010    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426014    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426021    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426026    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426031    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426036    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426040    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426045    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426049    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426054    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426058    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:07:15.436865 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426062    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426067    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426071    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426076    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426082    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426087    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426091    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426095    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426099    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426104    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426108    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426113    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426116    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426122    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426126    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426130    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426135    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426139    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426143    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426147    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:07:15.437324 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426151    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426156    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426160    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426166    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426171    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.426175    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.426809    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.434081    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.434096    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.434109    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.434114    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434168    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434174    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434178    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434181    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:07:15.437835 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434184    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434186    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434189    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434192    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434194    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434197    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434200    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434202    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434205    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434208    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434210    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434213    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434216    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434218    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434221    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434223    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434226    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434228    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434231    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:07:15.438198 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434233    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434236    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434238    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434241    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434244    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434247    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434250    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434253    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434256    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434258    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434261    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434263    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434266    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434269    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434271    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434274    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434276    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434278    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434281    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434283    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:07:15.438669 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434286    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434288    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434291    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434293    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434296    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434299    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434301    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434305    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434309    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434312    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434314    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434318    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434322    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434324    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434327    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434330    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434333    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434336    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434339    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:07:15.439158 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434342    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434345    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434347    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434350    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434353    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434356    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434358    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434361    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434363    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434366    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434368    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434371    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434373    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434375    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434378    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434380    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434383    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434386    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434388    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434391    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434393    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:07:15.439613 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434396    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434399    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434401    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434404    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434406    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434408    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434411    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434414    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434417    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434419    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434422    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434425    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434428    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434431    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434433    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:07:15.440138 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434437    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.434442    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434556    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434562    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434565    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434567    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434570    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434573    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434575    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434578    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434581    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434584    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434586    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434589    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434592    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:07:15.440499 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434594    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434597    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434599    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434602    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434604    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434607    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434610    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434612    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434615    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434617    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434620    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434623    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434626    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434643    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434647    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434652    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434655    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434658    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434660    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434663    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:07:15.440902 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434666    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434669    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434672    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434675    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434678    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434681    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434684    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434688    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434691    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434693    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434696    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434698    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434701    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434703    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434706    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434709    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434711    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434714    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434716    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434719    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:07:15.441401 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434721    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434724    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434727    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434730    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434732    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434735    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434738    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434740    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434743    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434746    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434749    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434752    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434754    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434757    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434759    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434762    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434765    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434767    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434770    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434772    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:07:15.441985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434775    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434777    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434780    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434783    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434785    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434788    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434790    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434793    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434795    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434798    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434800    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434803    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434805    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434808    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434810    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434813    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434816    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434818    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434821    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434823    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:07:15.442502 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434826    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434829    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434832    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434834    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434837    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:15.434841    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.434846    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.434959    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.437055    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.438380    2564 server.go:1019] "Starting client certificate rotation"
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.438476    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.439110    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 14:07:15.443343 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.441035    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 14:07:15.444344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.444317    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 14:07:15.454905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.454882    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 07 14:07:15.457152 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.457128    2564 log.go:25] "Validated CRI v1 image API"
Jul 07 14:07:15.458013 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.457996    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 14:07:15.463572 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.463548    2564 fs.go:135] Filesystem UUIDs: map[27842781-fde5-474a-b74b-c5368c0ebb38:/dev/nvme0n1p4 730eac57-419f-409f-af78-6521e006afce:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 07 14:07:15.463659 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.463572    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 14:07:15.469067 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.469048    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 14:07:15.469315 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.469200    2564 manager.go:216] Machine: {Timestamp:2026-07-07 14:07:15.467263808 +0000 UTC m=+0.298348287 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105204 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21d5b4f3080a5ff505ca6795b2d831 SystemUUID:ec21d5b4-f308-0a5f-f505-ca6795b2d831 BootID:ddbd3ac9-6ddb-4405-904a-78fa7894a278 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:e2:0c:61:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:e2:0c:61:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:7d:2b:59:f4:cc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 14:07:15.469315 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.469313    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 14:07:15.469434 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.469423    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 14:07:15.472590 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.472565    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 14:07:15.472738 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.472593    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 14:07:15.473378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.473369    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 14:07:15.473435 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.473381    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 14:07:15.473435 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.473389    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 14:07:15.473926 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.473916    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 14:07:15.475425 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.475415    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 14:07:15.478431 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.478420    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 14:07:15.478548 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.478539    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 14:07:15.478583 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.478569    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 14:07:15.478583 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.478580    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 14:07:15.478663 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.478596    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 14:07:15.478663 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.478608    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 07 14:07:15.478663 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.478619    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 14:07:15.479102 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.479087    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 14:07:15.479158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.479106    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 14:07:15.481209 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.481191    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 14:07:15.483357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.483343    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 14:07:15.483410 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.483379    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 14:07:15.484774 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484759    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 14:07:15.484774 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484775    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484781    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484788    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484796    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484802    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484811    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484816    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484822    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484828    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484836    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 14:07:15.484866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.484841    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 14:07:15.486158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.486141    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 14:07:15.486158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.486153    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 14:07:15.489495 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.489480    2564 server.go:1268] "Started kubelet"
Jul 07 14:07:15.489606 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.489551    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 14:07:15.490065 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.489971    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 14:07:15.490176 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.490144    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 14:07:15.490330 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.490311    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 14:07:15.490469 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.490450    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 14:07:15.490816 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.490793    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 14:07:15.491271 ip-10-0-132-63 systemd[1]: Started Kubernetes Kubelet.
Jul 07 14:07:15.491945 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.491857    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 14:07:15.494772 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.494754    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 14:07:15.496566 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.496545    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 14:07:15.498561 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.497841    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-63.ec2.internal.18c0071421f93c09  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-63.ec2.internal,UID:ip-10-0-132-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-63.ec2.internal,},FirstTimestamp:2026-07-07 14:07:15.489438729 +0000 UTC m=+0.320523207,LastTimestamp:2026-07-07 14:07:15.489438729 +0000 UTC m=+0.320523207,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-63.ec2.internal,}"
Jul 07 14:07:15.502183 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.502164    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 14:07:15.502183 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.502173    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 14:07:15.502334 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.502249    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:15.502890 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.502874    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 14:07:15.504763 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.504549    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 14:07:15.504865 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.504766    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 14:07:15.504865 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.504645    2564 factory.go:55] Registering systemd factory
Jul 07 14:07:15.504865 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.504842    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 07 14:07:15.505014 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.504909    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 14:07:15.505014 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.504917    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 14:07:15.505242 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.505229    2564 factory.go:153] Registering CRI-O factory
Jul 07 14:07:15.505308 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.505246    2564 factory.go:223] Registration of the crio container factory successfully
Jul 07 14:07:15.505359 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.505331    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 14:07:15.505359 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.505356    2564 factory.go:103] Registering Raw factory
Jul 07 14:07:15.505439 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.505373    2564 manager.go:1196] Started watching for new ooms in manager
Jul 07 14:07:15.505777 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.505749    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4rqcv"
Jul 07 14:07:15.505777 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.505771    2564 manager.go:349] Starting recovery of all containers
Jul 07 14:07:15.514279 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.514258    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4rqcv"
Jul 07 14:07:15.516582 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.516552    2564 manager.go:354] Recovery completed
Jul 07 14:07:15.516754 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.516726    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 14:07:15.516819 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.516766    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 14:07:15.520714 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.520699    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:07:15.523652 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.523605    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:07:15.523736 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.523680    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:07:15.523736 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.523700    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:07:15.525026 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.525009    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 14:07:15.525026 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.525017    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:07:15.525026 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.525024    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 14:07:15.525183 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.525041    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 14:07:15.525763 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.525745    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:07:15.525810 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.525782    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:07:15.525810 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.525799    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:07:15.526328 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.526318    2564 policy_none.go:49] "None policy: Start"
Jul 07 14:07:15.526360 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.526334    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 14:07:15.526360 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.526343    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 14:07:15.527357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.527346    2564 policy_none.go:47] "Start"
Jul 07 14:07:15.568265 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.568246    2564 manager.go:337] "Starting Device Plugin manager"
Jul 07 14:07:15.568364 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.568277    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 14:07:15.568364 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.568286    2564 server.go:87] "Starting device plugin registration server"
Jul 07 14:07:15.568596 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.568579    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 14:07:15.568707 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.568595    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 14:07:15.568707 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.568693    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 14:07:15.568830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.568797    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 14:07:15.568830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.568806    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 14:07:15.569289 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.569273    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 14:07:15.569360 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.569321    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:15.669783 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.669718    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:07:15.671005 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.670731    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:07:15.671005 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.670762    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:07:15.671005 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.670775    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:07:15.671005 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.670803    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.679353 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.679340    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.679402 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.679361    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-63.ec2.internal\": node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:15.696179 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.696159    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:15.706735 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.706701    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 14:07:15.708133 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.708110    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 14:07:15.708227 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.708148    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 14:07:15.708227 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.708168    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 14:07:15.708227 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.708202    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 14:07:15.710247 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.710218    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:07:15.796554 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.796509    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:15.809046 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.809023    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal"]
Jul 07 14:07:15.809115 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.809104    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:07:15.810105 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.810089    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:07:15.810158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.810126    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:07:15.810158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.810139    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:07:15.811602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.811589    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:07:15.811748 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.811734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.811800 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.811790    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:07:15.812368 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.812349    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:07:15.812485 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.812381    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:07:15.812485 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.812392    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:07:15.812485 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.812349    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:07:15.812485 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.812456    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:07:15.812485 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.812468    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:07:15.813766 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.813748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.813874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.813774    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:07:15.814555 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.814536    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:07:15.814679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.814565    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:07:15.814679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.814575    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:07:15.831200 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.831172    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-63.ec2.internal\" not found" node="ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.834602 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.834584    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-63.ec2.internal\" not found" node="ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.897252 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.897223    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:15.907909 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.907889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dc2be8de79f1759400ca5d82771f684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal\" (UID: \"2dc2be8de79f1759400ca5d82771f684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.907966 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.907915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc2be8de79f1759400ca5d82771f684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal\" (UID: \"2dc2be8de79f1759400ca5d82771f684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.907966 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:15.907945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f78f1e5224e3338e6765aa113711a8e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-63.ec2.internal\" (UID: \"4f78f1e5224e3338e6765aa113711a8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:15.998194 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:15.998123    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:16.008463 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.008444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc2be8de79f1759400ca5d82771f684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal\" (UID: \"2dc2be8de79f1759400ca5d82771f684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.008520 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.008469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f78f1e5224e3338e6765aa113711a8e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-63.ec2.internal\" (UID: \"4f78f1e5224e3338e6765aa113711a8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.008553 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.008537    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dc2be8de79f1759400ca5d82771f684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal\" (UID: \"2dc2be8de79f1759400ca5d82771f684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.008585 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.008537    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2dc2be8de79f1759400ca5d82771f684-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal\" (UID: \"2dc2be8de79f1759400ca5d82771f684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.008585 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.008561    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2dc2be8de79f1759400ca5d82771f684-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal\" (UID: \"2dc2be8de79f1759400ca5d82771f684\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.008585 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.008569    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4f78f1e5224e3338e6765aa113711a8e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-63.ec2.internal\" (UID: \"4f78f1e5224e3338e6765aa113711a8e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.098679 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:16.098623    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:16.135188 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.135161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.139564 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.139413    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.199497 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:16.199459    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:16.300045 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:16.299981    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:16.400399 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:16.400362    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:16.437841 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.437812    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 14:07:16.438417 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.437943    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 14:07:16.500517 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:16.500491    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-63.ec2.internal\" not found"
Jul 07 14:07:16.507926 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.507904    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:07:16.516513 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.516489    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:02:15 +0000 UTC" deadline="2027-12-31 12:50:26.643485657 +0000 UTC"
Jul 07 14:07:16.516513 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.516512    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13006h43m10.126976893s"
Jul 07 14:07:16.517069 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.517056    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:07:16.603174 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.603113    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.613038 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.613022    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 14:07:16.614737 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.614722    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal"
Jul 07 14:07:16.622350 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.622336    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 14:07:16.630853 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:16.630813    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc2be8de79f1759400ca5d82771f684.slice/crio-6874435cc7e4c1e4a66f362775ff6c5e4dcfd151b64928fcc7854ef043083caa WatchSource:0}: Error finding container 6874435cc7e4c1e4a66f362775ff6c5e4dcfd151b64928fcc7854ef043083caa: Status 404 returned error can't find the container with id 6874435cc7e4c1e4a66f362775ff6c5e4dcfd151b64928fcc7854ef043083caa
Jul 07 14:07:16.638596 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.638575    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:07:16.644695 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:16.644671    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f78f1e5224e3338e6765aa113711a8e.slice/crio-1120de419e1a19f74dc0db28ed4ff2b16a558c4ea74f16767ea447380bfe7dab WatchSource:0}: Error finding container 1120de419e1a19f74dc0db28ed4ff2b16a558c4ea74f16767ea447380bfe7dab: Status 404 returned error can't find the container with id 1120de419e1a19f74dc0db28ed4ff2b16a558c4ea74f16767ea447380bfe7dab
Jul 07 14:07:16.710893 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.710843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal" event={"ID":"4f78f1e5224e3338e6765aa113711a8e","Type":"ContainerStarted","Data":"1120de419e1a19f74dc0db28ed4ff2b16a558c4ea74f16767ea447380bfe7dab"}
Jul 07 14:07:16.711774 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:16.711744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal" event={"ID":"2dc2be8de79f1759400ca5d82771f684","Type":"ContainerStarted","Data":"6874435cc7e4c1e4a66f362775ff6c5e4dcfd151b64928fcc7854ef043083caa"}
Jul 07 14:07:17.035447 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.035381    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:07:17.479484 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.479415    2564 apiserver.go:52] "Watching apiserver"
Jul 07 14:07:17.489025 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.489001    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 14:07:17.489385 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.489355    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-pdqh5","openshift-ovn-kubernetes/ovnkube-node-mhc9l","kube-system/global-pull-secret-syncer-s67dg","kube-system/konnectivity-agent-kwpfm","kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm","openshift-cluster-node-tuning-operator/tuned-qxwp6","openshift-dns/node-resolver-65fwj","openshift-image-registry/node-ca-xr9q6","openshift-multus/multus-additional-cni-plugins-9cl87","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal","openshift-multus/multus-9zx27","openshift-multus/network-metrics-daemon-8zsw6","openshift-network-diagnostics/network-check-target-bzgws"]
Jul 07 14:07:17.490726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.490706    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.491718 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.491702    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.492723 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.492707    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.492811 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.492763    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:17.493227 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.493206    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 14:07:17.493312 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.493206    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:07:17.493717 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.493700    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:17.493811 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.493792    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hp492\""
Jul 07 14:07:17.494050 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.494031    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 14:07:17.494728 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.494710    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 14:07:17.494728 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.494726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sw88v\""
Jul 07 14:07:17.494863 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.494844    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.495895 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.495878    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 14:07:17.495895 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.495891    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 14:07:17.496195 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.496173    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.496323 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.496275    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lk78f\""
Jul 07 14:07:17.497113 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.497096    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:07:17.497532 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.497515    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-76jk8\""
Jul 07 14:07:17.497736 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.497720    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 14:07:17.497824 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.497779    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.497886 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.497725    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 14:07:17.498773 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.498716    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 14:07:17.498901 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.498883    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 14:07:17.499013 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.498998    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lvxfx\""
Jul 07 14:07:17.499358 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.499344    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 14:07:17.500015 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.499981    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:17.500157 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.500132    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:17.502221 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.501853    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.502298 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.502280    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 14:07:17.502384 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.502328    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jlfm\""
Jul 07 14:07:17.502837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.502284    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 14:07:17.502913 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.502844    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 14:07:17.502913 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.502892    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 14:07:17.503431 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.503413    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.505162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.504853    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 14:07:17.505162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.504882    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 14:07:17.505162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.505052    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 14:07:17.505162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.505061    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 14:07:17.505162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.505081    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2474k\""
Jul 07 14:07:17.505836 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.505817    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:17.505904 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.505882    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:17.506235 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.506216    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 14:07:17.506376 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.506352    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 14:07:17.506448 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.506404    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d95kk\""
Jul 07 14:07:17.506448 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.506426    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 14:07:17.506579 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.506564    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 14:07:17.506656 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.506592    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 14:07:17.506656 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.506651    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 14:07:17.507205 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.507192    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.507552 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.507533    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 14:07:17.509355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.509242    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fvc6h\""
Jul 07 14:07:17.509548 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.509532    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 14:07:17.515292 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515274    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 14:07:17.515369 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysctl-conf\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.515369 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-systemd\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.515369 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-etc-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.515369 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m68qh\" (UniqueName: \"kubernetes.io/projected/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-kube-api-access-m68qh\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-run-netns\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-kubernetes\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-var-lib-kubelet\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l8n5\" (UniqueName: \"kubernetes.io/projected/682db57e-e0d7-4e29-a1b2-7bd91ec36481-kube-api-access-2l8n5\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-device-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-system-cni-dir\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovnkube-config\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-sys\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9swjb\" (UniqueName: \"kubernetes.io/projected/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-kube-api-access-9swjb\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.515775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jkfw\" (UniqueName: \"kubernetes.io/projected/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-kube-api-access-2jkfw\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-slash\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515866    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-systemd\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-node-log\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682db57e-e0d7-4e29-a1b2-7bd91ec36481-tmp\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mk2q\" (UniqueName: \"kubernetes.io/projected/d38dc807-0614-472c-910d-f076695deb91-kube-api-access-8mk2q\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18a01f98-93bb-4b3e-8786-f20c762b3b0b-serviceca\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.515982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-226mh\" (UniqueName: \"kubernetes.io/projected/18a01f98-93bb-4b3e-8786-f20c762b3b0b-kube-api-access-226mh\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-systemd-units\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-tmp-dir\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-socket-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-registration-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516113    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovnkube-script-lib\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516143    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9543d7a4-1d14-4bf6-badf-95b774682013-kubelet-config\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-cni-bin\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-log-socket\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovn-node-metrics-cert\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysconfig\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d38dc807-0614-472c-910d-f076695deb91-host-slash\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d38dc807-0614-472c-910d-f076695deb91-iptables-alerter-script\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-tuned\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83dd5e8e-402f-48b9-a913-1b0eb178101f-konnectivity-ca\") pod \"konnectivity-agent-kwpfm\" (UID: \"83dd5e8e-402f-48b9-a913-1b0eb178101f\") " pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdkfz\" (UniqueName: \"kubernetes.io/projected/0e18eb63-f577-4035-af15-9ece40255edb-kube-api-access-wdkfz\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9543d7a4-1d14-4bf6-badf-95b774682013-dbus\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-var-lib-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-cni-netd\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-hosts-file\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-sys-fs\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.516815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-kubelet\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-host\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516586    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-cnibin\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-os-release\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516649    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a01f98-93bb-4b3e-8786-f20c762b3b0b-host\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516687    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-env-overrides\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysctl-d\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-lib-modules\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516741    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-cni-binary-copy\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-modprobe-d\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-run\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83dd5e8e-402f-48b9-a913-1b0eb178101f-agent-certs\") pod \"konnectivity-agent-kwpfm\" (UID: \"83dd5e8e-402f-48b9-a913-1b0eb178101f\") " pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516845    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j54t8\" (UniqueName: \"kubernetes.io/projected/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-kube-api-access-j54t8\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.517344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.516858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-ovn\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.535160 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.535137    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6rr24"
Jul 07 14:07:17.545490 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.545465    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6rr24"
Jul 07 14:07:17.606224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.605791    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 14:07:17.617834 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.617794    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.617834 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.617834    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-env-overrides\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618020 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.617858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysctl-d\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618020 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.617905    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618020 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.617985    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysctl-d\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618020 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-lib-modules\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-cni-binary-copy\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.618179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.618179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-modprobe-d\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-run\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-socket-dir-parent\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.618179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618155    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-lib-modules\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83dd5e8e-402f-48b9-a913-1b0eb178101f-agent-certs\") pod \"konnectivity-agent-kwpfm\" (UID: \"83dd5e8e-402f-48b9-a913-1b0eb178101f\") " pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j54t8\" (UniqueName: \"kubernetes.io/projected/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-kube-api-access-j54t8\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618210    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-run\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-ovn\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysctl-conf\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618253    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-ovn\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-systemd\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-hostroot\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618310    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-systemd\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-multus-certs\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618336    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-env-overrides\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-etc-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618367    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-etc-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618405    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-modprobe-d\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m68qh\" (UniqueName: \"kubernetes.io/projected/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-kube-api-access-m68qh\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618494    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysctl-conf\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618529    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618567    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-cni-binary-copy\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618587    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-cni-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618612    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-cni-binary-copy\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-cni-bin\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-run-netns\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-kubernetes\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618764    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-run-netns\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618775    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618787    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-var-lib-kubelet\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618861    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-kubernetes\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l8n5\" (UniqueName: \"kubernetes.io/projected/682db57e-e0d7-4e29-a1b2-7bd91ec36481-kube-api-access-2l8n5\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.618980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-os-release\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.618944    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-var-lib-kubelet\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-device-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-system-cni-dir\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619119    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-system-cni-dir\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovnkube-config\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-sys\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619192    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-device-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-k8s-cni-cncf-io\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-kubelet\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9swjb\" (UniqueName: \"kubernetes.io/projected/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-kube-api-access-9swjb\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkfw\" (UniqueName: \"kubernetes.io/projected/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-kube-api-access-2jkfw\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-slash\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619496    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-slash\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-systemd\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.619711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619575    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-sys\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-node-log\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619646    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovnkube-config\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619671    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-node-log\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682db57e-e0d7-4e29-a1b2-7bd91ec36481-tmp\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-cnibin\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619759    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-run-systemd\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mk2q\" (UniqueName: \"kubernetes.io/projected/d38dc807-0614-472c-910d-f076695deb91-kube-api-access-8mk2q\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18a01f98-93bb-4b3e-8786-f20c762b3b0b-serviceca\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619895    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-226mh\" (UniqueName: \"kubernetes.io/projected/18a01f98-93bb-4b3e-8786-f20c762b3b0b-kube-api-access-226mh\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-systemd-units\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.619992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-cni-multus\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620005    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e18eb63-f577-4035-af15-9ece40255edb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620055    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-systemd-units\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8l9\" (UniqueName: \"kubernetes.io/projected/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-kube-api-access-cf8l9\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-tmp-dir\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.620418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-socket-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620193    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-registration-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-netns\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620232    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-socket-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-conf-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620220    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/18a01f98-93bb-4b3e-8786-f20c762b3b0b-serviceca\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620265    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-registration-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovnkube-script-lib\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620306    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-daemon-config\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9543d7a4-1d14-4bf6-badf-95b774682013-kubelet-config\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-cni-bin\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-system-cni-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620435    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-tmp-dir\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620441    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9543d7a4-1d14-4bf6-badf-95b774682013-kubelet-config\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-log-socket\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.620522    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:17.621159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620589    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-cni-bin\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.620603    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret podName:9543d7a4-1d14-4bf6-badf-95b774682013 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:18.120563911 +0000 UTC m=+2.951648378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret") pod "global-pull-secret-syncer-s67dg" (UID: "9543d7a4-1d14-4bf6-badf-95b774682013") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620641    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-log-socket\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovn-node-metrics-cert\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysconfig\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620738    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovnkube-script-lib\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620742    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d38dc807-0614-472c-910d-f076695deb91-host-slash\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d38dc807-0614-472c-910d-f076695deb91-iptables-alerter-script\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620783    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d38dc807-0614-472c-910d-f076695deb91-host-slash\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-tuned\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.620823    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.620865    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:18.120851006 +0000 UTC m=+2.951935473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620825    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-sysconfig\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83dd5e8e-402f-48b9-a913-1b0eb178101f-konnectivity-ca\") pod \"konnectivity-agent-kwpfm\" (UID: \"83dd5e8e-402f-48b9-a913-1b0eb178101f\") " pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdkfz\" (UniqueName: \"kubernetes.io/projected/0e18eb63-f577-4035-af15-9ece40255edb-kube-api-access-wdkfz\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.621874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9543d7a4-1d14-4bf6-badf-95b774682013-dbus\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-var-lib-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-cni-netd\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.620984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-etc-kubernetes\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-hosts-file\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-sys-fs\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-kubelet\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-host\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-cnibin\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621165    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-os-release\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a01f98-93bb-4b3e-8786-f20c762b3b0b-host\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621256    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18a01f98-93bb-4b3e-8786-f20c762b3b0b-host\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621282    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d38dc807-0614-472c-910d-f076695deb91-iptables-alerter-script\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621299    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/682db57e-e0d7-4e29-a1b2-7bd91ec36481-host\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621304    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-sys-fs\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.631905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621309    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621258    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83dd5e8e-402f-48b9-a913-1b0eb178101f-konnectivity-ca\") pod \"konnectivity-agent-kwpfm\" (UID: \"83dd5e8e-402f-48b9-a913-1b0eb178101f\") " pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621339    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-kubelet\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621344    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621348    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-cnibin\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621167    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-hosts-file\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621256    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9543d7a4-1d14-4bf6-badf-95b774682013-dbus\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621357    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-host-cni-netd\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621393    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-var-lib-openvswitch\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.621403    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e18eb63-f577-4035-af15-9ece40255edb-os-release\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.622307    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/682db57e-e0d7-4e29-a1b2-7bd91ec36481-tmp\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.622712    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83dd5e8e-402f-48b9-a913-1b0eb178101f-agent-certs\") pod \"konnectivity-agent-kwpfm\" (UID: \"83dd5e8e-402f-48b9-a913-1b0eb178101f\") " pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.623233    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/682db57e-e0d7-4e29-a1b2-7bd91ec36481-etc-tuned\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.623444    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-ovn-node-metrics-cert\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.630873    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l8n5\" (UniqueName: \"kubernetes.io/projected/682db57e-e0d7-4e29-a1b2-7bd91ec36481-kube-api-access-2l8n5\") pod \"tuned-qxwp6\" (UID: \"682db57e-e0d7-4e29-a1b2-7bd91ec36481\") " pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.631161    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j54t8\" (UniqueName: \"kubernetes.io/projected/bd0a6bee-456e-48e1-a82a-dd514a9ae2f5-kube-api-access-j54t8\") pod \"aws-ebs-csi-driver-node-8ttvm\" (UID: \"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.631211    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jkfw\" (UniqueName: \"kubernetes.io/projected/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-kube-api-access-2jkfw\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:17.632708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.631725    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m68qh\" (UniqueName: \"kubernetes.io/projected/5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85-kube-api-access-m68qh\") pod \"ovnkube-node-mhc9l\" (UID: \"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.633902 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.633883    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-226mh\" (UniqueName: \"kubernetes.io/projected/18a01f98-93bb-4b3e-8786-f20c762b3b0b-kube-api-access-226mh\") pod \"node-ca-xr9q6\" (UID: \"18a01f98-93bb-4b3e-8786-f20c762b3b0b\") " pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.634543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.634524    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mk2q\" (UniqueName: \"kubernetes.io/projected/d38dc807-0614-472c-910d-f076695deb91-kube-api-access-8mk2q\") pod \"iptables-alerter-pdqh5\" (UID: \"d38dc807-0614-472c-910d-f076695deb91\") " pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.636052 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.636032    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdkfz\" (UniqueName: \"kubernetes.io/projected/0e18eb63-f577-4035-af15-9ece40255edb-kube-api-access-wdkfz\") pod \"multus-additional-cni-plugins-9cl87\" (UID: \"0e18eb63-f577-4035-af15-9ece40255edb\") " pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.636219 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.636200    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9swjb\" (UniqueName: \"kubernetes.io/projected/6d939d2a-40f6-4fec-8cc8-3c0e5334d502-kube-api-access-9swjb\") pod \"node-resolver-65fwj\" (UID: \"6d939d2a-40f6-4fec-8cc8-3c0e5334d502\") " pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.722408 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-cnibin\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722408 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-cni-multus\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8l9\" (UniqueName: \"kubernetes.io/projected/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-kube-api-access-cf8l9\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-netns\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-conf-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-daemon-config\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-system-cni-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-etc-kubernetes\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-socket-dir-parent\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.722704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-hostroot\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722710    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-multus-certs\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-cni-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-cni-binary-copy\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-cni-bin\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-os-release\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-k8s-cni-cncf-io\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-kubelet\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722926    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-kubelet\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.722983    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-cnibin\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723018    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-cni-multus\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723480 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723281    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-netns\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723480 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723324    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-conf-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723700    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-multus-certs\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723719    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-var-lib-cni-bin\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723785    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-os-release\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723807    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-cni-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723820    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-system-cni-dir\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723830    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-socket-dir-parent\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723875    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-hostroot\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.723912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723881    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-host-run-k8s-cni-cncf-io\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.724261 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723919    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-multus-daemon-config\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.724261 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.723965    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-etc-kubernetes\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.724261 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.724160    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-cni-binary-copy\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.728576 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.728549    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:17.728576 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.728577    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:17.728768 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.728592    2564 projected.go:196] Error preparing data for projected volume kube-api-access-4vvth for pod openshift-network-diagnostics/network-check-target-bzgws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:17.728768 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:17.728680    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth podName:d21858e8-100e-489e-a126-6ed0e5e2928b nodeName:}" failed. No retries permitted until 2026-07-07 14:07:18.228662368 +0000 UTC m=+3.059746834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4vvth" (UniqueName: "kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth") pod "network-check-target-bzgws" (UID: "d21858e8-100e-489e-a126-6ed0e5e2928b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:17.730511 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.730467    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8l9\" (UniqueName: \"kubernetes.io/projected/13a7cdea-0bcf-475c-8ae6-f105edf86bc9-kube-api-access-cf8l9\") pod \"multus-9zx27\" (UID: \"13a7cdea-0bcf-475c-8ae6-f105edf86bc9\") " pod="openshift-multus/multus-9zx27"
Jul 07 14:07:17.805726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.805692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qxwp6"
Jul 07 14:07:17.812357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.812331    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-65fwj"
Jul 07 14:07:17.819781 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.819757    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:17.825735 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.825716    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pdqh5"
Jul 07 14:07:17.832316 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.832296    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm"
Jul 07 14:07:17.844778 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.844758    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xr9q6"
Jul 07 14:07:17.852498 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.852480    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:17.857312 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.857297    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9cl87"
Jul 07 14:07:17.862923 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:17.862903    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9zx27"
Jul 07 14:07:18.012795 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.012723    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:07:18.125447 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.125412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:18.125447 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.125451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:18.125707 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.125555    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:18.125707 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.125564    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:18.125707 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.125603    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:19.125589464 +0000 UTC m=+3.956673929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:18.125707 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.125619    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret podName:9543d7a4-1d14-4bf6-badf-95b774682013 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:19.12561027 +0000 UTC m=+3.956694735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret") pod "global-pull-secret-syncer-s67dg" (UID: "9543d7a4-1d14-4bf6-badf-95b774682013") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:18.326326 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.326242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:18.326481 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.326402    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:18.326481 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.326423    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:18.326481 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.326434    2564 projected.go:196] Error preparing data for projected volume kube-api-access-4vvth for pod openshift-network-diagnostics/network-check-target-bzgws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:18.326623 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.326488    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth podName:d21858e8-100e-489e-a126-6ed0e5e2928b nodeName:}" failed. No retries permitted until 2026-07-07 14:07:19.326468924 +0000 UTC m=+4.157553392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vvth" (UniqueName: "kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth") pod "network-check-target-bzgws" (UID: "d21858e8-100e-489e-a126-6ed0e5e2928b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:18.548507 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.548290    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:02:17 +0000 UTC" deadline="2028-04-08 14:44:19.032781408 +0000 UTC"
Jul 07 14:07:18.548507 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.548501    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15384h37m0.484283931s"
Jul 07 14:07:18.687694 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:18.687576    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8f4e2b_ae39_4dc3_a7cf_7c4dcc303d85.slice/crio-353976d85229c4be0d0ab6b3025c55febe6b693a99cf19ad65947590beec4525 WatchSource:0}: Error finding container 353976d85229c4be0d0ab6b3025c55febe6b693a99cf19ad65947590beec4525: Status 404 returned error can't find the container with id 353976d85229c4be0d0ab6b3025c55febe6b693a99cf19ad65947590beec4525
Jul 07 14:07:18.690106 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:18.689412    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0a6bee_456e_48e1_a82a_dd514a9ae2f5.slice/crio-5b4adbd18ed0ca6b596b40f88b67fef215b7aa3298514bdfecf42ba2e973a425 WatchSource:0}: Error finding container 5b4adbd18ed0ca6b596b40f88b67fef215b7aa3298514bdfecf42ba2e973a425: Status 404 returned error can't find the container with id 5b4adbd18ed0ca6b596b40f88b67fef215b7aa3298514bdfecf42ba2e973a425
Jul 07 14:07:18.691339 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:18.691258    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a01f98_93bb_4b3e_8786_f20c762b3b0b.slice/crio-c979a52b094fa0016292ed89dda4f7a41e7b7f8f3803e96ffb9405205f66731b WatchSource:0}: Error finding container c979a52b094fa0016292ed89dda4f7a41e7b7f8f3803e96ffb9405205f66731b: Status 404 returned error can't find the container with id c979a52b094fa0016292ed89dda4f7a41e7b7f8f3803e96ffb9405205f66731b
Jul 07 14:07:18.693377 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:18.693271    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a7cdea_0bcf_475c_8ae6_f105edf86bc9.slice/crio-29dcaebce0a7b7c0c80383d738775b93e3ca951a1496042d4124c84c40e1b938 WatchSource:0}: Error finding container 29dcaebce0a7b7c0c80383d738775b93e3ca951a1496042d4124c84c40e1b938: Status 404 returned error can't find the container with id 29dcaebce0a7b7c0c80383d738775b93e3ca951a1496042d4124c84c40e1b938
Jul 07 14:07:18.694378 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:18.694362    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38dc807_0614_472c_910d_f076695deb91.slice/crio-0aad7bc1a2b5df7ea42fd53a33472bff5930efbca0984438583904ee9ead5a9d WatchSource:0}: Error finding container 0aad7bc1a2b5df7ea42fd53a33472bff5930efbca0984438583904ee9ead5a9d: Status 404 returned error can't find the container with id 0aad7bc1a2b5df7ea42fd53a33472bff5930efbca0984438583904ee9ead5a9d
Jul 07 14:07:18.708954 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.708932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:18.709048 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.709028    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:18.709048 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.709038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:18.709138 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.709031    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:18.709138 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.709111    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:18.709210 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:18.709153    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:18.716621 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.716598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zx27" event={"ID":"13a7cdea-0bcf-475c-8ae6-f105edf86bc9","Type":"ContainerStarted","Data":"29dcaebce0a7b7c0c80383d738775b93e3ca951a1496042d4124c84c40e1b938"}
Jul 07 14:07:18.717817 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.717776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerStarted","Data":"a0ae9ed960fe0c2e77fded62b34f2ce4bb1ff4cccd5bedde7811dd25bbd9537b"}
Jul 07 14:07:18.718946 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.718926    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"353976d85229c4be0d0ab6b3025c55febe6b693a99cf19ad65947590beec4525"}
Jul 07 14:07:18.720110 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.720082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qxwp6" event={"ID":"682db57e-e0d7-4e29-a1b2-7bd91ec36481","Type":"ContainerStarted","Data":"fea12f950640814596788b717208fab40167579e6ab4b8e8be36d4f05417888e"}
Jul 07 14:07:18.721099 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.721082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-65fwj" event={"ID":"6d939d2a-40f6-4fec-8cc8-3c0e5334d502","Type":"ContainerStarted","Data":"88f98ca8b3860105f1d0a111681b00f496e93e50427ee29cbddd6a93ad2d28a7"}
Jul 07 14:07:18.722163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.722142    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pdqh5" event={"ID":"d38dc807-0614-472c-910d-f076695deb91","Type":"ContainerStarted","Data":"0aad7bc1a2b5df7ea42fd53a33472bff5930efbca0984438583904ee9ead5a9d"}
Jul 07 14:07:18.723200 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.723177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kwpfm" event={"ID":"83dd5e8e-402f-48b9-a913-1b0eb178101f","Type":"ContainerStarted","Data":"11118f1bda422aacbd4f715ac731d6c4d275579de65180515646ce8cbb73915f"}
Jul 07 14:07:18.724289 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.724267    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xr9q6" event={"ID":"18a01f98-93bb-4b3e-8786-f20c762b3b0b","Type":"ContainerStarted","Data":"c979a52b094fa0016292ed89dda4f7a41e7b7f8f3803e96ffb9405205f66731b"}
Jul 07 14:07:18.725255 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:18.725181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm" event={"ID":"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5","Type":"ContainerStarted","Data":"5b4adbd18ed0ca6b596b40f88b67fef215b7aa3298514bdfecf42ba2e973a425"}
Jul 07 14:07:19.131551 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.131499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:19.131551 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.131549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:19.131807 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:19.131680    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:19.131807 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:19.131692    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:19.131807 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:19.131755    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:21.13173778 +0000 UTC m=+5.962822248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:19.131807 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:19.131770    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret podName:9543d7a4-1d14-4bf6-badf-95b774682013 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:21.131763973 +0000 UTC m=+5.962848438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret") pod "global-pull-secret-syncer-s67dg" (UID: "9543d7a4-1d14-4bf6-badf-95b774682013") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:19.333158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.333072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:19.333320 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:19.333260    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:19.333320 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:19.333283    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:19.333320 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:19.333295    2564 projected.go:196] Error preparing data for projected volume kube-api-access-4vvth for pod openshift-network-diagnostics/network-check-target-bzgws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:19.333463 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:19.333358    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth podName:d21858e8-100e-489e-a126-6ed0e5e2928b nodeName:}" failed. No retries permitted until 2026-07-07 14:07:21.333339511 +0000 UTC m=+6.164423978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vvth" (UniqueName: "kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth") pod "network-check-target-bzgws" (UID: "d21858e8-100e-489e-a126-6ed0e5e2928b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:19.549590 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.549503    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:02:17 +0000 UTC" deadline="2028-02-17 11:35:39.754391352 +0000 UTC"
Jul 07 14:07:19.549590 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.549558    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14157h28m20.20483725s"
Jul 07 14:07:19.746754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.745888    2564 generic.go:356] "Generic (PLEG): container finished" podID="2dc2be8de79f1759400ca5d82771f684" containerID="5d86348cd2fd667afbed2b569e39dd211cc895e623361d6c9d1dce264ace0450" exitCode=0
Jul 07 14:07:19.746754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.746048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal" event={"ID":"2dc2be8de79f1759400ca5d82771f684","Type":"ContainerDied","Data":"5d86348cd2fd667afbed2b569e39dd211cc895e623361d6c9d1dce264ace0450"}
Jul 07 14:07:19.752722 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.752140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal" event={"ID":"4f78f1e5224e3338e6765aa113711a8e","Type":"ContainerStarted","Data":"734e569f261dab19e69bb95c2e9287a6fa5bd12aaabe982690cf7e7df592fac9"}
Jul 07 14:07:19.779811 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:19.779557    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-63.ec2.internal" podStartSLOduration=3.779536077 podStartE2EDuration="3.779536077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:19.778781855 +0000 UTC m=+4.609866343" watchObservedRunningTime="2026-07-07 14:07:19.779536077 +0000 UTC m=+4.610620607"
Jul 07 14:07:20.709364 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:20.709332    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:20.709869 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:20.709473    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:20.709927 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:20.709870    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:20.710010 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:20.709988    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:20.710070 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:20.710054    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:20.710150 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:20.710129    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:20.769929 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:20.769826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal" event={"ID":"2dc2be8de79f1759400ca5d82771f684","Type":"ContainerStarted","Data":"379a23943d89c47efef8de53a14fe70cd22090a045f5de2c8f4a14ec1763133f"}
Jul 07 14:07:21.148342 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:21.148254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:21.148342 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:21.148308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:21.148564 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:21.148438    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:21.148564 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:21.148499    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:25.148481874 +0000 UTC m=+9.979566352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:21.148925 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:21.148906    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:21.149006 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:21.148963    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret podName:9543d7a4-1d14-4bf6-badf-95b774682013 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:25.148947585 +0000 UTC m=+9.980032067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret") pod "global-pull-secret-syncer-s67dg" (UID: "9543d7a4-1d14-4bf6-badf-95b774682013") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:21.350166 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:21.350127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:21.350355 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:21.350312    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:21.350355 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:21.350339    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:21.350355 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:21.350352    2564 projected.go:196] Error preparing data for projected volume kube-api-access-4vvth for pod openshift-network-diagnostics/network-check-target-bzgws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:21.350497 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:21.350418    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth podName:d21858e8-100e-489e-a126-6ed0e5e2928b nodeName:}" failed. No retries permitted until 2026-07-07 14:07:25.350397739 +0000 UTC m=+10.181482212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vvth" (UniqueName: "kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth") pod "network-check-target-bzgws" (UID: "d21858e8-100e-489e-a126-6ed0e5e2928b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:22.708716 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:22.708677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:22.709124 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:22.708819    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:22.709124 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:22.708925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:22.709124 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:22.709048    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:22.709124 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:22.709104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:22.709348 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:22.709185    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:24.708657 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:24.708587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:24.709125 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:24.708799    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:24.709201 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:24.709143    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:24.709258 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:24.709237    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:24.709317 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:24.709288    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:24.709381 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:24.709361    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:25.183848 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:25.183759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:25.183848 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:25.183801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:25.184061 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:25.183980    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:25.184061 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:25.184044    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:33.184024978 +0000 UTC m=+18.015109450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:25.184304 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:25.184271    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:25.184383 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:25.184343    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret podName:9543d7a4-1d14-4bf6-badf-95b774682013 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:33.184325178 +0000 UTC m=+18.015409650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret") pod "global-pull-secret-syncer-s67dg" (UID: "9543d7a4-1d14-4bf6-badf-95b774682013") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:25.385533 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:25.385492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:25.385786 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:25.385716    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:25.385786 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:25.385739    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:25.385786 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:25.385752    2564 projected.go:196] Error preparing data for projected volume kube-api-access-4vvth for pod openshift-network-diagnostics/network-check-target-bzgws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:25.385928 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:25.385813    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth podName:d21858e8-100e-489e-a126-6ed0e5e2928b nodeName:}" failed. No retries permitted until 2026-07-07 14:07:33.385792815 +0000 UTC m=+18.216877284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vvth" (UniqueName: "kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth") pod "network-check-target-bzgws" (UID: "d21858e8-100e-489e-a126-6ed0e5e2928b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:26.709396 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:26.709309    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:26.709869 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:26.709310    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:26.709869 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:26.709451    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:26.709869 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:26.709536    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:26.709869 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:26.709316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:26.709869 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:26.709625    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:28.710121 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:28.709348    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:28.710121 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:28.709491    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:28.710121 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:28.709875    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:28.710121 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:28.709974    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:28.710121 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:28.710017    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:28.710121 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:28.710082    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:29.790546 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:29.790423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerStarted","Data":"9c5f85d2b056442263c8303f6a479c303d61c603a58f53b92f2e9e2f52de8fed"}
Jul 07 14:07:29.792532 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:29.792497    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-65fwj" event={"ID":"6d939d2a-40f6-4fec-8cc8-3c0e5334d502","Type":"ContainerStarted","Data":"ef917da94717da776845d3fbcb75f68991a25ded84b1c1b8f03754c6abd32fb6"}
Jul 07 14:07:29.794505 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:29.794475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kwpfm" event={"ID":"83dd5e8e-402f-48b9-a913-1b0eb178101f","Type":"ContainerStarted","Data":"07d8599e96dae7f78c563dfbd9b9d03ddf67866001a87ddb1004f8ed54ff8f89"}
Jul 07 14:07:29.797682 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:29.797660    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xr9q6" event={"ID":"18a01f98-93bb-4b3e-8786-f20c762b3b0b","Type":"ContainerStarted","Data":"78d10499343582a21da43c0064f0fcac315f8623f5de3d73b4d9f00f84640f52"}
Jul 07 14:07:29.813385 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:29.813345    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-63.ec2.internal" podStartSLOduration=13.813330179 podStartE2EDuration="13.813330179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:20.78637582 +0000 UTC m=+5.617460308" watchObservedRunningTime="2026-07-07 14:07:29.813330179 +0000 UTC m=+14.644414666"
Jul 07 14:07:29.827362 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:29.827325    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xr9q6" podStartSLOduration=4.378885253 podStartE2EDuration="14.827310206s" totalImagesPullingTime="10.448424953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:29.827159921 +0000 UTC m=+14.658244408" watchObservedRunningTime="2026-07-07 14:07:29.827310206 +0000 UTC m=+14.658394692"
Jul 07 14:07:29.843532 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:29.843484    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-65fwj" podStartSLOduration=4.392100858 podStartE2EDuration="14.843469625s" totalImagesPullingTime="10.451368767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:29.843322537 +0000 UTC m=+14.674407025" watchObservedRunningTime="2026-07-07 14:07:29.843469625 +0000 UTC m=+14.674554123"
Jul 07 14:07:29.858206 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:29.858154    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kwpfm" podStartSLOduration=4.4311556979999995 podStartE2EDuration="14.858135851s" totalImagesPullingTime="10.426980153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:29.857691963 +0000 UTC m=+14.688776470" watchObservedRunningTime="2026-07-07 14:07:29.858135851 +0000 UTC m=+14.689220342"
Jul 07 14:07:30.403328 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:30.403297    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:30.403917 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:30.403893    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:30.708855 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:30.708768    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:30.709003 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:30.708902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:30.709067 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:30.709010    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:30.709067 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:30.708904    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:30.709153 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:30.708898    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:30.709202 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:30.709148    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:30.801461 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:30.801388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pdqh5" event={"ID":"d38dc807-0614-472c-910d-f076695deb91","Type":"ContainerStarted","Data":"325f82ca9c95571fb3a2daa6f32b5020573ca4141a105c3c67ecf7bef84db3e4"}
Jul 07 14:07:30.817930 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:30.817884    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pdqh5" podStartSLOduration=5.372470056 podStartE2EDuration="15.817869587s" totalImagesPullingTime="10.445399531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:30.81732016 +0000 UTC m=+15.648404648" watchObservedRunningTime="2026-07-07 14:07:30.817869587 +0000 UTC m=+15.648954075"
Jul 07 14:07:31.803743 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:31.803709    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 14:07:32.708862 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:32.708825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:32.709053 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:32.708825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:32.709053 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:32.708965    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:32.709053 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:32.708825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:32.709053 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:32.709040    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:32.709214 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:32.709135    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:33.249466 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:33.249435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:33.249466 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:33.249470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:33.250354 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:33.249575    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:33.250354 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:33.249580    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:33.250354 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:33.249644    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:49.249613493 +0000 UTC m=+34.080697958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:33.250354 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:33.249662    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret podName:9543d7a4-1d14-4bf6-badf-95b774682013 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:49.249652461 +0000 UTC m=+34.080736932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret") pod "global-pull-secret-syncer-s67dg" (UID: "9543d7a4-1d14-4bf6-badf-95b774682013") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:33.450481 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:33.450441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:33.450680 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:33.450650    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:33.450680 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:33.450675    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:33.450798 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:33.450689    2564 projected.go:196] Error preparing data for projected volume kube-api-access-4vvth for pod openshift-network-diagnostics/network-check-target-bzgws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:33.450798 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:33.450757    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth podName:d21858e8-100e-489e-a126-6ed0e5e2928b nodeName:}" failed. No retries permitted until 2026-07-07 14:07:49.45073721 +0000 UTC m=+34.281821678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vvth" (UniqueName: "kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth") pod "network-check-target-bzgws" (UID: "d21858e8-100e-489e-a126-6ed0e5e2928b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:33.810014 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:33.809976    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e18eb63-f577-4035-af15-9ece40255edb" containerID="9c5f85d2b056442263c8303f6a479c303d61c603a58f53b92f2e9e2f52de8fed" exitCode=0
Jul 07 14:07:33.810175 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:33.810035    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerDied","Data":"9c5f85d2b056442263c8303f6a479c303d61c603a58f53b92f2e9e2f52de8fed"}
Jul 07 14:07:34.709416 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:34.709388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:34.709416 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:34.709419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:34.709858 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:34.709388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:34.709858 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:34.709504    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:34.709858 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:34.709562    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:34.709858 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:34.709657    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:36.708493 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:36.708460    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:36.708917 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:36.708498    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:36.708917 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:36.708462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:36.708917 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:36.708592    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:36.708917 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:36.708654    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:36.708917 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:36.708752    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:37.291518 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.291484    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:37.291917 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.291663    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 14:07:37.292251 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.292209    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kwpfm"
Jul 07 14:07:37.818977 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.818651    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm" event={"ID":"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5","Type":"ContainerStarted","Data":"ca256756783db85da4ccdfbea3585bb250ac25d1e951ee59a6e7ca9290bfb954"}
Jul 07 14:07:37.820111 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.820090    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9zx27" event={"ID":"13a7cdea-0bcf-475c-8ae6-f105edf86bc9","Type":"ContainerStarted","Data":"3bebab8150d4da1ee3f1116c4325888d03fff46c48f6dc50ef8139b8c9793095"}
Jul 07 14:07:37.822163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.822143    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"558b992ca261435421aa9f4fbb2f8004301a5e81b4a860e7c34e32f4efc19be3"}
Jul 07 14:07:37.822245 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.822222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"8a557079e0ea07cd87323c022d5dcaf8d113b5cf3d5e5c6edc6a7ec04e58e0f7"}
Jul 07 14:07:37.822313 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.822252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"205b16fce6dcd7fc6aa7f62cec1a51c12dbad8567d50bf860d2a46cbf2fe1e6a"}
Jul 07 14:07:37.823374 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.823331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qxwp6" event={"ID":"682db57e-e0d7-4e29-a1b2-7bd91ec36481","Type":"ContainerStarted","Data":"a55a21c2d3ee5788cc68c0273e7735441a3419a8c28519de787efcbe99c2beea"}
Jul 07 14:07:37.841609 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.841556    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9zx27" podStartSLOduration=4.023278042 podStartE2EDuration="22.841541783s" totalImagesPullingTime="18.818263741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:37.838352978 +0000 UTC m=+22.669437457" watchObservedRunningTime="2026-07-07 14:07:37.841541783 +0000 UTC m=+22.672626270"
Jul 07 14:07:37.856181 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:37.856144    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qxwp6" podStartSLOduration=4.08380036 podStartE2EDuration="22.856130538s" totalImagesPullingTime="18.772330178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:37.856120788 +0000 UTC m=+22.687205274" watchObservedRunningTime="2026-07-07 14:07:37.856130538 +0000 UTC m=+22.687215025"
Jul 07 14:07:38.708606 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:38.708578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:38.708805 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:38.708578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:38.708805 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:38.708726    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:38.708805 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:38.708578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:38.708805 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:38.708790    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:38.709032 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:38.708880    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:38.828905 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:38.828868    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"fb72309db6bedeaae518cf26260abfc52a2e6ffbd60587c1963ec1290d00edfe"}
Jul 07 14:07:38.829337 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:38.828939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"6740abc9bc3fcb5769195e67546777af558aa58cb7c2240e6f003621c65a314d"}
Jul 07 14:07:38.829337 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:38.828974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"53d307f608eb675b162f4d52fcdb6a9a4b3f62675c49a3ecbb7373cd7063f0a9"}
Jul 07 14:07:39.200648 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:39.200606    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 14:07:39.581152 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:39.580959    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:07:39.200643355Z","UUID":"2c913a1b-9df0-4e62-bbcd-96ea7706ce83","Handler":null,"Name":"","Endpoint":""}
Jul 07 14:07:39.582455 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:39.582436    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 14:07:39.582580 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:39.582472    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 14:07:39.833784 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:39.833704    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm" event={"ID":"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5","Type":"ContainerStarted","Data":"5d66b26f79a869eddfc9285c770380b6058db0eac6e7825d8ed9b5bd2b965bbe"}
Jul 07 14:07:40.708879 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:40.708838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:40.708879 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:40.708865    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:40.709071 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:40.708968    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:40.709071 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:40.708979    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:40.709071 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:40.709045    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:40.709165 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:40.709099    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:40.840353 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:40.840315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"06f57e5761df1c02314165987442c76c35348bd68f23d53e7be9d391e60f7308"}
Jul 07 14:07:40.842649 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:40.842603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm" event={"ID":"bd0a6bee-456e-48e1-a82a-dd514a9ae2f5","Type":"ContainerStarted","Data":"6b77294ef1360995a8fc559dc6dc25e2f170b27332a0be4661ab32420d19c1d5"}
Jul 07 14:07:40.862515 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:40.862469    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8ttvm" podStartSLOduration=12.693159193 podStartE2EDuration="25.862455838s" totalImagesPullingTime="13.169296645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:40.862002622 +0000 UTC m=+25.693087108" watchObservedRunningTime="2026-07-07 14:07:40.862455838 +0000 UTC m=+25.693540326"
Jul 07 14:07:42.709024 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:42.708943    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:42.709024 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:42.708970    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:42.709660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:42.709065    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:42.709660 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:42.709080    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:42.709660 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:42.709176    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:42.709660 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:42.709262    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:43.852647 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.852379    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" event={"ID":"5c8f4e2b-ae39-4dc3-a7cf-7c4dcc303d85","Type":"ContainerStarted","Data":"b301db18f22bd908447d35f12cc584aabda9c5478efc1f9dfbb4e72670f4a373"}
Jul 07 14:07:43.853149 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.852718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:43.853149 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.852771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:43.853149 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.852815    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:43.859441 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.859414    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e18eb63-f577-4035-af15-9ece40255edb" containerID="f1dbb846f5a1aeb0f738156a8c286af28c02f3899eb1ccafd1afe78c9a1d2706" exitCode=0
Jul 07 14:07:43.859592 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.859452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerDied","Data":"f1dbb846f5a1aeb0f738156a8c286af28c02f3899eb1ccafd1afe78c9a1d2706"}
Jul 07 14:07:43.869478 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.869457    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:43.869582 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.869572    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:07:43.886458 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:43.886415    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l" podStartSLOduration=10.044054803 podStartE2EDuration="28.886401997s" totalImagesPullingTime="18.842347194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:43.885972192 +0000 UTC m=+28.717056680" watchObservedRunningTime="2026-07-07 14:07:43.886401997 +0000 UTC m=+28.717486493"
Jul 07 14:07:44.708687 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:44.708615    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:44.709266 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:44.709234    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:44.709410 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:44.708859    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:44.709583 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:44.709563    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:44.709712 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:44.708818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:44.709906 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:44.709880    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:45.410255 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:45.408051    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s67dg"]
Jul 07 14:07:45.410255 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:45.408168    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:45.410255 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:45.408278    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:45.410255 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:45.409722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzgws"]
Jul 07 14:07:45.410255 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:45.409798    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:45.410255 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:45.409876    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:45.410885 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:45.410797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8zsw6"]
Jul 07 14:07:45.410885 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:45.410880    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:45.411022 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:45.410980    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:45.865814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:45.865573    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e18eb63-f577-4035-af15-9ece40255edb" containerID="1b10b3c7985b9e1b205c57ff7139452bfe2e6c482cafa772904afaa52b31c716" exitCode=0
Jul 07 14:07:45.865965 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:45.865662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerDied","Data":"1b10b3c7985b9e1b205c57ff7139452bfe2e6c482cafa772904afaa52b31c716"}
Jul 07 14:07:46.708940 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:46.708898    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:46.709310 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:46.708951    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:46.709310 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:46.709016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:46.709310 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:46.709036    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:46.709310 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:46.709085    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:46.709310 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:46.709158    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:47.872622 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:47.872533    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e18eb63-f577-4035-af15-9ece40255edb" containerID="09fef599270577d1bcb5f5139c5674b4ef9479256e4527ced52f58e5c2101d38" exitCode=0
Jul 07 14:07:47.872622 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:47.872595    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerDied","Data":"09fef599270577d1bcb5f5139c5674b4ef9479256e4527ced52f58e5c2101d38"}
Jul 07 14:07:48.708936 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:48.708907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:48.709095 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:48.708907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:48.709095 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:48.709003    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzgws" podUID="d21858e8-100e-489e-a126-6ed0e5e2928b"
Jul 07 14:07:48.709095 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:48.709023    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:48.709197 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:48.709098    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:07:48.709197 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:48.709146    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s67dg" podUID="9543d7a4-1d14-4bf6-badf-95b774682013"
Jul 07 14:07:49.267980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:49.267942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:49.267980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:49.267977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:49.268380 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:49.268082    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:49.268380 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:49.268084    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:49.268380 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:49.268137    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret podName:9543d7a4-1d14-4bf6-badf-95b774682013 nodeName:}" failed. No retries permitted until 2026-07-07 14:08:21.268122737 +0000 UTC m=+66.099207202 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret") pod "global-pull-secret-syncer-s67dg" (UID: "9543d7a4-1d14-4bf6-badf-95b774682013") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:49.268380 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:49.268151    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:08:21.26814432 +0000 UTC m=+66.099228785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:49.470224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:49.470186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:49.470378 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:49.470320    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:49.470378 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:49.470337    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:49.470378 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:49.470345    2564 projected.go:196] Error preparing data for projected volume kube-api-access-4vvth for pod openshift-network-diagnostics/network-check-target-bzgws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:49.470480 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:49.470400    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth podName:d21858e8-100e-489e-a126-6ed0e5e2928b nodeName:}" failed. No retries permitted until 2026-07-07 14:08:21.470384759 +0000 UTC m=+66.301469231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4vvth" (UniqueName: "kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth") pod "network-check-target-bzgws" (UID: "d21858e8-100e-489e-a126-6ed0e5e2928b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:50.009691 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.009666    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-63.ec2.internal" event="NodeReady"
Jul 07 14:07:50.009845 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.009777    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 14:07:50.063709 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.063602    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bnq5v"]
Jul 07 14:07:50.065418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.065403    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kj7vc"]
Jul 07 14:07:50.065533 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.065517    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.067116 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.067087    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kj7vc"
Jul 07 14:07:50.068128 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.068108    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 14:07:50.068231 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.068170    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cxvss\""
Jul 07 14:07:50.069093 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.069075    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 14:07:50.069718 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.069698    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 14:07:50.069802 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.069720    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sfsdl\""
Jul 07 14:07:50.069802 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.069761    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 14:07:50.070030 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.070015    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 14:07:50.088602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.088539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kj7vc"]
Jul 07 14:07:50.089479 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.089460    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bnq5v"]
Jul 07 14:07:50.174295 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.174220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0-cert\") pod \"ingress-canary-kj7vc\" (UID: \"7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0\") " pod="openshift-ingress-canary/ingress-canary-kj7vc"
Jul 07 14:07:50.174295 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.174255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-tmp-dir\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.174295 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.174294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4j5x\" (UniqueName: \"kubernetes.io/projected/7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0-kube-api-access-v4j5x\") pod \"ingress-canary-kj7vc\" (UID: \"7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0\") " pod="openshift-ingress-canary/ingress-canary-kj7vc"
Jul 07 14:07:50.174499 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.174369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.174499 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.174410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbg47\" (UniqueName: \"kubernetes.io/projected/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-kube-api-access-bbg47\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.174499 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.174486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-config-volume\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.275618 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.275579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4j5x\" (UniqueName: \"kubernetes.io/projected/7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0-kube-api-access-v4j5x\") pod \"ingress-canary-kj7vc\" (UID: \"7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0\") " pod="openshift-ingress-canary/ingress-canary-kj7vc"
Jul 07 14:07:50.276224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.275656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.276224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.275685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbg47\" (UniqueName: \"kubernetes.io/projected/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-kube-api-access-bbg47\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.276224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.275740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-config-volume\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.276224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.275774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0-cert\") pod \"ingress-canary-kj7vc\" (UID: \"7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0\") " pod="openshift-ingress-canary/ingress-canary-kj7vc"
Jul 07 14:07:50.276224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.275799    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-tmp-dir\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.276224 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:50.275829    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:50.276224 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:50.275900    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:07:50.775878871 +0000 UTC m=+35.606963356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:50.276224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.276174    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-tmp-dir\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.276615 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.276541    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-config-volume\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.280819 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.280793    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0-cert\") pod \"ingress-canary-kj7vc\" (UID: \"7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0\") " pod="openshift-ingress-canary/ingress-canary-kj7vc"
Jul 07 14:07:50.284106 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.284083    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbg47\" (UniqueName: \"kubernetes.io/projected/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-kube-api-access-bbg47\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.284417 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.284399    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4j5x\" (UniqueName: \"kubernetes.io/projected/7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0-kube-api-access-v4j5x\") pod \"ingress-canary-kj7vc\" (UID: \"7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0\") " pod="openshift-ingress-canary/ingress-canary-kj7vc"
Jul 07 14:07:50.380604 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.380564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kj7vc"
Jul 07 14:07:50.514216 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.514013    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kj7vc"]
Jul 07 14:07:50.518868 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:07:50.518842    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb99be6_6d69_4ba6_a51e_f7d3daf9f6c0.slice/crio-26dfa1e8cbbf0d4e6d9fc56bad03516325d30c4413c68fb06d6e112f7188b273 WatchSource:0}: Error finding container 26dfa1e8cbbf0d4e6d9fc56bad03516325d30c4413c68fb06d6e112f7188b273: Status 404 returned error can't find the container with id 26dfa1e8cbbf0d4e6d9fc56bad03516325d30c4413c68fb06d6e112f7188b273
Jul 07 14:07:50.708901 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.708798    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:07:50.708901 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.708820    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:07:50.708901 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.708841    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:07:50.711822 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.711803    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:07:50.712936 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.712907    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:07:50.712936 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.712918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:07:50.713078 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.712918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d5l84\""
Jul 07 14:07:50.713078 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.712918    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wgdzp\""
Jul 07 14:07:50.713078 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.712908    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:07:50.779552 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.779517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:50.779734 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:50.779676    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:50.779795 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:50.779756    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:07:51.779735026 +0000 UTC m=+36.610819496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:50.882055 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:50.882021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kj7vc" event={"ID":"7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0","Type":"ContainerStarted","Data":"26dfa1e8cbbf0d4e6d9fc56bad03516325d30c4413c68fb06d6e112f7188b273"}
Jul 07 14:07:51.787062 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:51.786989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:51.787450 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:51.787156    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:51.787450 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:51.787221    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:07:53.787204373 +0000 UTC m=+38.618288841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:53.801349 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:53.801312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:53.801827 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:53.801497    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:53.801827 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:53.801558    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:07:57.801539124 +0000 UTC m=+42.632623596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:56.899270 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:56.899229    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kj7vc" event={"ID":"7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0","Type":"ContainerStarted","Data":"a0642da6f56b75c1957c40740ee1ed748edcafcbec92751be20d150ef0c784f5"}
Jul 07 14:07:56.916024 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:56.915481    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kj7vc" podStartSLOduration=0.68996573 podStartE2EDuration="6.915461171s" totalImagesPullingTime="6.225495441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:56.914863826 +0000 UTC m=+41.745948313" watchObservedRunningTime="2026-07-07 14:07:56.915461171 +0000 UTC m=+41.746545659"
Jul 07 14:07:57.830852 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:57.830808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:07:57.831025 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:57.830953    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:57.831025 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:07:57.831012    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:08:05.830996921 +0000 UTC m=+50.662081386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:57.903869 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:57.903832    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e18eb63-f577-4035-af15-9ece40255edb" containerID="efcf3a115c6677df8908019979bbebe5c5c1a023dbb1833fd73ce6346cec891d" exitCode=0
Jul 07 14:07:57.904233 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:57.903903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerDied","Data":"efcf3a115c6677df8908019979bbebe5c5c1a023dbb1833fd73ce6346cec891d"}
Jul 07 14:07:58.909342 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:58.909309    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e18eb63-f577-4035-af15-9ece40255edb" containerID="c6910ca70dd961e35a6517bf83b643106c9695c6f88037d32dac083c0c39302a" exitCode=0
Jul 07 14:07:58.909802 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:58.909381    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerDied","Data":"c6910ca70dd961e35a6517bf83b643106c9695c6f88037d32dac083c0c39302a"}
Jul 07 14:07:59.916890 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:59.916854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cl87" event={"ID":"0e18eb63-f577-4035-af15-9ece40255edb","Type":"ContainerStarted","Data":"d34ffc06eedaae00326c4f008d7b20b18a454c75f471915d8e4e98c67db6c7fb"}
Jul 07 14:07:59.943954 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:07:59.943902    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9cl87" podStartSLOduration=12.824878991 podStartE2EDuration="44.943886627s" totalImagesPullingTime="32.119007636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:59.942237271 +0000 UTC m=+44.773321758" watchObservedRunningTime="2026-07-07 14:07:59.943886627 +0000 UTC m=+44.774971111"
Jul 07 14:08:05.890599 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:05.890545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:08:05.891209 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:08:05.890751    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:08:05.891209 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:08:05.890841    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:08:21.890818245 +0000 UTC m=+66.721902715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:08:15.877207 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:15.877179    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhc9l"
Jul 07 14:08:21.301228 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.301178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:08:21.301228 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.301231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:08:21.304300 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.304277    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:08:21.304359 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.304316    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:08:21.311704 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:08:21.311680    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 14:08:21.311823 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:08:21.311753    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:25.31173568 +0000 UTC m=+130.142820145 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : secret "metrics-daemon-secret" not found
Jul 07 14:08:21.315012 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.314989    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9543d7a4-1d14-4bf6-badf-95b774682013-original-pull-secret\") pod \"global-pull-secret-syncer-s67dg\" (UID: \"9543d7a4-1d14-4bf6-badf-95b774682013\") " pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:08:21.320937 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.320918    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s67dg"
Jul 07 14:08:21.442098 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.442070    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s67dg"]
Jul 07 14:08:21.445570 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:08:21.445544    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9543d7a4_1d14_4bf6_badf_95b774682013.slice/crio-c9dc755d9fbbaa2c4e59952feac7e446f74c27b76281de0b9a488d535b092707 WatchSource:0}: Error finding container c9dc755d9fbbaa2c4e59952feac7e446f74c27b76281de0b9a488d535b092707: Status 404 returned error can't find the container with id c9dc755d9fbbaa2c4e59952feac7e446f74c27b76281de0b9a488d535b092707
Jul 07 14:08:21.503252 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.503191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:08:21.506129 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.506107    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:08:21.516064 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.516037    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:08:21.526672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.526643    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vvth\" (UniqueName: \"kubernetes.io/projected/d21858e8-100e-489e-a126-6ed0e5e2928b-kube-api-access-4vvth\") pod \"network-check-target-bzgws\" (UID: \"d21858e8-100e-489e-a126-6ed0e5e2928b\") " pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:08:21.629827 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.629803    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d5l84\""
Jul 07 14:08:21.638264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.638249    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:08:21.763623 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.763571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzgws"]
Jul 07 14:08:21.769428 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:08:21.769401    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21858e8_100e_489e_a126_6ed0e5e2928b.slice/crio-8f94fac4119bcbe47c28271df2e5e083cd8262d8535b7181476d6a4fecadac0b WatchSource:0}: Error finding container 8f94fac4119bcbe47c28271df2e5e083cd8262d8535b7181476d6a4fecadac0b: Status 404 returned error can't find the container with id 8f94fac4119bcbe47c28271df2e5e083cd8262d8535b7181476d6a4fecadac0b
Jul 07 14:08:21.906252 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.906170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:08:21.906391 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:08:21.906335    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:08:21.906447 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:08:21.906411    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:08:53.906392693 +0000 UTC m=+98.737477163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:08:21.967290 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.967240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzgws" event={"ID":"d21858e8-100e-489e-a126-6ed0e5e2928b","Type":"ContainerStarted","Data":"8f94fac4119bcbe47c28271df2e5e083cd8262d8535b7181476d6a4fecadac0b"}
Jul 07 14:08:21.968588 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:21.968556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s67dg" event={"ID":"9543d7a4-1d14-4bf6-badf-95b774682013","Type":"ContainerStarted","Data":"c9dc755d9fbbaa2c4e59952feac7e446f74c27b76281de0b9a488d535b092707"}
Jul 07 14:08:27.986274 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:27.986240    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzgws" event={"ID":"d21858e8-100e-489e-a126-6ed0e5e2928b","Type":"ContainerStarted","Data":"9392385896b7dac19308dbb2347bee070bb7ec87b016505a8db073a2332720bb"}
Jul 07 14:08:27.986726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:27.986326    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:08:27.987645 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:27.987611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s67dg" event={"ID":"9543d7a4-1d14-4bf6-badf-95b774682013","Type":"ContainerStarted","Data":"4e1d87276498f7e9e306a0bdbc44d59d8dedfbc19f28d2fe560f6a1e69e4bf56"}
Jul 07 14:08:28.004315 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:28.004271    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bzgws" podStartSLOduration=67.812719906 podStartE2EDuration="1m13.004258353s" totalImagesPullingTime="5.191538447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:28.003482223 +0000 UTC m=+72.834566710" watchObservedRunningTime="2026-07-07 14:08:28.004258353 +0000 UTC m=+72.835342837"
Jul 07 14:08:28.020297 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:28.020248    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s67dg" podStartSLOduration=67.493457358 podStartE2EDuration="1m13.020234675s" totalImagesPullingTime="5.526777317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:28.01941741 +0000 UTC m=+72.850501899" watchObservedRunningTime="2026-07-07 14:08:28.020234675 +0000 UTC m=+72.851319161"
Jul 07 14:08:53.925700 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:53.925656    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:08:53.926186 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:08:53.925805    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:08:53.926186 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:08:53.925901    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:09:57.92588323 +0000 UTC m=+162.756967696 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:08:58.992810 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:08:58.992785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bzgws"
Jul 07 14:09:25.328837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:09:25.328793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:09:25.329339 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:09:25.328906    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 14:09:25.329339 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:09:25.328966    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs podName:664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:27.328948867 +0000 UTC m=+252.160033336 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs") pod "network-metrics-daemon-8zsw6" (UID: "664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563") : secret "metrics-daemon-secret" not found
Jul 07 14:09:53.076174 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:09:53.076126    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bnq5v" podUID="4be4ed7e-4a00-4ab0-8b9c-02276c6511cf"
Jul 07 14:09:53.185376 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:09:53.185342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:09:53.733308 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:09:53.733266    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8zsw6" podUID="664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563"
Jul 07 14:09:57.953682 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:09:57.953606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:09:57.954300 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:09:57.953782    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:09:57.954300 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:09:57.953885    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls podName:4be4ed7e-4a00-4ab0-8b9c-02276c6511cf nodeName:}" failed. No retries permitted until 2026-07-07 14:11:59.953862965 +0000 UTC m=+284.784947431 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls") pod "dns-default-bnq5v" (UID: "4be4ed7e-4a00-4ab0-8b9c-02276c6511cf") : secret "dns-default-metrics-tls" not found
Jul 07 14:10:07.709091 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:07.709010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:10:23.973415 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.973374    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vxntv"]
Jul 07 14:10:23.975360 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.975344    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76bd7978f-vbn26"]
Jul 07 14:10:23.975497 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.975477    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:23.976909 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.976888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:23.979027 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.979002    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 14:10:23.979404 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.979385    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:10:23.979404 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.979408    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 14:10:23.980850 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.980824    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 14:10:23.980850 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.980841    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 14:10:23.981011 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.980995    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n7fn9\""
Jul 07 14:10:23.981072 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.981047    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 14:10:23.981072 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.981058    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 14:10:23.981183 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.981131    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 14:10:23.981183 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.981144    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 14:10:23.981448 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.981429    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 14:10:23.982894 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.982478    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vmw6m\""
Jul 07 14:10:23.986270 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.986252    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 14:10:23.995960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:23.995939    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vxntv"]
Jul 07 14:10:24.001357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.001335    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76bd7978f-vbn26"]
Jul 07 14:10:24.066239 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.066212    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-594lf"]
Jul 07 14:10:24.068244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.068219    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw"]
Jul 07 14:10:24.068383 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.068354    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:24.070153 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.070136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw"
Jul 07 14:10:24.070431 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.070403    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx"]
Jul 07 14:10:24.071929 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.071901    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx"
Jul 07 14:10:24.074812 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.074647    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6bgrm\""
Jul 07 14:10:24.074939 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.074909    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 14:10:24.076295 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.076276    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 14:10:24.076394 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.076331    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7xwqn\""
Jul 07 14:10:24.076394 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.076353    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 14:10:24.076524 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.076434    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:10:24.076602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.076582    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7tnnr\""
Jul 07 14:10:24.083563 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.083540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw"]
Jul 07 14:10:24.084754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.084734    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-594lf"]
Jul 07 14:10:24.086368 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.086345    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx"]
Jul 07 14:10:24.130805 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.130734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.130805 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.130776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wll6d\" (UniqueName: \"kubernetes.io/projected/9870b139-e587-4211-a0f3-210bf678bb37-kube-api-access-wll6d\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.131058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.130825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ba46223-105a-42fa-911d-7a49fb4d061a-trusted-ca\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.131058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.130863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ba46223-105a-42fa-911d-7a49fb4d061a-serving-cert\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.131058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.130940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-default-certificate\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.131058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.130988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mjdp\" (UniqueName: \"kubernetes.io/projected/6ba46223-105a-42fa-911d-7a49fb4d061a-kube-api-access-6mjdp\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.131058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.131005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-stats-auth\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.131058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.131030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ba46223-105a-42fa-911d-7a49fb4d061a-config\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.131058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.131051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.181246 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.181214    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"]
Jul 07 14:10:24.183317 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.183294    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.186137 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.186113    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 14:10:24.186137 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.186128    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 14:10:24.186328 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.186128    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:10:24.186328 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.186262    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 14:10:24.186533 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.186517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mfqjl\""
Jul 07 14:10:24.192383 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.192359    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"]
Jul 07 14:10:24.232383 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ba46223-105a-42fa-911d-7a49fb4d061a-config\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.232383 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.232383 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.232679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wll6d\" (UniqueName: \"kubernetes.io/projected/9870b139-e587-4211-a0f3-210bf678bb37-kube-api-access-wll6d\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.232679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232436    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:24.232679 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.232471    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:10:24.232679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ba46223-105a-42fa-911d-7a49fb4d061a-trusted-ca\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.232679 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.232542    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:24.732520437 +0000 UTC m=+189.563604904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : secret "router-metrics-certs-default" not found
Jul 07 14:10:24.232679 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.232603    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:24.732576024 +0000 UTC m=+189.563660489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : configmap references non-existent config key: service-ca.crt
Jul 07 14:10:24.232679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wzv7\" (UniqueName: \"kubernetes.io/projected/0b772ab1-4124-4a24-950a-b11aa9f090d0-kube-api-access-2wzv7\") pod \"network-check-source-989f8b8dc-8qhsx\" (UID: \"0b772ab1-4124-4a24-950a-b11aa9f090d0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx"
Jul 07 14:10:24.232679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd6t2\" (UniqueName: \"kubernetes.io/projected/ada37b9b-b6df-4438-8103-a24766866f67-kube-api-access-cd6t2\") pod \"volume-data-source-validator-5d456fdbcd-rhslw\" (UID: \"ada37b9b-b6df-4438-8103-a24766866f67\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw"
Jul 07 14:10:24.233075 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ba46223-105a-42fa-911d-7a49fb4d061a-serving-cert\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.233075 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-default-certificate\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.233075 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1f5e365-9efd-4a80-b21c-5b446aab6340-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:24.233075 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232832    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mjdp\" (UniqueName: \"kubernetes.io/projected/6ba46223-105a-42fa-911d-7a49fb4d061a-kube-api-access-6mjdp\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.233075 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.232856    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-stats-auth\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.233293 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.233273    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ba46223-105a-42fa-911d-7a49fb4d061a-config\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.233336 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.233306    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ba46223-105a-42fa-911d-7a49fb4d061a-trusted-ca\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.235417 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.235394    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-stats-auth\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.235620 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.235604    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ba46223-105a-42fa-911d-7a49fb4d061a-serving-cert\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.235728 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.235712    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-default-certificate\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.241608 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.241583    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mjdp\" (UniqueName: \"kubernetes.io/projected/6ba46223-105a-42fa-911d-7a49fb4d061a-kube-api-access-6mjdp\") pod \"console-operator-68b757fb67-vxntv\" (UID: \"6ba46223-105a-42fa-911d-7a49fb4d061a\") " pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.242214 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.242196    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wll6d\" (UniqueName: \"kubernetes.io/projected/9870b139-e587-4211-a0f3-210bf678bb37-kube-api-access-wll6d\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.286007 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.285963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:24.334211 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.334180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:24.334378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.334244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzv7\" (UniqueName: \"kubernetes.io/projected/0b772ab1-4124-4a24-950a-b11aa9f090d0-kube-api-access-2wzv7\") pod \"network-check-source-989f8b8dc-8qhsx\" (UID: \"0b772ab1-4124-4a24-950a-b11aa9f090d0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx"
Jul 07 14:10:24.334378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.334275    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd6t2\" (UniqueName: \"kubernetes.io/projected/ada37b9b-b6df-4438-8103-a24766866f67-kube-api-access-cd6t2\") pod \"volume-data-source-validator-5d456fdbcd-rhslw\" (UID: \"ada37b9b-b6df-4438-8103-a24766866f67\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw"
Jul 07 14:10:24.334378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.334310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.334378 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.334352    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 14:10:24.334557 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.334342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29z6z\" (UniqueName: \"kubernetes.io/projected/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-kube-api-access-29z6z\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.340040 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.334760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.340040 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.335294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1f5e365-9efd-4a80-b21c-5b446aab6340-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:24.340040 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.335412    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert podName:b1f5e365-9efd-4a80-b21c-5b446aab6340 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:24.83538814 +0000 UTC m=+189.666472618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-594lf" (UID: "b1f5e365-9efd-4a80-b21c-5b446aab6340") : secret "networking-console-plugin-cert" not found
Jul 07 14:10:24.340040 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.336119    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b1f5e365-9efd-4a80-b21c-5b446aab6340-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:24.346173 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.346141    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd6t2\" (UniqueName: \"kubernetes.io/projected/ada37b9b-b6df-4438-8103-a24766866f67-kube-api-access-cd6t2\") pod \"volume-data-source-validator-5d456fdbcd-rhslw\" (UID: \"ada37b9b-b6df-4438-8103-a24766866f67\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw"
Jul 07 14:10:24.346296 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.346236    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wzv7\" (UniqueName: \"kubernetes.io/projected/0b772ab1-4124-4a24-950a-b11aa9f090d0-kube-api-access-2wzv7\") pod \"network-check-source-989f8b8dc-8qhsx\" (UID: \"0b772ab1-4124-4a24-950a-b11aa9f090d0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx"
Jul 07 14:10:24.385132 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.385095    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw"
Jul 07 14:10:24.390793 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.390772    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx"
Jul 07 14:10:24.415127 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.414849    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-vxntv"]
Jul 07 14:10:24.417688 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:10:24.417617    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba46223_105a_42fa_911d_7a49fb4d061a.slice/crio-3ced7de7f8d7467bef24c2bca6d57af519e6c7e8df306b7d464d7cd4d4b913a2 WatchSource:0}: Error finding container 3ced7de7f8d7467bef24c2bca6d57af519e6c7e8df306b7d464d7cd4d4b913a2: Status 404 returned error can't find the container with id 3ced7de7f8d7467bef24c2bca6d57af519e6c7e8df306b7d464d7cd4d4b913a2
Jul 07 14:10:24.437515 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.436715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.437515 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.436763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29z6z\" (UniqueName: \"kubernetes.io/projected/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-kube-api-access-29z6z\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.437515 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.436812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.437515 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.437255    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.440315 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.440288    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.447117 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.446193    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29z6z\" (UniqueName: \"kubernetes.io/projected/e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d-kube-api-access-29z6z\") pod \"kube-storage-version-migrator-operator-846bf668f7-fjbv4\" (UID: \"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.492966 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.492936    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"
Jul 07 14:10:24.520032 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.519998    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw"]
Jul 07 14:10:24.523041 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:10:24.523000    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada37b9b_b6df_4438_8103_a24766866f67.slice/crio-27ade7ecd28c44b4c0b70997d580534a38f4488d810941b6dfb8ba9e164c2346 WatchSource:0}: Error finding container 27ade7ecd28c44b4c0b70997d580534a38f4488d810941b6dfb8ba9e164c2346: Status 404 returned error can't find the container with id 27ade7ecd28c44b4c0b70997d580534a38f4488d810941b6dfb8ba9e164c2346
Jul 07 14:10:24.538858 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.538825    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx"]
Jul 07 14:10:24.542503 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:10:24.542463    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b772ab1_4124_4a24_950a_b11aa9f090d0.slice/crio-78c8aab88982992294cbd90e96920a6d338824e3b2bc7dd58e51f16db1e371eb WatchSource:0}: Error finding container 78c8aab88982992294cbd90e96920a6d338824e3b2bc7dd58e51f16db1e371eb: Status 404 returned error can't find the container with id 78c8aab88982992294cbd90e96920a6d338824e3b2bc7dd58e51f16db1e371eb
Jul 07 14:10:24.629004 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.628975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4"]
Jul 07 14:10:24.632316 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:10:24.632290    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c3f9f3_d7bb_47c2_90a7_3bf7e2680a0d.slice/crio-c15f3a70373ddbed8c171c0244b9508376bf0130f8ed152a254b8dc6e4b5c55c WatchSource:0}: Error finding container c15f3a70373ddbed8c171c0244b9508376bf0130f8ed152a254b8dc6e4b5c55c: Status 404 returned error can't find the container with id c15f3a70373ddbed8c171c0244b9508376bf0130f8ed152a254b8dc6e4b5c55c
Jul 07 14:10:24.739120 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.739069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.739335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.739128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:24.739335 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.739237    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.739222736 +0000 UTC m=+190.570307206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : configmap references non-existent config key: service-ca.crt
Jul 07 14:10:24.739335 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.739248    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:10:24.739335 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.739308    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.739293316 +0000 UTC m=+190.570377788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : secret "router-metrics-certs-default" not found
Jul 07 14:10:24.839700 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:24.839566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:24.839888 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.839762    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 14:10:24.839888 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:24.839838    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert podName:b1f5e365-9efd-4a80-b21c-5b446aab6340 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:25.839818123 +0000 UTC m=+190.670902595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-594lf" (UID: "b1f5e365-9efd-4a80-b21c-5b446aab6340") : secret "networking-console-plugin-cert" not found
Jul 07 14:10:25.266424 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.266382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4" event={"ID":"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d","Type":"ContainerStarted","Data":"c15f3a70373ddbed8c171c0244b9508376bf0130f8ed152a254b8dc6e4b5c55c"}
Jul 07 14:10:25.267974 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.267905    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw" event={"ID":"ada37b9b-b6df-4438-8103-a24766866f67","Type":"ContainerStarted","Data":"27ade7ecd28c44b4c0b70997d580534a38f4488d810941b6dfb8ba9e164c2346"}
Jul 07 14:10:25.270714 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.270679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx" event={"ID":"0b772ab1-4124-4a24-950a-b11aa9f090d0","Type":"ContainerStarted","Data":"1e8c61e5a522a711077b2dc15fddce489b201ff16f354252ef493d53955497e2"}
Jul 07 14:10:25.270851 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.270732    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx" event={"ID":"0b772ab1-4124-4a24-950a-b11aa9f090d0","Type":"ContainerStarted","Data":"78c8aab88982992294cbd90e96920a6d338824e3b2bc7dd58e51f16db1e371eb"}
Jul 07 14:10:25.272546 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.272520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" event={"ID":"6ba46223-105a-42fa-911d-7a49fb4d061a","Type":"ContainerStarted","Data":"3ced7de7f8d7467bef24c2bca6d57af519e6c7e8df306b7d464d7cd4d4b913a2"}
Jul 07 14:10:25.287441 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.287383    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-8qhsx" podStartSLOduration=1.287364212 podStartE2EDuration="1.287364212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:25.286821314 +0000 UTC m=+190.117905802" watchObservedRunningTime="2026-07-07 14:10:25.287364212 +0000 UTC m=+190.118448699"
Jul 07 14:10:25.748760 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.748723    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:25.748944 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.748787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:25.748944 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:25.748878    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:10:25.748944 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:25.748930    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:27.748913066 +0000 UTC m=+192.579997545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : configmap references non-existent config key: service-ca.crt
Jul 07 14:10:25.748944 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:25.748947    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:27.748939022 +0000 UTC m=+192.580023487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : secret "router-metrics-certs-default" not found
Jul 07 14:10:25.849584 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:25.849363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:25.849738 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:25.849610    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 14:10:25.849738 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:25.849708    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert podName:b1f5e365-9efd-4a80-b21c-5b446aab6340 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:27.849687631 +0000 UTC m=+192.680772099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-594lf" (UID: "b1f5e365-9efd-4a80-b21c-5b446aab6340") : secret "networking-console-plugin-cert" not found
Jul 07 14:10:26.277495 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:26.277455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw" event={"ID":"ada37b9b-b6df-4438-8103-a24766866f67","Type":"ContainerStarted","Data":"fbd53fe7a54012fadb6d5bc914f895ffec195259ebd8e2b61cf56937d2539274"}
Jul 07 14:10:26.294043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:26.293995    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-rhslw" podStartSLOduration=1.038023981 podStartE2EDuration="2.293976191s" totalImagesPullingTime="1.25595221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:26.292787066 +0000 UTC m=+191.123871553" watchObservedRunningTime="2026-07-07 14:10:26.293976191 +0000 UTC m=+191.125060677"
Jul 07 14:10:27.282900 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.282871    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/0.log"
Jul 07 14:10:27.283339 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.282915    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ba46223-105a-42fa-911d-7a49fb4d061a" containerID="70abce2d442e3eb0dcc1d6de15b75266d96cf1eaf9f6b22895b6373ed68e249c" exitCode=255
Jul 07 14:10:27.283339 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.282986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" event={"ID":"6ba46223-105a-42fa-911d-7a49fb4d061a","Type":"ContainerDied","Data":"70abce2d442e3eb0dcc1d6de15b75266d96cf1eaf9f6b22895b6373ed68e249c"}
Jul 07 14:10:27.283339 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.283273    2564 scope.go:117] "RemoveContainer" containerID="70abce2d442e3eb0dcc1d6de15b75266d96cf1eaf9f6b22895b6373ed68e249c"
Jul 07 14:10:27.284472 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.284446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4" event={"ID":"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d","Type":"ContainerStarted","Data":"ce6c7a2ebce20800ff73089e05900e60e12552bf7a5496574a24d157935436be"}
Jul 07 14:10:27.320593 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.320533    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4" podStartSLOduration=0.916747742 podStartE2EDuration="3.320512469s" totalImagesPullingTime="2.403764727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:27.319169324 +0000 UTC m=+192.150253809" watchObservedRunningTime="2026-07-07 14:10:27.320512469 +0000 UTC m=+192.151596956"
Jul 07 14:10:27.764773 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.764737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:27.764942 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.764787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:27.764942 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:27.764904    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:31.764886803 +0000 UTC m=+196.595971291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : configmap references non-existent config key: service-ca.crt
Jul 07 14:10:27.764942 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:27.764933    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:10:27.765046 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:27.764976    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:31.764963368 +0000 UTC m=+196.596047834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : secret "router-metrics-certs-default" not found
Jul 07 14:10:27.865714 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:27.865668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:27.865858 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:27.865827    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 14:10:27.865902 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:27.865891    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert podName:b1f5e365-9efd-4a80-b21c-5b446aab6340 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:31.865874087 +0000 UTC m=+196.696958574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-594lf" (UID: "b1f5e365-9efd-4a80-b21c-5b446aab6340") : secret "networking-console-plugin-cert" not found
Jul 07 14:10:28.290218 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.290186    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/1.log"
Jul 07 14:10:28.290784 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.290755    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/0.log"
Jul 07 14:10:28.290912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.290804    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ba46223-105a-42fa-911d-7a49fb4d061a" containerID="dbebc3f6885d3a431c0e4a691047748bc2f01793ee1335a73e245c6643d16f4e" exitCode=255
Jul 07 14:10:28.290912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.290891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" event={"ID":"6ba46223-105a-42fa-911d-7a49fb4d061a","Type":"ContainerDied","Data":"dbebc3f6885d3a431c0e4a691047748bc2f01793ee1335a73e245c6643d16f4e"}
Jul 07 14:10:28.291022 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.290968    2564 scope.go:117] "RemoveContainer" containerID="70abce2d442e3eb0dcc1d6de15b75266d96cf1eaf9f6b22895b6373ed68e249c"
Jul 07 14:10:28.291164 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.291141    2564 scope.go:117] "RemoveContainer" containerID="dbebc3f6885d3a431c0e4a691047748bc2f01793ee1335a73e245c6643d16f4e"
Jul 07 14:10:28.291418 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:28.291336    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vxntv_openshift-console-operator(6ba46223-105a-42fa-911d-7a49fb4d061a)\"" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" podUID="6ba46223-105a-42fa-911d-7a49fb4d061a"
Jul 07 14:10:28.386161 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.386121    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6nrr6"]
Jul 07 14:10:28.388917 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.388900    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.391685 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.391661    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 14:10:28.391795 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.391693    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 14:10:28.391844 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.391814    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 14:10:28.391906 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.391893    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vkw4d\""
Jul 07 14:10:28.391964 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.391955    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 14:10:28.401229 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.401204    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6nrr6"]
Jul 07 14:10:28.469677 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.469616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7922daa5-1590-4224-9217-c970c576e48d-crio-socket\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.469852 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.469697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.469852 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.469716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.469852 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.469734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-955dx\" (UniqueName: \"kubernetes.io/projected/7922daa5-1590-4224-9217-c970c576e48d-kube-api-access-955dx\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.469852 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.469762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7922daa5-1590-4224-9217-c970c576e48d-data-volume\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.570921 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.570841    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7922daa5-1590-4224-9217-c970c576e48d-crio-socket\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.570921 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.570884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.570921 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.570903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.570921 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.570917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-955dx\" (UniqueName: \"kubernetes.io/projected/7922daa5-1590-4224-9217-c970c576e48d-kube-api-access-955dx\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.571149 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.570943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7922daa5-1590-4224-9217-c970c576e48d-data-volume\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.571149 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.570969    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7922daa5-1590-4224-9217-c970c576e48d-crio-socket\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.571149 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:28.570997    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:28.571149 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:28.571007    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:28.571149 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:28.571064    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.071042773 +0000 UTC m=+193.902127246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:28.571149 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:28.571125    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.07110835 +0000 UTC m=+193.902192822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:28.571341 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.571250    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7922daa5-1590-4224-9217-c970c576e48d-data-volume\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:28.581720 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:28.581688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-955dx\" (UniqueName: \"kubernetes.io/projected/7922daa5-1590-4224-9217-c970c576e48d-kube-api-access-955dx\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:29.075229 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:29.075195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:29.075229 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:29.075236    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:29.075518 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:29.075344    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:29.075518 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:29.075404    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:30.075389309 +0000 UTC m=+194.906473777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:29.075518 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:29.075351    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:29.075518 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:29.075489    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:30.075472889 +0000 UTC m=+194.906557358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:29.295667 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:29.295622    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/1.log"
Jul 07 14:10:29.296034 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:29.295970    2564 scope.go:117] "RemoveContainer" containerID="dbebc3f6885d3a431c0e4a691047748bc2f01793ee1335a73e245c6643d16f4e"
Jul 07 14:10:29.296133 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:29.296115    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vxntv_openshift-console-operator(6ba46223-105a-42fa-911d-7a49fb4d061a)\"" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" podUID="6ba46223-105a-42fa-911d-7a49fb4d061a"
Jul 07 14:10:30.084206 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.084167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:30.084206 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.084206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:30.084420 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:30.084300    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:30.084420 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:30.084320    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:30.084420 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:30.084364    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:32.084347021 +0000 UTC m=+196.915431488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:30.084420 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:30.084378    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:32.084372653 +0000 UTC m=+196.915457117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:30.158399 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.158374    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-65fwj_6d939d2a-40f6-4fec-8cc8-3c0e5334d502/dns-node-resolver/0.log"
Jul 07 14:10:30.495749 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.495721    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7kdlj"]
Jul 07 14:10:30.500655 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.499608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.502747 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.502723    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 14:10:30.502884 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.502800    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 14:10:30.503944 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.503923    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 14:10:30.504013 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.503975    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pwz6q\""
Jul 07 14:10:30.504013 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.503986    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 14:10:30.508250 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.508232    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7kdlj"]
Jul 07 14:10:30.586605 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.586561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/efd1b319-a34e-40f2-aa08-4b6cc78fe354-signing-key\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.586792 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.586626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/efd1b319-a34e-40f2-aa08-4b6cc78fe354-signing-cabundle\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.586792 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.586697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8kxr\" (UniqueName: \"kubernetes.io/projected/efd1b319-a34e-40f2-aa08-4b6cc78fe354-kube-api-access-s8kxr\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.687973 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.687929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/efd1b319-a34e-40f2-aa08-4b6cc78fe354-signing-cabundle\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.688116 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.687987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8kxr\" (UniqueName: \"kubernetes.io/projected/efd1b319-a34e-40f2-aa08-4b6cc78fe354-kube-api-access-s8kxr\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.688116 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.688049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/efd1b319-a34e-40f2-aa08-4b6cc78fe354-signing-key\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.688588 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.688562    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/efd1b319-a34e-40f2-aa08-4b6cc78fe354-signing-cabundle\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.690613 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.690591    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/efd1b319-a34e-40f2-aa08-4b6cc78fe354-signing-key\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.696738 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.696708    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8kxr\" (UniqueName: \"kubernetes.io/projected/efd1b319-a34e-40f2-aa08-4b6cc78fe354-kube-api-access-s8kxr\") pod \"service-ca-758f599c5-7kdlj\" (UID: \"efd1b319-a34e-40f2-aa08-4b6cc78fe354\") " pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.809783 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.809702    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7kdlj"
Jul 07 14:10:30.936899 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:30.936865    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7kdlj"]
Jul 07 14:10:30.940393 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:10:30.940365    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd1b319_a34e_40f2_aa08_4b6cc78fe354.slice/crio-4cd9aa4740d508851abf03f906fc2ea944fc800b09ea809714f1759d0e5edb69 WatchSource:0}: Error finding container 4cd9aa4740d508851abf03f906fc2ea944fc800b09ea809714f1759d0e5edb69: Status 404 returned error can't find the container with id 4cd9aa4740d508851abf03f906fc2ea944fc800b09ea809714f1759d0e5edb69
Jul 07 14:10:31.304110 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:31.304074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7kdlj" event={"ID":"efd1b319-a34e-40f2-aa08-4b6cc78fe354","Type":"ContainerStarted","Data":"4cd9aa4740d508851abf03f906fc2ea944fc800b09ea809714f1759d0e5edb69"}
Jul 07 14:10:31.558022 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:31.557954    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xr9q6_18a01f98-93bb-4b3e-8786-f20c762b3b0b/node-ca/0.log"
Jul 07 14:10:31.796462 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:31.796430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:31.796462 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:31.796475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:31.796704 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:31.796586    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:10:31.796704 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:31.796659    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:39.796643513 +0000 UTC m=+204.627727991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : secret "router-metrics-certs-default" not found
Jul 07 14:10:31.796704 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:31.796673    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:39.796667438 +0000 UTC m=+204.627751903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : configmap references non-existent config key: service-ca.crt
Jul 07 14:10:31.897412 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:31.897379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:31.897545 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:31.897524    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 14:10:31.897604 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:31.897593    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert podName:b1f5e365-9efd-4a80-b21c-5b446aab6340 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:39.897574671 +0000 UTC m=+204.728659135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-594lf" (UID: "b1f5e365-9efd-4a80-b21c-5b446aab6340") : secret "networking-console-plugin-cert" not found
Jul 07 14:10:32.099216 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:32.099172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:32.099216 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:32.099215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:32.099473 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:32.099326    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:32.099473 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:32.099343    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:32.099473 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:32.099392    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:36.099376237 +0000 UTC m=+200.930460702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:32.099473 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:32.099409    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:36.09940077 +0000 UTC m=+200.930485235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:32.158541 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:32.158464    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kj7vc_7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0/serve-healthcheck-canary/0.log"
Jul 07 14:10:34.286279 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:34.286240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:34.286665 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:34.286293    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:34.286665 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:34.286590    2564 scope.go:117] "RemoveContainer" containerID="dbebc3f6885d3a431c0e4a691047748bc2f01793ee1335a73e245c6643d16f4e"
Jul 07 14:10:34.286769 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:34.286751    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-vxntv_openshift-console-operator(6ba46223-105a-42fa-911d-7a49fb4d061a)\"" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" podUID="6ba46223-105a-42fa-911d-7a49fb4d061a"
Jul 07 14:10:35.319770 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:35.319730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7kdlj" event={"ID":"efd1b319-a34e-40f2-aa08-4b6cc78fe354","Type":"ContainerStarted","Data":"6fafa85814b07f62017fb396355eb91e710e497df1c85dceda07c92adb45b99d"}
Jul 07 14:10:35.335791 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:35.335736    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-7kdlj" podStartSLOduration=1.950135209 podStartE2EDuration="5.335719737s" totalImagesPullingTime="3.385584528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:35.335396412 +0000 UTC m=+200.166480900" watchObservedRunningTime="2026-07-07 14:10:35.335719737 +0000 UTC m=+200.166804223"
Jul 07 14:10:36.131775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:36.131715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:36.131980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:36.131774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:36.131980 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:36.131876    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:36.132093 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:36.132033    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:44.132009805 +0000 UTC m=+208.963094285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:36.132093 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:36.131907    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:36.132206 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:36.132115    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:10:44.13209709 +0000 UTC m=+208.963181568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:39.863964 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:39.863928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:39.864367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:39.863985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:39.864367 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:39.864091    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:10:39.864367 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:39.864172    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:55.864150838 +0000 UTC m=+220.695235311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : secret "router-metrics-certs-default" not found
Jul 07 14:10:39.864367 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:39.864200    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle podName:9870b139-e587-4211-a0f3-210bf678bb37 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:55.864188191 +0000 UTC m=+220.695272656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle") pod "router-default-76bd7978f-vbn26" (UID: "9870b139-e587-4211-a0f3-210bf678bb37") : configmap references non-existent config key: service-ca.crt
Jul 07 14:10:39.964987 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:39.964948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:39.965161 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:39.965096    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 14:10:39.965203 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:39.965165    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert podName:b1f5e365-9efd-4a80-b21c-5b446aab6340 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:55.965148506 +0000 UTC m=+220.796232972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-594lf" (UID: "b1f5e365-9efd-4a80-b21c-5b446aab6340") : secret "networking-console-plugin-cert" not found
Jul 07 14:10:44.199082 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:44.199034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:44.199082 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:44.199080    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:44.199671 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:44.199197    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:44.199671 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:44.199273    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls podName:7922daa5-1590-4224-9217-c970c576e48d nodeName:}" failed. No retries permitted until 2026-07-07 14:11:00.199257561 +0000 UTC m=+225.030342025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nrr6" (UID: "7922daa5-1590-4224-9217-c970c576e48d") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:44.199783 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:44.199698    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7922daa5-1590-4224-9217-c970c576e48d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:10:45.710087 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:45.710054    2564 scope.go:117] "RemoveContainer" containerID="dbebc3f6885d3a431c0e4a691047748bc2f01793ee1335a73e245c6643d16f4e"
Jul 07 14:10:46.354928 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:46.354900    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:10:46.355310 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:46.355296    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/1.log"
Jul 07 14:10:46.355355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:46.355329    2564 generic.go:356] "Generic (PLEG): container finished" podID="6ba46223-105a-42fa-911d-7a49fb4d061a" containerID="0445e487b6dfac110a52fee8eeeb75e75d797b5eb464a8f54d1066863eece833" exitCode=255
Jul 07 14:10:46.355388 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:46.355359    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" event={"ID":"6ba46223-105a-42fa-911d-7a49fb4d061a","Type":"ContainerDied","Data":"0445e487b6dfac110a52fee8eeeb75e75d797b5eb464a8f54d1066863eece833"}
Jul 07 14:10:46.355424 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:46.355404    2564 scope.go:117] "RemoveContainer" containerID="dbebc3f6885d3a431c0e4a691047748bc2f01793ee1335a73e245c6643d16f4e"
Jul 07 14:10:46.355794 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:46.355774    2564 scope.go:117] "RemoveContainer" containerID="0445e487b6dfac110a52fee8eeeb75e75d797b5eb464a8f54d1066863eece833"
Jul 07 14:10:46.355950 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:46.355932    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-vxntv_openshift-console-operator(6ba46223-105a-42fa-911d-7a49fb4d061a)\"" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" podUID="6ba46223-105a-42fa-911d-7a49fb4d061a"
Jul 07 14:10:47.359348 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:47.359322    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:10:54.286931 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:54.286883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:54.287434 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:54.286954    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:10:54.287434 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:54.287325    2564 scope.go:117] "RemoveContainer" containerID="0445e487b6dfac110a52fee8eeeb75e75d797b5eb464a8f54d1066863eece833"
Jul 07 14:10:54.287547 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:10:54.287511    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-vxntv_openshift-console-operator(6ba46223-105a-42fa-911d-7a49fb4d061a)\"" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" podUID="6ba46223-105a-42fa-911d-7a49fb4d061a"
Jul 07 14:10:55.892323 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:55.892278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:55.892728 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:55.892337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:55.892970 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:55.892948    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9870b139-e587-4211-a0f3-210bf678bb37-service-ca-bundle\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:55.894760 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:55.894737    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9870b139-e587-4211-a0f3-210bf678bb37-metrics-certs\") pod \"router-default-76bd7978f-vbn26\" (UID: \"9870b139-e587-4211-a0f3-210bf678bb37\") " pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:55.993319 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:55.993278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:55.995801 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:55.995770    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1f5e365-9efd-4a80-b21c-5b446aab6340-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-594lf\" (UID: \"b1f5e365-9efd-4a80-b21c-5b446aab6340\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:56.091674 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:56.091605    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:56.177945 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:56.177919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf"
Jul 07 14:10:56.227861 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:56.227809    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76bd7978f-vbn26"]
Jul 07 14:10:56.231601 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:10:56.231566    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9870b139_e587_4211_a0f3_210bf678bb37.slice/crio-e9e1d944f58bfbb6879b02f2e93c4aec18a92810f6f1fc6ebd521e355a719e39 WatchSource:0}: Error finding container e9e1d944f58bfbb6879b02f2e93c4aec18a92810f6f1fc6ebd521e355a719e39: Status 404 returned error can't find the container with id e9e1d944f58bfbb6879b02f2e93c4aec18a92810f6f1fc6ebd521e355a719e39
Jul 07 14:10:56.311653 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:56.311604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-594lf"]
Jul 07 14:10:56.314578 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:10:56.314546    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f5e365_9efd_4a80_b21c_5b446aab6340.slice/crio-c950683b6864c368cdd39f66b7c4fb820ce0168e5c587908e219071651bcf5ed WatchSource:0}: Error finding container c950683b6864c368cdd39f66b7c4fb820ce0168e5c587908e219071651bcf5ed: Status 404 returned error can't find the container with id c950683b6864c368cdd39f66b7c4fb820ce0168e5c587908e219071651bcf5ed
Jul 07 14:10:56.387324 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:56.387286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76bd7978f-vbn26" event={"ID":"9870b139-e587-4211-a0f3-210bf678bb37","Type":"ContainerStarted","Data":"740760afeb759aa6e66d418e13652dabdcf4d4f1db0fcb153b85159eb40582f7"}
Jul 07 14:10:56.387519 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:56.387342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76bd7978f-vbn26" event={"ID":"9870b139-e587-4211-a0f3-210bf678bb37","Type":"ContainerStarted","Data":"e9e1d944f58bfbb6879b02f2e93c4aec18a92810f6f1fc6ebd521e355a719e39"}
Jul 07 14:10:56.388299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:56.388272    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf" event={"ID":"b1f5e365-9efd-4a80-b21c-5b446aab6340","Type":"ContainerStarted","Data":"c950683b6864c368cdd39f66b7c4fb820ce0168e5c587908e219071651bcf5ed"}
Jul 07 14:10:56.406300 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:56.406211    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76bd7978f-vbn26" podStartSLOduration=33.40619681 podStartE2EDuration="33.40619681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:56.405804674 +0000 UTC m=+221.236889162" watchObservedRunningTime="2026-07-07 14:10:56.40619681 +0000 UTC m=+221.237281296"
Jul 07 14:10:57.091823 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:57.091777    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:57.094464 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:57.094442    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:57.391929 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:57.391898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:57.393405 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:57.393379    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76bd7978f-vbn26"
Jul 07 14:10:58.396665 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.396615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf" event={"ID":"b1f5e365-9efd-4a80-b21c-5b446aab6340","Type":"ContainerStarted","Data":"bfe3b17456302339a3f10e229bd9d4157e2a57c54af1b0f551d5b344e9d4f5aa"}
Jul 07 14:10:58.413973 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.413924    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-594lf" podStartSLOduration=33.225374966 podStartE2EDuration="34.413908738s" totalImagesPullingTime="1.188533772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:58.413202123 +0000 UTC m=+223.244286603" watchObservedRunningTime="2026-07-07 14:10:58.413908738 +0000 UTC m=+223.244993225"
Jul 07 14:10:58.637674 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.637641    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"]
Jul 07 14:10:58.639678 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.639661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"
Jul 07 14:10:58.642357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.642333    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-j4t8z\""
Jul 07 14:10:58.642646 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.642617    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 14:10:58.649684 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.649612    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"]
Jul 07 14:10:58.712205 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.712163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d67a7fde-9c40-4951-94c7-5017011177a7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-46v56\" (UID: \"d67a7fde-9c40-4951-94c7-5017011177a7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"
Jul 07 14:10:58.813017 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.812977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d67a7fde-9c40-4951-94c7-5017011177a7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-46v56\" (UID: \"d67a7fde-9c40-4951-94c7-5017011177a7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"
Jul 07 14:10:58.815544 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.815523    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d67a7fde-9c40-4951-94c7-5017011177a7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-46v56\" (UID: \"d67a7fde-9c40-4951-94c7-5017011177a7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"
Jul 07 14:10:58.948035 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:58.947939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"
Jul 07 14:10:59.073759 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:59.073727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"]
Jul 07 14:10:59.076772 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:10:59.076743    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67a7fde_9c40_4951_94c7_5017011177a7.slice/crio-098f5fdffbf42cf6ff9997774dbf47ebbd91fb48d1dcea8122dfe44f1da02911 WatchSource:0}: Error finding container 098f5fdffbf42cf6ff9997774dbf47ebbd91fb48d1dcea8122dfe44f1da02911: Status 404 returned error can't find the container with id 098f5fdffbf42cf6ff9997774dbf47ebbd91fb48d1dcea8122dfe44f1da02911
Jul 07 14:10:59.407240 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:10:59.407202    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56" event={"ID":"d67a7fde-9c40-4951-94c7-5017011177a7","Type":"ContainerStarted","Data":"098f5fdffbf42cf6ff9997774dbf47ebbd91fb48d1dcea8122dfe44f1da02911"}
Jul 07 14:11:00.224331 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.224288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:11:00.227078 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.227044    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7922daa5-1590-4224-9217-c970c576e48d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nrr6\" (UID: \"7922daa5-1590-4224-9217-c970c576e48d\") " pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:11:00.412158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.412123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56" event={"ID":"d67a7fde-9c40-4951-94c7-5017011177a7","Type":"ContainerStarted","Data":"50b8456c6ff62e542b35dabc2162252c474c3dc00c1b04e78970e80145e7efe9"}
Jul 07 14:11:00.412608 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.412388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"
Jul 07 14:11:00.416960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.416940    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56"
Jul 07 14:11:00.428390 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.428347    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46v56" podStartSLOduration=1.183628731 podStartE2EDuration="2.428332819s" totalImagesPullingTime="1.244704088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:00.427708244 +0000 UTC m=+225.258792732" watchObservedRunningTime="2026-07-07 14:11:00.428332819 +0000 UTC m=+225.259417305"
Jul 07 14:11:00.498143 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.498060    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6nrr6"
Jul 07 14:11:00.626390 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.626294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6nrr6"]
Jul 07 14:11:00.629195 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:00.629157    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7922daa5_1590_4224_9217_c970c576e48d.slice/crio-999368daa605ff3bc4e75be40ff4f7d6d49fde3ff94f782ad8a25593e2d79266 WatchSource:0}: Error finding container 999368daa605ff3bc4e75be40ff4f7d6d49fde3ff94f782ad8a25593e2d79266: Status 404 returned error can't find the container with id 999368daa605ff3bc4e75be40ff4f7d6d49fde3ff94f782ad8a25593e2d79266
Jul 07 14:11:00.688487 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.688454    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"]
Jul 07 14:11:00.690960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.690944    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.693642 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.693614    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 14:11:00.693794 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.693735    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fhl5s\""
Jul 07 14:11:00.693990 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.693970    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 14:11:00.694109 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.693994    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 14:11:00.694109 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.693994    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 14:11:00.694224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.694111    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 14:11:00.700974 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.700948    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"]
Jul 07 14:11:00.829856 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.829763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc4afbe-5e80-4328-99da-069815c7ec00-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.829856 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.829821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdc4afbe-5e80-4328-99da-069815c7ec00-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.829856 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.829841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2dq\" (UniqueName: \"kubernetes.io/projected/fdc4afbe-5e80-4328-99da-069815c7ec00-kube-api-access-hh2dq\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.830067 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.829865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc4afbe-5e80-4328-99da-069815c7ec00-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.931085 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.931029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc4afbe-5e80-4328-99da-069815c7ec00-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.931259 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.931119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc4afbe-5e80-4328-99da-069815c7ec00-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.931259 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.931160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdc4afbe-5e80-4328-99da-069815c7ec00-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.931259 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.931177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2dq\" (UniqueName: \"kubernetes.io/projected/fdc4afbe-5e80-4328-99da-069815c7ec00-kube-api-access-hh2dq\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.931929 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.931867    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdc4afbe-5e80-4328-99da-069815c7ec00-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.933626 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.933603    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdc4afbe-5e80-4328-99da-069815c7ec00-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.933733 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.933694    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fdc4afbe-5e80-4328-99da-069815c7ec00-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:00.939280 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:00.939260    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2dq\" (UniqueName: \"kubernetes.io/projected/fdc4afbe-5e80-4328-99da-069815c7ec00-kube-api-access-hh2dq\") pod \"prometheus-operator-567f7b8b7c-4kj52\" (UID: \"fdc4afbe-5e80-4328-99da-069815c7ec00\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:01.002725 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:01.002682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"
Jul 07 14:11:01.147607 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:01.147443    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52"]
Jul 07 14:11:01.150280 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:01.150234    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc4afbe_5e80_4328_99da_069815c7ec00.slice/crio-0d5bc1b71ab6ae79414e4048eb74767090aa312c84dfe3378735a64f8cda755f WatchSource:0}: Error finding container 0d5bc1b71ab6ae79414e4048eb74767090aa312c84dfe3378735a64f8cda755f: Status 404 returned error can't find the container with id 0d5bc1b71ab6ae79414e4048eb74767090aa312c84dfe3378735a64f8cda755f
Jul 07 14:11:01.417305 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:01.417269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nrr6" event={"ID":"7922daa5-1590-4224-9217-c970c576e48d","Type":"ContainerStarted","Data":"999368daa605ff3bc4e75be40ff4f7d6d49fde3ff94f782ad8a25593e2d79266"}
Jul 07 14:11:01.418950 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:01.418827    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52" event={"ID":"fdc4afbe-5e80-4328-99da-069815c7ec00","Type":"ContainerStarted","Data":"0d5bc1b71ab6ae79414e4048eb74767090aa312c84dfe3378735a64f8cda755f"}
Jul 07 14:11:05.434008 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:05.433974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nrr6" event={"ID":"7922daa5-1590-4224-9217-c970c576e48d","Type":"ContainerStarted","Data":"364a2770829dc7fd772399950167230cff6c540a7f1a7fad640855fe8957318e"}
Jul 07 14:11:05.435660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:05.435618    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52" event={"ID":"fdc4afbe-5e80-4328-99da-069815c7ec00","Type":"ContainerStarted","Data":"370395f4c7ef0ede191566aadd42ec707770dbb81a678bd7b19d011df4e13ad2"}
Jul 07 14:11:05.435783 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:05.435675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52" event={"ID":"fdc4afbe-5e80-4328-99da-069815c7ec00","Type":"ContainerStarted","Data":"43f3ee31b43ebe92aac5b8115621f99b9e4b41cd03967275ab1ddc9ef8254505"}
Jul 07 14:11:05.453298 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:05.453249    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4kj52" podStartSLOduration=1.874364399 podStartE2EDuration="5.453235726s" totalImagesPullingTime="3.578871327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:05.452360038 +0000 UTC m=+230.283444524" watchObservedRunningTime="2026-07-07 14:11:05.453235726 +0000 UTC m=+230.284320212"
Jul 07 14:11:05.710546 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:05.710454    2564 scope.go:117] "RemoveContainer" containerID="0445e487b6dfac110a52fee8eeeb75e75d797b5eb464a8f54d1066863eece833"
Jul 07 14:11:05.710732 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:11:05.710602    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-vxntv_openshift-console-operator(6ba46223-105a-42fa-911d-7a49fb4d061a)\"" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" podUID="6ba46223-105a-42fa-911d-7a49fb4d061a"
Jul 07 14:11:06.440391 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:06.440355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nrr6" event={"ID":"7922daa5-1590-4224-9217-c970c576e48d","Type":"ContainerStarted","Data":"086037f5c08a1115be3bcd6a8464a33147a07087ecb2e1b9216cc861ab6420a7"}
Jul 07 14:11:07.029741 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.029514    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"]
Jul 07 14:11:07.032485 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.032465    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.035258 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.035231    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 14:11:07.035869 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.035574    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-n7gbm\""
Jul 07 14:11:07.035869 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.035604    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 14:11:07.045679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.045563    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"]
Jul 07 14:11:07.046517 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.046495    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"]
Jul 07 14:11:07.049306 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.049291    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.053968 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.053134    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 14:11:07.053968 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.053443    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 14:11:07.053968 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.053648    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p8x6z\""
Jul 07 14:11:07.053968 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.053835    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 14:11:07.065164 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.065092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"]
Jul 07 14:11:07.065696 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.065678    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gn55k"]
Jul 07 14:11:07.072883 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.069737    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.072883 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.072064    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 14:11:07.074411 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.074388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5v7xh\""
Jul 07 14:11:07.074546 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.074388    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 14:11:07.074671 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.074655    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.194976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa338ad-3179-4a34-b805-c35c869abb08-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-root\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f1af4ad-bf0d-416a-a084-1461692f8307-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-textfile\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-tls\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnfzl\" (UniqueName: \"kubernetes.io/projected/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-kube-api-access-vnfzl\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa338ad-3179-4a34-b805-c35c869abb08-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-wtmp\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-sys\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-metrics-client-ca\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa338ad-3179-4a34-b805-c35c869abb08-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.195831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.196709 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195501    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb24z\" (UniqueName: \"kubernetes.io/projected/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-api-access-cb24z\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.196709 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.196709 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pzs8\" (UniqueName: \"kubernetes.io/projected/4fa338ad-3179-4a34-b805-c35c869abb08-kube-api-access-7pzs8\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.196709 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.195599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8f1af4ad-bf0d-416a-a084-1461692f8307-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.296661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.296661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb24z\" (UniqueName: \"kubernetes.io/projected/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-api-access-cb24z\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.296661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.296934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pzs8\" (UniqueName: \"kubernetes.io/projected/4fa338ad-3179-4a34-b805-c35c869abb08-kube-api-access-7pzs8\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.296934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8f1af4ad-bf0d-416a-a084-1461692f8307-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.296934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa338ad-3179-4a34-b805-c35c869abb08-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.296934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-root\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.296934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296826    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.296934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f1af4ad-bf0d-416a-a084-1461692f8307-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.296934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-textfile\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.296934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-tls\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnfzl\" (UniqueName: \"kubernetes.io/projected/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-kube-api-access-vnfzl\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.296983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa338ad-3179-4a34-b805-c35c869abb08-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-wtmp\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297043    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-sys\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-metrics-client-ca\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa338ad-3179-4a34-b805-c35c869abb08-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.297367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297286    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8f1af4ad-bf0d-416a-a084-1461692f8307-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.297846 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297645    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-textfile\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.297846 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297685    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f1af4ad-bf0d-416a-a084-1461692f8307-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.297846 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:11:07.297738    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 14:11:07.297846 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:11:07.297795    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-tls podName:e8595a3a-364c-4c88-b30c-98d4ad4bbc63 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:07.797775477 +0000 UTC m=+232.628860148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-tls") pod "node-exporter-gn55k" (UID: "e8595a3a-364c-4c88-b30c-98d4ad4bbc63") : secret "node-exporter-tls" not found
Jul 07 14:11:07.298104 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.297902    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fa338ad-3179-4a34-b805-c35c869abb08-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.298855 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.298828    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-sys\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.298975 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.298873    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-wtmp\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.298975 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.298887    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-root\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.299466 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.299419    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-metrics-client-ca\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.299466 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.299454    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.299613 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:11:07.299531    2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 14:11:07.299613 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:11:07.299582    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-tls podName:8f1af4ad-bf0d-416a-a084-1461692f8307 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:07.799567121 +0000 UTC m=+232.630651591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-7l4gl" (UID: "8f1af4ad-bf0d-416a-a084-1461692f8307") : secret "kube-state-metrics-tls" not found
Jul 07 14:11:07.300012 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.299786    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.301569 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.301544    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fa338ad-3179-4a34-b805-c35c869abb08-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.302568 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.302524    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.303772 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.303733    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.303893 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.303771    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fa338ad-3179-4a34-b805-c35c869abb08-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.310163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.310120    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pzs8\" (UniqueName: \"kubernetes.io/projected/4fa338ad-3179-4a34-b805-c35c869abb08-kube-api-access-7pzs8\") pod \"openshift-state-metrics-54cf96dfcf-fsfd6\" (UID: \"4fa338ad-3179-4a34-b805-c35c869abb08\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.311915 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.311864    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb24z\" (UniqueName: \"kubernetes.io/projected/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-api-access-cb24z\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.312132 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.312096    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnfzl\" (UniqueName: \"kubernetes.io/projected/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-kube-api-access-vnfzl\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.347448 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.347414    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"
Jul 07 14:11:07.508706 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.508679    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6"]
Jul 07 14:11:07.511610 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:07.511577    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa338ad_3179_4a34_b805_c35c869abb08.slice/crio-779bc5292d0f664c736e4ce6617b332e38bd496dbe882220bb7b7ac8fa49d286 WatchSource:0}: Error finding container 779bc5292d0f664c736e4ce6617b332e38bd496dbe882220bb7b7ac8fa49d286: Status 404 returned error can't find the container with id 779bc5292d0f664c736e4ce6617b332e38bd496dbe882220bb7b7ac8fa49d286
Jul 07 14:11:07.803144 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.803044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-tls\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.803333 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.803206    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.805913 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.805886    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8595a3a-364c-4c88-b30c-98d4ad4bbc63-node-exporter-tls\") pod \"node-exporter-gn55k\" (UID: \"e8595a3a-364c-4c88-b30c-98d4ad4bbc63\") " pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:07.806124 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.806098    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f1af4ad-bf0d-416a-a084-1461692f8307-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7l4gl\" (UID: \"8f1af4ad-bf0d-416a-a084-1461692f8307\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.971645 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.971595    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"
Jul 07 14:11:07.984307 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:07.984270    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gn55k"
Jul 07 14:11:08.451124 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:08.451079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6" event={"ID":"4fa338ad-3179-4a34-b805-c35c869abb08","Type":"ContainerStarted","Data":"838cb024bc75b24f9a8911418ec7dfdb84ceb21861c92d04a59e7edfd98234b9"}
Jul 07 14:11:08.451299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:08.451158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6" event={"ID":"4fa338ad-3179-4a34-b805-c35c869abb08","Type":"ContainerStarted","Data":"75fe904fe1c21b8ce4da409123561f7fb4e89118aa645c880074139cb1c2871f"}
Jul 07 14:11:08.451299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:08.451186    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6" event={"ID":"4fa338ad-3179-4a34-b805-c35c869abb08","Type":"ContainerStarted","Data":"779bc5292d0f664c736e4ce6617b332e38bd496dbe882220bb7b7ac8fa49d286"}
Jul 07 14:11:08.782599 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:08.782572    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8595a3a_364c_4c88_b30c_98d4ad4bbc63.slice/crio-7376b78a22f6f827030f22633f685e8ddd4b9c7332878b23348f9622be320bed WatchSource:0}: Error finding container 7376b78a22f6f827030f22633f685e8ddd4b9c7332878b23348f9622be320bed: Status 404 returned error can't find the container with id 7376b78a22f6f827030f22633f685e8ddd4b9c7332878b23348f9622be320bed
Jul 07 14:11:08.928860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:08.928829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl"]
Jul 07 14:11:08.932244 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:08.932207    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1af4ad_bf0d_416a_a084_1461692f8307.slice/crio-8018f42ee870e85910cb4b2a08121037c17c0a4a8c367ecac7122d339dda364f WatchSource:0}: Error finding container 8018f42ee870e85910cb4b2a08121037c17c0a4a8c367ecac7122d339dda364f: Status 404 returned error can't find the container with id 8018f42ee870e85910cb4b2a08121037c17c0a4a8c367ecac7122d339dda364f
Jul 07 14:11:09.456552 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:09.456517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nrr6" event={"ID":"7922daa5-1590-4224-9217-c970c576e48d","Type":"ContainerStarted","Data":"e7ebfca4c56b8846ebdeaa70d2a2caf074ce4b38b792b615d7150c86bb0ca60c"}
Jul 07 14:11:09.457711 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:09.457682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn55k" event={"ID":"e8595a3a-364c-4c88-b30c-98d4ad4bbc63","Type":"ContainerStarted","Data":"7376b78a22f6f827030f22633f685e8ddd4b9c7332878b23348f9622be320bed"}
Jul 07 14:11:09.459734 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:09.459696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6" event={"ID":"4fa338ad-3179-4a34-b805-c35c869abb08","Type":"ContainerStarted","Data":"d842adeba4f589708a8f17e26ea1aba50f6ba725e9039defe98a86f0cf58f141"}
Jul 07 14:11:09.460888 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:09.460868    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl" event={"ID":"8f1af4ad-bf0d-416a-a084-1461692f8307","Type":"ContainerStarted","Data":"8018f42ee870e85910cb4b2a08121037c17c0a4a8c367ecac7122d339dda364f"}
Jul 07 14:11:09.474979 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:09.474913    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6nrr6" podStartSLOduration=33.422864029 podStartE2EDuration="41.474895485s" totalImagesPullingTime="8.052031456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:10:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:09.474153218 +0000 UTC m=+234.305237704" watchObservedRunningTime="2026-07-07 14:11:09.474895485 +0000 UTC m=+234.305979973"
Jul 07 14:11:09.493208 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:09.493156    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-fsfd6" podStartSLOduration=0.792077585 podStartE2EDuration="2.493139503s" totalImagesPullingTime="1.701061918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:09.492393294 +0000 UTC m=+234.323477782" watchObservedRunningTime="2026-07-07 14:11:09.493139503 +0000 UTC m=+234.324224021"
Jul 07 14:11:10.037245 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.037198    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"]
Jul 07 14:11:10.042674 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.042591    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.046299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.045559    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 14:11:10.046299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.045758    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 14:11:10.046299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.045938    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cdxq8\""
Jul 07 14:11:10.046299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.046056    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 14:11:10.046299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.045941    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b71vd5sfqirv4\""
Jul 07 14:11:10.046790 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.046311    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 14:11:10.046790 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.046480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 14:11:10.055456 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.055421    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"]
Jul 07 14:11:10.126793 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.126754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-tls\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.126793 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.126791    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-grpc-tls\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.127019 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.126824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.127019 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.126855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ced40f1d-ffb2-426d-b1fd-a5935722b33e-metrics-client-ca\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.127019 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.126911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.127019 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.126987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt68q\" (UniqueName: \"kubernetes.io/projected/ced40f1d-ffb2-426d-b1fd-a5935722b33e-kube-api-access-gt68q\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.127019 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.127010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.127276 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.127027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.228245 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.228209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-tls\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.228430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.228254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-grpc-tls\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.228430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.228283    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.228430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.228315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ced40f1d-ffb2-426d-b1fd-a5935722b33e-metrics-client-ca\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.228430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.228343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.228430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.228376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt68q\" (UniqueName: \"kubernetes.io/projected/ced40f1d-ffb2-426d-b1fd-a5935722b33e-kube-api-access-gt68q\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.228430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.228403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.228755 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.228455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.229531 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.229499    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ced40f1d-ffb2-426d-b1fd-a5935722b33e-metrics-client-ca\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.232219 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.232192    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-tls\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.232355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.232264    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.232620 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.232599    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-grpc-tls\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.232721 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.232602    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.232963 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.232931    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.233049 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.233030    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ced40f1d-ffb2-426d-b1fd-a5935722b33e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.236366 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.236342    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt68q\" (UniqueName: \"kubernetes.io/projected/ced40f1d-ffb2-426d-b1fd-a5935722b33e-kube-api-access-gt68q\") pod \"thanos-querier-85c6bf7d45-qrq6b\" (UID: \"ced40f1d-ffb2-426d-b1fd-a5935722b33e\") " pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.358576 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.358478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:10.607869 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:10.607847    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"]
Jul 07 14:11:10.617957 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:10.617912    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced40f1d_ffb2_426d_b1fd_a5935722b33e.slice/crio-3322783b73271f3e87cf21347276339a0ce5a944157be1c9d9307ec9c00c8bc1 WatchSource:0}: Error finding container 3322783b73271f3e87cf21347276339a0ce5a944157be1c9d9307ec9c00c8bc1: Status 404 returned error can't find the container with id 3322783b73271f3e87cf21347276339a0ce5a944157be1c9d9307ec9c00c8bc1
Jul 07 14:11:11.471418 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:11.471379    2564 generic.go:356] "Generic (PLEG): container finished" podID="e8595a3a-364c-4c88-b30c-98d4ad4bbc63" containerID="0aa95b49442226a904622671b673243e081656503a6ec0dc4a1f3fc7a1270604" exitCode=0
Jul 07 14:11:11.471900 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:11.471470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn55k" event={"ID":"e8595a3a-364c-4c88-b30c-98d4ad4bbc63","Type":"ContainerDied","Data":"0aa95b49442226a904622671b673243e081656503a6ec0dc4a1f3fc7a1270604"}
Jul 07 14:11:11.473513 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:11.473480    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b" event={"ID":"ced40f1d-ffb2-426d-b1fd-a5935722b33e","Type":"ContainerStarted","Data":"3322783b73271f3e87cf21347276339a0ce5a944157be1c9d9307ec9c00c8bc1"}
Jul 07 14:11:11.476596 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:11.476357    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl" event={"ID":"8f1af4ad-bf0d-416a-a084-1461692f8307","Type":"ContainerStarted","Data":"c54b7ce9efd66c929e8d758ca505bc895050d043e52e9bba1d9647e94fb87b94"}
Jul 07 14:11:11.476596 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:11.476415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl" event={"ID":"8f1af4ad-bf0d-416a-a084-1461692f8307","Type":"ContainerStarted","Data":"fe8b7d5e5567d8b32ee4435befe5d9fe392f45d6547d018b7b621ce319126929"}
Jul 07 14:11:11.476596 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:11.476444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl" event={"ID":"8f1af4ad-bf0d-416a-a084-1461692f8307","Type":"ContainerStarted","Data":"0a916b147d64561deda9b6fbe7042b18b714aed33805690ea296a5f6106185f6"}
Jul 07 14:11:11.510127 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:11.510066    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7l4gl" podStartSLOduration=2.930847632 podStartE2EDuration="4.510044451s" totalImagesPullingTime="1.579196819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:11.509684841 +0000 UTC m=+236.340769329" watchObservedRunningTime="2026-07-07 14:11:11.510044451 +0000 UTC m=+236.341128940"
Jul 07 14:11:12.252220 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.252181    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"]
Jul 07 14:11:12.255925 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.255905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.259125 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.258837    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 14:11:12.259125 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.258847    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 14:11:12.259125 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.258837    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 14:11:12.259125 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.258911    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t88mg\""
Jul 07 14:11:12.259125 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.258971    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 14:11:12.259125 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.258990    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 14:11:12.265197 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.265175    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 14:11:12.268820 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.268801    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"]
Jul 07 14:11:12.348064 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.348025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-secret-telemeter-client\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.348257 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.348074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-federate-client-tls\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.348257 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.348142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d97z\" (UniqueName: \"kubernetes.io/projected/3ae13a15-87a5-43f8-9e68-65d92211e5fb-kube-api-access-5d97z\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.348257 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.348204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.348378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.348285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.348378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.348361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-metrics-client-ca\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.348468 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.348396    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-telemeter-client-tls\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.348468 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.348437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-serving-certs-ca-bundle\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.449135 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.449097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-secret-telemeter-client\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.449135 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.449144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-federate-client-tls\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.449392 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.449174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d97z\" (UniqueName: \"kubernetes.io/projected/3ae13a15-87a5-43f8-9e68-65d92211e5fb-kube-api-access-5d97z\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.449392 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.449201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.449392 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.449255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.449392 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.449317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-metrics-client-ca\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.449392 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.449345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-telemeter-client-tls\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.449392 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.449383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-serving-certs-ca-bundle\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.450293 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.450216    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-serving-certs-ca-bundle\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.450293 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.450219    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-metrics-client-ca\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.450658 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.450525    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ae13a15-87a5-43f8-9e68-65d92211e5fb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.452501 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.452476    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.452660 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.452618    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-secret-telemeter-client\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.452750 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.452732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-federate-client-tls\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.452962 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.452942    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3ae13a15-87a5-43f8-9e68-65d92211e5fb-telemeter-client-tls\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.458354 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.458332    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d97z\" (UniqueName: \"kubernetes.io/projected/3ae13a15-87a5-43f8-9e68-65d92211e5fb-kube-api-access-5d97z\") pod \"telemeter-client-6c85f8b586-jxbfw\" (UID: \"3ae13a15-87a5-43f8-9e68-65d92211e5fb\") " pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.483967 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.483927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn55k" event={"ID":"e8595a3a-364c-4c88-b30c-98d4ad4bbc63","Type":"ContainerStarted","Data":"d45657c0dfd1293546463991d9dee5789cbfe0a4fe8c45a226d5c59d67fed6ff"}
Jul 07 14:11:12.484430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.483989    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn55k" event={"ID":"e8595a3a-364c-4c88-b30c-98d4ad4bbc63","Type":"ContainerStarted","Data":"da2f08f46a51a569df03351cd2c85e4e23828fc8422fdf517fb5b120db3c4d1e"}
Jul 07 14:11:12.506458 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.506355    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gn55k" podStartSLOduration=3.730557158 podStartE2EDuration="5.506338981s" totalImagesPullingTime="1.683455582s" totalInitContainerRuntime="92.326241ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:12.505430764 +0000 UTC m=+237.336515264" watchObservedRunningTime="2026-07-07 14:11:12.506338981 +0000 UTC m=+237.337423468"
Jul 07 14:11:12.567871 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.567837    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"
Jul 07 14:11:12.870946 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:12.870822    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c85f8b586-jxbfw"]
Jul 07 14:11:12.874254 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:12.874228    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae13a15_87a5_43f8_9e68_65d92211e5fb.slice/crio-2611fb0adcde673fb5285812c75a306572861373fcdd90578d27a06eb294b48e WatchSource:0}: Error finding container 2611fb0adcde673fb5285812c75a306572861373fcdd90578d27a06eb294b48e: Status 404 returned error can't find the container with id 2611fb0adcde673fb5285812c75a306572861373fcdd90578d27a06eb294b48e
Jul 07 14:11:13.259055 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.259006    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:11:13.263951 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.263919    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.266918 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.266889    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 14:11:13.267089 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.267049    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 14:11:13.267244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.267176    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 14:11:13.267888 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.267416    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d0b9uup1ugsac\""
Jul 07 14:11:13.267981 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.267945    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 14:11:13.269963 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.268110    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 14:11:13.269963 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.268505    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rjwvm\""
Jul 07 14:11:13.269963 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.269008    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 14:11:13.269963 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.269704    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 14:11:13.270228 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.270149    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 14:11:13.270228 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.270222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 14:11:13.270383 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.270362    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 14:11:13.270807 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.270374    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 14:11:13.271187 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.271166    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 14:11:13.271383 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.271363    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 14:11:13.272881 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.272859    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 14:11:13.277861 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.277837    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 14:11:13.286031 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.285999    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:11:13.360229 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360190    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360229 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360495 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360495 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360495 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360495 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360495 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360451    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360495 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360877 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360877 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r88nn\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-kube-api-access-r88nn\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360877 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360877 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360877 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.360877 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.361093 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.361093 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.361093 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.360984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.361093 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.361025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.361093 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.361047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.361241 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.361085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-config\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.461860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.461812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.461860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.461860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.462115 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.461906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.462115 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.461931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.462115 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.461955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464195 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464150    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-config\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r88nn\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-kube-api-access-r88nn\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.464672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.465015 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.464681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.465079 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.465009    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.468146 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.465681    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.468146 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.466000    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.468146 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.466554    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.468146 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.466617    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.468146 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.467370    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.468146 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.467856    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.468146 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.467860    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.469474 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.469447    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.469593 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.469575    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.470172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.470146    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.470954 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.470791    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.470954 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.470893    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.470954 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.470912    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.471250 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.471196    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.472200 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.472160    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.472330 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.472305    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.472330 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.472323    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-config\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.472975 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.472944    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.479505 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.479482    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r88nn\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-kube-api-access-r88nn\") pod \"prometheus-k8s-0\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.490908 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.490870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw" event={"ID":"3ae13a15-87a5-43f8-9e68-65d92211e5fb","Type":"ContainerStarted","Data":"2611fb0adcde673fb5285812c75a306572861373fcdd90578d27a06eb294b48e"}
Jul 07 14:11:13.495594 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.495553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b" event={"ID":"ced40f1d-ffb2-426d-b1fd-a5935722b33e","Type":"ContainerStarted","Data":"259dca9f0aed35d0379b5c4df9403f2628de532ea594ac756ac83e711bb2543b"}
Jul 07 14:11:13.495764 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.495658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b" event={"ID":"ced40f1d-ffb2-426d-b1fd-a5935722b33e","Type":"ContainerStarted","Data":"7a72883dedef6ce1623578fe70918ddabf22bd64e9e650f939407b72e3bb689d"}
Jul 07 14:11:13.495764 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.495708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b" event={"ID":"ced40f1d-ffb2-426d-b1fd-a5935722b33e","Type":"ContainerStarted","Data":"b9f1f976d814399d6a517062b15f4d7e33a4d1818fedab0d1c1dce4e3ecb9fad"}
Jul 07 14:11:13.580774 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.580695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:13.940998 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:13.940971    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:11:13.944833 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:13.944805    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2f33ff_217c_4b6d_9267_fdc367535101.slice/crio-df4d2608cd4ccb8350947c25f46920c0ac4f72f507b40c7328b4e3ab47028b52 WatchSource:0}: Error finding container df4d2608cd4ccb8350947c25f46920c0ac4f72f507b40c7328b4e3ab47028b52: Status 404 returned error can't find the container with id df4d2608cd4ccb8350947c25f46920c0ac4f72f507b40c7328b4e3ab47028b52
Jul 07 14:11:14.502747 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:14.502702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b" event={"ID":"ced40f1d-ffb2-426d-b1fd-a5935722b33e","Type":"ContainerStarted","Data":"07a5100bca4da4e74203687006a88a5aad4d48039d77fa40b9a5fe6a24d483fd"}
Jul 07 14:11:14.503216 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:14.502800    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b" event={"ID":"ced40f1d-ffb2-426d-b1fd-a5935722b33e","Type":"ContainerStarted","Data":"1455eb848dc475671ecf4b286212edfa228cb8aee29e2477ffa2114fb846e440"}
Jul 07 14:11:14.503216 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:14.502837    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b" event={"ID":"ced40f1d-ffb2-426d-b1fd-a5935722b33e","Type":"ContainerStarted","Data":"b8e638d7dabb1b80a9aff5a5d63fdf29a97442ad44bf2792b2104e81f5e8b8cd"}
Jul 07 14:11:14.503216 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:14.502878    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:14.503986 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:14.503956    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerStarted","Data":"df4d2608cd4ccb8350947c25f46920c0ac4f72f507b40c7328b4e3ab47028b52"}
Jul 07 14:11:14.528191 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:14.528138    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b" podStartSLOduration=1.5476002530000001 podStartE2EDuration="4.528120332s" totalImagesPullingTime="2.980520079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:14.527617679 +0000 UTC m=+239.358702167" watchObservedRunningTime="2026-07-07 14:11:14.528120332 +0000 UTC m=+239.359204819"
Jul 07 14:11:16.516194 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:16.516153    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw" event={"ID":"3ae13a15-87a5-43f8-9e68-65d92211e5fb","Type":"ContainerStarted","Data":"97082c6251f1abd9e0b76be79f5613afca801944c2ce5d59f8c9e2adf052f315"}
Jul 07 14:11:16.516617 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:16.516230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw" event={"ID":"3ae13a15-87a5-43f8-9e68-65d92211e5fb","Type":"ContainerStarted","Data":"8fb4f449f2e671488e6a0c763de6be16cbd88cfd94dbf7d5369fc89e5ade3076"}
Jul 07 14:11:16.516617 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:16.516263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw" event={"ID":"3ae13a15-87a5-43f8-9e68-65d92211e5fb","Type":"ContainerStarted","Data":"4f57ad72001991b347d2f51475cf0adb02a186d7f98312e2a42f2d9595a22e62"}
Jul 07 14:11:16.517598 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:16.517573    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerID="66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64" exitCode=0
Jul 07 14:11:16.517676 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:16.517661    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerDied","Data":"66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64"}
Jul 07 14:11:16.539966 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:16.539910    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c85f8b586-jxbfw" podStartSLOduration=1.847234636 podStartE2EDuration="4.539894427s" totalImagesPullingTime="2.692659791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:16.537134403 +0000 UTC m=+241.368218889" watchObservedRunningTime="2026-07-07 14:11:16.539894427 +0000 UTC m=+241.370978912"
Jul 07 14:11:16.709576 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:16.709544    2564 scope.go:117] "RemoveContainer" containerID="0445e487b6dfac110a52fee8eeeb75e75d797b5eb464a8f54d1066863eece833"
Jul 07 14:11:17.524166 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:17.524131    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:11:17.524542 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:17.524265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" event={"ID":"6ba46223-105a-42fa-911d-7a49fb4d061a","Type":"ContainerStarted","Data":"9768ce9b3543398840cf8a46b19ca220704d72358b389ac461bd99129ec9f83d"}
Jul 07 14:11:17.542656 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:17.542563    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-vxntv" podStartSLOduration=51.924981393 podStartE2EDuration="54.542538443s" totalImagesPullingTime="2.61755705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:17.540459746 +0000 UTC m=+242.371544234" watchObservedRunningTime="2026-07-07 14:11:17.542538443 +0000 UTC m=+242.373622931"
Jul 07 14:11:20.515541 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:20.515500    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85c6bf7d45-qrq6b"
Jul 07 14:11:21.548526 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:21.548438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerStarted","Data":"3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04"}
Jul 07 14:11:21.548980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:21.548533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerStarted","Data":"678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446"}
Jul 07 14:11:21.548980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:21.548564    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerStarted","Data":"a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f"}
Jul 07 14:11:21.548980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:21.548589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerStarted","Data":"35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d"}
Jul 07 14:11:21.548980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:21.548612    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerStarted","Data":"a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62"}
Jul 07 14:11:21.548980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:21.548659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerStarted","Data":"93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb"}
Jul 07 14:11:21.579403 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:21.579347    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.577145178 podStartE2EDuration="8.579329689s" totalImagesPullingTime="5.981605824s" totalInitContainerRuntime="20.578687ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:21.576572898 +0000 UTC m=+246.407657385" watchObservedRunningTime="2026-07-07 14:11:21.579329689 +0000 UTC m=+246.410414176"
Jul 07 14:11:23.581901 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:23.581862    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:11:27.406559 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:27.406515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:11:27.409109 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:27.409078    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563-metrics-certs\") pod \"network-metrics-daemon-8zsw6\" (UID: \"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563\") " pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:11:27.512703 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:27.512670    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wgdzp\""
Jul 07 14:11:27.520018 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:27.519994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8zsw6"
Jul 07 14:11:27.525445 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:27.525424    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:11:27.530069 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:27.530046    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-vxntv"
Jul 07 14:11:27.665966 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:27.665937    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8zsw6"]
Jul 07 14:11:27.668518 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:11:27.668490    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664f6f4a_aaf6_4e6e_9da0_f5fdf09a7563.slice/crio-61583cee7ce47fa76c19e59131fb14cde762f3776df3a5e469affaa4e2ac9daa WatchSource:0}: Error finding container 61583cee7ce47fa76c19e59131fb14cde762f3776df3a5e469affaa4e2ac9daa: Status 404 returned error can't find the container with id 61583cee7ce47fa76c19e59131fb14cde762f3776df3a5e469affaa4e2ac9daa
Jul 07 14:11:28.583871 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:28.583824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8zsw6" event={"ID":"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563","Type":"ContainerStarted","Data":"61583cee7ce47fa76c19e59131fb14cde762f3776df3a5e469affaa4e2ac9daa"}
Jul 07 14:11:29.589577 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:29.589546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8zsw6" event={"ID":"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563","Type":"ContainerStarted","Data":"417aad4be733bbe163bb68aaccf19593a08252710d9cb95122eb64d3cd99d1a0"}
Jul 07 14:11:29.589983 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:29.589603    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8zsw6" event={"ID":"664f6f4a-aaf6-4e6e-9da0-f5fdf09a7563","Type":"ContainerStarted","Data":"635a066c852e1edd6c964cc31a1417030491b02936fca540efbc26261d37dc84"}
Jul 07 14:11:29.606873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:29.606817    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8zsw6" podStartSLOduration=253.170941599 podStartE2EDuration="4m14.606801235s" totalImagesPullingTime="1.435859636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:29.606454452 +0000 UTC m=+254.437538949" watchObservedRunningTime="2026-07-07 14:11:29.606801235 +0000 UTC m=+254.437885721"
Jul 07 14:11:38.633384 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:38.633349    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d" containerID="ce6c7a2ebce20800ff73089e05900e60e12552bf7a5496574a24d157935436be" exitCode=0
Jul 07 14:11:38.633818 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:38.633423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4" event={"ID":"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d","Type":"ContainerDied","Data":"ce6c7a2ebce20800ff73089e05900e60e12552bf7a5496574a24d157935436be"}
Jul 07 14:11:38.633818 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:38.633750    2564 scope.go:117] "RemoveContainer" containerID="ce6c7a2ebce20800ff73089e05900e60e12552bf7a5496574a24d157935436be"
Jul 07 14:11:39.639027 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:39.638991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-fjbv4" event={"ID":"e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d","Type":"ContainerStarted","Data":"9250b2c565373b0b5b93658240a3bed3c89cd9a1a9a937143d480adbbd252748"}
Jul 07 14:11:53.716494 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:53.716469    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7l4gl_8f1af4ad-bf0d-416a-a084-1461692f8307/kube-state-metrics/0.log"
Jul 07 14:11:53.919395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:53.919361    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7l4gl_8f1af4ad-bf0d-416a-a084-1461692f8307/kube-rbac-proxy-main/0.log"
Jul 07 14:11:54.116956 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:54.116877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7l4gl_8f1af4ad-bf0d-416a-a084-1461692f8307/kube-rbac-proxy-self/0.log"
Jul 07 14:11:54.716592 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:54.716565    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn55k_e8595a3a-364c-4c88-b30c-98d4ad4bbc63/init-textfile/0.log"
Jul 07 14:11:54.917601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:54.917570    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn55k_e8595a3a-364c-4c88-b30c-98d4ad4bbc63/node-exporter/0.log"
Jul 07 14:11:55.117258 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:55.117184    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn55k_e8595a3a-364c-4c88-b30c-98d4ad4bbc63/kube-rbac-proxy/0.log"
Jul 07 14:11:56.185959 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:11:56.185908    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bnq5v" podUID="4be4ed7e-4a00-4ab0-8b9c-02276c6511cf"
Jul 07 14:11:56.516663 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:56.516556    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fsfd6_4fa338ad-3179-4a34-b805-c35c869abb08/kube-rbac-proxy-main/0.log"
Jul 07 14:11:56.712935 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:56.712904    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:11:56.716023 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:56.716002    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fsfd6_4fa338ad-3179-4a34-b805-c35c869abb08/kube-rbac-proxy-self/0.log"
Jul 07 14:11:56.916528 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:56.916501    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fsfd6_4fa338ad-3179-4a34-b805-c35c869abb08/openshift-state-metrics/0.log"
Jul 07 14:11:57.116316 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:57.116291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5e2f33ff-217c-4b6d-9267-fdc367535101/init-config-reloader/0.log"
Jul 07 14:11:57.321537 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:57.317738    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5e2f33ff-217c-4b6d-9267-fdc367535101/prometheus/0.log"
Jul 07 14:11:57.517309 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:57.517283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5e2f33ff-217c-4b6d-9267-fdc367535101/config-reloader/0.log"
Jul 07 14:11:57.716884 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:57.716859    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5e2f33ff-217c-4b6d-9267-fdc367535101/thanos-sidecar/0.log"
Jul 07 14:11:57.916675 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:57.916648    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5e2f33ff-217c-4b6d-9267-fdc367535101/kube-rbac-proxy-web/0.log"
Jul 07 14:11:58.117790 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:58.117717    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5e2f33ff-217c-4b6d-9267-fdc367535101/kube-rbac-proxy/0.log"
Jul 07 14:11:58.317446 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:58.317413    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5e2f33ff-217c-4b6d-9267-fdc367535101/kube-rbac-proxy-thanos/0.log"
Jul 07 14:11:58.518650 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:58.518616    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4kj52_fdc4afbe-5e80-4328-99da-069815c7ec00/prometheus-operator/0.log"
Jul 07 14:11:58.717211 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:58.717186    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4kj52_fdc4afbe-5e80-4328-99da-069815c7ec00/kube-rbac-proxy/0.log"
Jul 07 14:11:58.915680 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:58.915649    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-46v56_d67a7fde-9c40-4951-94c7-5017011177a7/prometheus-operator-admission-webhook/0.log"
Jul 07 14:11:59.116133 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:59.116109    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c85f8b586-jxbfw_3ae13a15-87a5-43f8-9e68-65d92211e5fb/telemeter-client/0.log"
Jul 07 14:11:59.316724 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:59.316650    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c85f8b586-jxbfw_3ae13a15-87a5-43f8-9e68-65d92211e5fb/reload/0.log"
Jul 07 14:11:59.516557 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:59.516517    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c85f8b586-jxbfw_3ae13a15-87a5-43f8-9e68-65d92211e5fb/kube-rbac-proxy/0.log"
Jul 07 14:11:59.715954 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:59.715930    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/thanos-query/0.log"
Jul 07 14:11:59.916229 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:59.916177    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/kube-rbac-proxy-web/0.log"
Jul 07 14:11:59.994837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:59.994760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:11:59.997259 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:11:59.997240    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4be4ed7e-4a00-4ab0-8b9c-02276c6511cf-metrics-tls\") pod \"dns-default-bnq5v\" (UID: \"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf\") " pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:12:00.016189 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.016155    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cxvss\""
Jul 07 14:12:00.023604 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.023578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:12:00.116785 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.116754    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/kube-rbac-proxy/0.log"
Jul 07 14:12:00.165155 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.165131    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bnq5v"]
Jul 07 14:12:00.167697 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:12:00.167669    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be4ed7e_4a00_4ab0_8b9c_02276c6511cf.slice/crio-2ff8cecf28b1fb3873272a8827ff02d2da3cc8d7bf8b17833e67dd97f9c9a84e WatchSource:0}: Error finding container 2ff8cecf28b1fb3873272a8827ff02d2da3cc8d7bf8b17833e67dd97f9c9a84e: Status 404 returned error can't find the container with id 2ff8cecf28b1fb3873272a8827ff02d2da3cc8d7bf8b17833e67dd97f9c9a84e
Jul 07 14:12:00.316197 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.316112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/prom-label-proxy/0.log"
Jul 07 14:12:00.516275 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.516246    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/kube-rbac-proxy-rules/0.log"
Jul 07 14:12:00.716402 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.716369    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/kube-rbac-proxy-metrics/0.log"
Jul 07 14:12:00.728967 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.728939    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnq5v" event={"ID":"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf","Type":"ContainerStarted","Data":"2ff8cecf28b1fb3873272a8827ff02d2da3cc8d7bf8b17833e67dd97f9c9a84e"}
Jul 07 14:12:00.916880 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:00.916847    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-594lf_b1f5e365-9efd-4a80-b21c-5b446aab6340/networking-console-plugin/0.log"
Jul 07 14:12:01.119853 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:01.119784    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:12:01.318345 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:01.318312    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/3.log"
Jul 07 14:12:02.739227 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:02.739191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnq5v" event={"ID":"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf","Type":"ContainerStarted","Data":"72325fb57695c6dce86bdb19600d941d22d37b1f992f25e88acfb0c5d77b0637"}
Jul 07 14:12:02.739650 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:02.739245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bnq5v" event={"ID":"4be4ed7e-4a00-4ab0-8b9c-02276c6511cf","Type":"ContainerStarted","Data":"a0e6712f71a7c7f68316d82856558006d16b7d1f092969e1ace8a8781e4d2de8"}
Jul 07 14:12:02.739650 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:02.739310    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:12:02.758836 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:02.758783    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bnq5v" podStartSLOduration=250.772644447 podStartE2EDuration="4m12.758766683s" totalImagesPullingTime="1.986122236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:12:02.757415058 +0000 UTC m=+287.588499536" watchObservedRunningTime="2026-07-07 14:12:02.758766683 +0000 UTC m=+287.589851170"
Jul 07 14:12:03.316358 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:03.316329    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-65fwj_6d939d2a-40f6-4fec-8cc8-3c0e5334d502/dns-node-resolver/0.log"
Jul 07 14:12:04.717477 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:04.717445    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xr9q6_18a01f98-93bb-4b3e-8786-f20c762b3b0b/node-ca/0.log"
Jul 07 14:12:04.917335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:04.917302    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76bd7978f-vbn26_9870b139-e587-4211-a0f3-210bf678bb37/router/0.log"
Jul 07 14:12:05.317206 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:05.317177    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kj7vc_7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0/serve-healthcheck-canary/0.log"
Jul 07 14:12:12.746053 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:12.746022    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bnq5v"
Jul 07 14:12:13.581723 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:13.581679    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:13.600457 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:13.600424    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:13.808855 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:13.808786    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:15.519968 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:15.519937    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:12:15.525778 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:15.525746    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:12:15.531203 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:15.531175    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 14:12:31.660140 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.660105    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:12:31.663915 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.660460    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy" containerID="cri-o://678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446" gracePeriod=600
Jul 07 14:12:31.663915 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.660489    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="config-reloader" containerID="cri-o://a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62" gracePeriod=600
Jul 07 14:12:31.663915 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.660495    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04" gracePeriod=600
Jul 07 14:12:31.663915 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.660520    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy-web" containerID="cri-o://a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f" gracePeriod=600
Jul 07 14:12:31.663915 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.660527    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="thanos-sidecar" containerID="cri-o://35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d" gracePeriod=600
Jul 07 14:12:31.663915 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.660442    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="prometheus" containerID="cri-o://93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb" gracePeriod=600
Jul 07 14:12:31.872913 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.872699    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerID="35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d" exitCode=0
Jul 07 14:12:31.872913 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.872734    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerID="a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62" exitCode=0
Jul 07 14:12:31.872913 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.872783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerDied","Data":"35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d"}
Jul 07 14:12:31.872913 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:31.872854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerDied","Data":"a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62"}
Jul 07 14:12:32.881991 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:32.881954    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerID="3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04" exitCode=0
Jul 07 14:12:32.881991 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:32.881981    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerID="678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446" exitCode=0
Jul 07 14:12:32.881991 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:32.881990    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerID="a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f" exitCode=0
Jul 07 14:12:32.882550 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:32.882007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerDied","Data":"3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04"}
Jul 07 14:12:32.882550 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:32.882102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerDied","Data":"678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446"}
Jul 07 14:12:32.882550 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:32.882129    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerDied","Data":"a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f"}
Jul 07 14:12:33.793583 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:33.793539    2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 07 14:12:33.794599 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:33.794559    2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 07 14:12:33.795478 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:33.795451    2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 07 14:12:33.795552 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:33.795491    2564 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="prometheus" probeResult="unknown"
Jul 07 14:12:38.793019 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.792907    2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb is running failed: container process not found" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 07 14:12:38.793913 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.793876    2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb is running failed: container process not found" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 07 14:12:38.794183 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.794156    2564 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb is running failed: container process not found" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 07 14:12:38.794272 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.794199    2564 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb is running failed: container process not found" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="prometheus" probeResult="unknown"
Jul 07 14:12:38.817458 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.817434    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:38.913175 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.913084    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb" exitCode=0
Jul 07 14:12:38.913175 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.913156    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:38.913175 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.913162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerDied","Data":"93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb"}
Jul 07 14:12:38.913402 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.913229    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e2f33ff-217c-4b6d-9267-fdc367535101","Type":"ContainerDied","Data":"df4d2608cd4ccb8350947c25f46920c0ac4f72f507b40c7328b4e3ab47028b52"}
Jul 07 14:12:38.913402 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.913264    2564 scope.go:117] "RemoveContainer" containerID="3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04"
Jul 07 14:12:38.921224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.921206    2564 scope.go:117] "RemoveContainer" containerID="678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446"
Jul 07 14:12:38.928810 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.928464    2564 scope.go:117] "RemoveContainer" containerID="a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f"
Jul 07 14:12:38.936050 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.936032    2564 scope.go:117] "RemoveContainer" containerID="35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d"
Jul 07 14:12:38.943584 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.943564    2564 scope.go:117] "RemoveContainer" containerID="a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62"
Jul 07 14:12:38.944268 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944249    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-2\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944388 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944283    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-db\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944388 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944302    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-web-config\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944388 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944335    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-grpc-tls\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944388 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944367    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-0\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-tls-assets\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944479    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-trusted-ca-bundle\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944502    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-kube-rbac-proxy\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944522    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-config\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944560    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.944601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944588    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-serving-certs-ca-bundle\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.945014 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944625    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-metrics-client-ca\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.945014 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944662    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:38.945014 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.944708    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-tls\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.945619 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.945387    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-thanos-prometheus-http-client-file\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.945619 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.945460    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r88nn\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-kube-api-access-r88nn\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.945619 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.945487    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-metrics-client-certs\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.945619 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.945517    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-1\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.945619 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.945544    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:12:38.945619 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.945557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-kubelet-serving-ca-bundle\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.945994 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.945867    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:38.946602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.946072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-config-out\") pod \"5e2f33ff-217c-4b6d-9267-fdc367535101\" (UID: \"5e2f33ff-217c-4b6d-9267-fdc367535101\") "
Jul 07 14:12:38.946602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.946179    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:38.946602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.946386    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:38.946602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.946404    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-db\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:38.946602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.946420    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:38.946602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.946437    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-metrics-client-ca\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:38.946962 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.946558    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:38.947051 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.946965    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:38.947331 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.947303    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:38.947448 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.947428    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:38.950530 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.950491    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.950661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.950611    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-config" (OuterVolumeSpecName: "config") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.950661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.950625    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.950964 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.950731    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.951064 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.951041    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-kube-api-access-r88nn" (OuterVolumeSpecName: "kube-api-access-r88nn") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "kube-api-access-r88nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:12:38.951819 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.951794    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.951911 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.951817    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.952113 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.952083    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.952456 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.952430    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.952456 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.952465    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-config-out" (OuterVolumeSpecName: "config-out") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:12:38.952602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.952497    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:12:38.961459 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.961440    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-web-config" (OuterVolumeSpecName: "web-config") pod "5e2f33ff-217c-4b6d-9267-fdc367535101" (UID: "5e2f33ff-217c-4b6d-9267-fdc367535101"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:38.969203 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.969180    2564 scope.go:117] "RemoveContainer" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb"
Jul 07 14:12:38.976883 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.976868    2564 scope.go:117] "RemoveContainer" containerID="66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64"
Jul 07 14:12:38.983802 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.983786    2564 scope.go:117] "RemoveContainer" containerID="3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04"
Jul 07 14:12:38.984054 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.984035    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04\": container with ID starting with 3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04 not found: ID does not exist" containerID="3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04"
Jul 07 14:12:38.984112 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.984063    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04"} err="failed to get container status \"3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04\": rpc error: code = NotFound desc = could not find container \"3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04\": container with ID starting with 3ec58351a5127f91c826ac7340f59666c519b204a048997b2cac75dbcad56b04 not found: ID does not exist"
Jul 07 14:12:38.984112 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.984097    2564 scope.go:117] "RemoveContainer" containerID="678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446"
Jul 07 14:12:38.984294 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.984277    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446\": container with ID starting with 678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446 not found: ID does not exist" containerID="678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446"
Jul 07 14:12:38.984344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.984304    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446"} err="failed to get container status \"678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446\": rpc error: code = NotFound desc = could not find container \"678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446\": container with ID starting with 678a29240614ad2be5055692b85f6bc35980552ba62ed0d9a3460a40a9551446 not found: ID does not exist"
Jul 07 14:12:38.984344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.984326    2564 scope.go:117] "RemoveContainer" containerID="a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f"
Jul 07 14:12:38.984550 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.984531    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f\": container with ID starting with a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f not found: ID does not exist" containerID="a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f"
Jul 07 14:12:38.984591 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.984554    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f"} err="failed to get container status \"a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f\": rpc error: code = NotFound desc = could not find container \"a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f\": container with ID starting with a02cdd293b5c315e326a8d66aaf37498ef159bfa7d4525827e7cbd613f30746f not found: ID does not exist"
Jul 07 14:12:38.984591 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.984566    2564 scope.go:117] "RemoveContainer" containerID="35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d"
Jul 07 14:12:38.984820 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.984804    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d\": container with ID starting with 35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d not found: ID does not exist" containerID="35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d"
Jul 07 14:12:38.984876 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.984825    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d"} err="failed to get container status \"35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d\": rpc error: code = NotFound desc = could not find container \"35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d\": container with ID starting with 35184b2c6cf02320f6f25736480f64a175658cf0240712df23af4023c9f20c5d not found: ID does not exist"
Jul 07 14:12:38.984876 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.984838    2564 scope.go:117] "RemoveContainer" containerID="a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62"
Jul 07 14:12:38.985066 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.985051    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62\": container with ID starting with a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62 not found: ID does not exist" containerID="a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62"
Jul 07 14:12:38.985107 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.985071    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62"} err="failed to get container status \"a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62\": rpc error: code = NotFound desc = could not find container \"a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62\": container with ID starting with a7cd09668c788c22e1457ee7ade28f3ef355646021194b548a20b47242fd6c62 not found: ID does not exist"
Jul 07 14:12:38.985107 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.985083    2564 scope.go:117] "RemoveContainer" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb"
Jul 07 14:12:38.985318 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.985304    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb\": container with ID starting with 93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb not found: ID does not exist" containerID="93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb"
Jul 07 14:12:38.985355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.985323    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb"} err="failed to get container status \"93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb\": rpc error: code = NotFound desc = could not find container \"93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb\": container with ID starting with 93e70d8512904c188ac87e28d8ddae5383c5c1fb9b74ce0c73113c0308e7b6bb not found: ID does not exist"
Jul 07 14:12:38.985355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.985336    2564 scope.go:117] "RemoveContainer" containerID="66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64"
Jul 07 14:12:38.985557 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:12:38.985542    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64\": container with ID starting with 66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64 not found: ID does not exist" containerID="66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64"
Jul 07 14:12:38.985599 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:38.985560    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64"} err="failed to get container status \"66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64\": rpc error: code = NotFound desc = could not find container \"66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64\": container with ID starting with 66f2060411f327a1f70f859e2e3098bb7351143d4ef70c555b20e2094fe4ee64 not found: ID does not exist"
Jul 07 14:12:39.047479 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047445    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047479 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047471    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047479 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047484    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047492    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r88nn\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-kube-api-access-r88nn\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047501    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-metrics-client-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047509    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047519    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047527    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e2f33ff-217c-4b6d-9267-fdc367535101-config-out\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047535    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-web-config\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047542    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-grpc-tls\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047550    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047558    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e2f33ff-217c-4b6d-9267-fdc367535101-tls-assets\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047568    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047577    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e2f33ff-217c-4b6d-9267-fdc367535101-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047585    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-secret-kube-rbac-proxy\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.047814 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.047593    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e2f33ff-217c-4b6d-9267-fdc367535101-config\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:12:39.239180 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.239149    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:12:39.244231 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.244207    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:12:39.270485 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270448    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:12:39.270836 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270820    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy-web"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270838    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy-web"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270848    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="init-config-reloader"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270854    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="init-config-reloader"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270859    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270865    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270873    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="config-reloader"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270879    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="config-reloader"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270885    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="thanos-sidecar"
Jul 07 14:12:39.270892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270890    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="thanos-sidecar"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270899    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="prometheus"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270904    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="prometheus"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270913    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy-thanos"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270918    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy-thanos"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270969    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy-thanos"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270978    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="thanos-sidecar"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270984    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="config-reloader"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270990    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="prometheus"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.270996    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy"
Jul 07 14:12:39.271172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.271005    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" containerName="kube-rbac-proxy-web"
Jul 07 14:12:39.276801 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.276781    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.279566 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.279544    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 14:12:39.279714 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.279649    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d0b9uup1ugsac\""
Jul 07 14:12:39.279714 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.279662    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 14:12:39.279855 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.279739    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 14:12:39.279855 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.279836    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 14:12:39.280075 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280062    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 14:12:39.280137 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280107    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 14:12:39.280205 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280157    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 14:12:39.280297 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280266    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 14:12:39.280361 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280318    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 14:12:39.280361 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280331    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rjwvm\""
Jul 07 14:12:39.280468 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280368    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 14:12:39.280604 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280589    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 14:12:39.280703 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280595    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 14:12:39.280703 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.280672    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 14:12:39.283938 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.283766    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 14:12:39.286193 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.286173    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 14:12:39.288873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.288855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:12:39.450965 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.450929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.450965 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.450960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.450980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab50c5f6-a760-44b2-932c-8e5fabd0861b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab50c5f6-a760-44b2-932c-8e5fabd0861b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451348 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451348 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451348 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs8sl\" (UniqueName: \"kubernetes.io/projected/ab50c5f6-a760-44b2-932c-8e5fabd0861b-kube-api-access-qs8sl\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451348 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451277    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451348 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451348 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451511 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451511 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451511 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-config\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451511 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451511 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.451683 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.451510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552231 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552231 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552231 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552231 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552292    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-config\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab50c5f6-a760-44b2-932c-8e5fabd0861b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab50c5f6-a760-44b2-932c-8e5fabd0861b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552730    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.552806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.552761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs8sl\" (UniqueName: \"kubernetes.io/projected/ab50c5f6-a760-44b2-932c-8e5fabd0861b-kube-api-access-qs8sl\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.553052 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.553030    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.553089 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.553039    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556180    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab50c5f6-a760-44b2-932c-8e5fabd0861b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556252    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556297    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556301    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556311    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556357    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556430    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556461    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-config\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.556543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556480    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.557267 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.556768    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.557267 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.557019    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.557505 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.557476    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.557866 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.557844    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ab50c5f6-a760-44b2-932c-8e5fabd0861b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.558735 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.558706    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.558977 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.558961    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab50c5f6-a760-44b2-932c-8e5fabd0861b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.559063 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.559043    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.559096 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.559049    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab50c5f6-a760-44b2-932c-8e5fabd0861b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.562169 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.562145    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs8sl\" (UniqueName: \"kubernetes.io/projected/ab50c5f6-a760-44b2-932c-8e5fabd0861b-kube-api-access-qs8sl\") pod \"prometheus-k8s-0\" (UID: \"ab50c5f6-a760-44b2-932c-8e5fabd0861b\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.586854 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.586832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:12:39.715242 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.715212    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e2f33ff-217c-4b6d-9267-fdc367535101" path="/var/lib/kubelet/pods/5e2f33ff-217c-4b6d-9267-fdc367535101/volumes"
Jul 07 14:12:39.737503 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.737466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 14:12:39.743926 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:12:39.743898    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab50c5f6_a760_44b2_932c_8e5fabd0861b.slice/crio-4045410367da7b40f35dd25dcfc044cfe58ad28296939ef60971f08a0f07392a WatchSource:0}: Error finding container 4045410367da7b40f35dd25dcfc044cfe58ad28296939ef60971f08a0f07392a: Status 404 returned error can't find the container with id 4045410367da7b40f35dd25dcfc044cfe58ad28296939ef60971f08a0f07392a
Jul 07 14:12:39.920502 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.920461    2564 generic.go:356] "Generic (PLEG): container finished" podID="ab50c5f6-a760-44b2-932c-8e5fabd0861b" containerID="5551ec8a692081ff9c3c3b623a207c9819ba088c15217b39f14f19eab7d1090b" exitCode=0
Jul 07 14:12:39.920933 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.920508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab50c5f6-a760-44b2-932c-8e5fabd0861b","Type":"ContainerDied","Data":"5551ec8a692081ff9c3c3b623a207c9819ba088c15217b39f14f19eab7d1090b"}
Jul 07 14:12:39.920933 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:39.920568    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab50c5f6-a760-44b2-932c-8e5fabd0861b","Type":"ContainerStarted","Data":"4045410367da7b40f35dd25dcfc044cfe58ad28296939ef60971f08a0f07392a"}
Jul 07 14:12:40.928457 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:40.928370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab50c5f6-a760-44b2-932c-8e5fabd0861b","Type":"ContainerStarted","Data":"eab7286f75adfac8a533347f6b1bd5ff156c0322d90838af8e5ca9f8751a273b"}
Jul 07 14:12:40.928457 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:40.928439    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab50c5f6-a760-44b2-932c-8e5fabd0861b","Type":"ContainerStarted","Data":"d1c6f48298b8a3a73ede1c9e5d701c601333edb12c45b7b60e9408eba37ad5e7"}
Jul 07 14:12:40.928860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:40.928465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab50c5f6-a760-44b2-932c-8e5fabd0861b","Type":"ContainerStarted","Data":"56d47c5018b375109e10eab7cc3e3789100b23caffc76ce088dd865d6f5a9c71"}
Jul 07 14:12:40.928860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:40.928496    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab50c5f6-a760-44b2-932c-8e5fabd0861b","Type":"ContainerStarted","Data":"7e32eabc483d00ee6100829d04f42f4241a8add66ed8e9b180bc6e90758243d5"}
Jul 07 14:12:40.928860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:40.928526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab50c5f6-a760-44b2-932c-8e5fabd0861b","Type":"ContainerStarted","Data":"2ce87a6b93809aa2edfb2f273566a080c3135fa71355a2ab6ae8410c1d452dc8"}
Jul 07 14:12:40.928860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:40.928550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ab50c5f6-a760-44b2-932c-8e5fabd0861b","Type":"ContainerStarted","Data":"b47eebf69c5873724b96f0fbd7a47fcea8403b49d58e97f330fac43fddc70d2a"}
Jul 07 14:12:40.960064 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:40.960012    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.936640468 podStartE2EDuration="1.959990053s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.349585ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:12:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:12:40.957359684 +0000 UTC m=+325.788444181" watchObservedRunningTime="2026-07-07 14:12:40.959990053 +0000 UTC m=+325.791074541"
Jul 07 14:12:44.587124 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:12:44.587086    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:13:39.587230 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:39.587195    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:13:39.604253 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:39.604227    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:13:40.185335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:40.185305    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 14:13:59.429346 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.429314    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"]
Jul 07 14:13:59.433371 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.433353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"
Jul 07 14:13:59.436943 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.436920    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hd4s9\""
Jul 07 14:13:59.437086 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.436973    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 14:13:59.438174 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.438155    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:13:59.441390 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.441364    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"]
Jul 07 14:13:59.539046 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.539011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb2d73eb-74e4-4204-bc66-91f0fabe1325-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l49pd\" (UID: \"bb2d73eb-74e4-4204-bc66-91f0fabe1325\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"
Jul 07 14:13:59.539242 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.539055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwj7l\" (UniqueName: \"kubernetes.io/projected/bb2d73eb-74e4-4204-bc66-91f0fabe1325-kube-api-access-kwj7l\") pod \"openshift-lws-operator-fd8ccff4c-l49pd\" (UID: \"bb2d73eb-74e4-4204-bc66-91f0fabe1325\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"
Jul 07 14:13:59.639653 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.639596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwj7l\" (UniqueName: \"kubernetes.io/projected/bb2d73eb-74e4-4204-bc66-91f0fabe1325-kube-api-access-kwj7l\") pod \"openshift-lws-operator-fd8ccff4c-l49pd\" (UID: \"bb2d73eb-74e4-4204-bc66-91f0fabe1325\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"
Jul 07 14:13:59.639853 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.639736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb2d73eb-74e4-4204-bc66-91f0fabe1325-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l49pd\" (UID: \"bb2d73eb-74e4-4204-bc66-91f0fabe1325\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"
Jul 07 14:13:59.640078 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.640061    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb2d73eb-74e4-4204-bc66-91f0fabe1325-tmp\") pod \"openshift-lws-operator-fd8ccff4c-l49pd\" (UID: \"bb2d73eb-74e4-4204-bc66-91f0fabe1325\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"
Jul 07 14:13:59.648964 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.648941    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwj7l\" (UniqueName: \"kubernetes.io/projected/bb2d73eb-74e4-4204-bc66-91f0fabe1325-kube-api-access-kwj7l\") pod \"openshift-lws-operator-fd8ccff4c-l49pd\" (UID: \"bb2d73eb-74e4-4204-bc66-91f0fabe1325\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"
Jul 07 14:13:59.765929 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.765843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"
Jul 07 14:13:59.900434 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.900407    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd"]
Jul 07 14:13:59.903427 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:13:59.903400    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb2d73eb_74e4_4204_bc66_91f0fabe1325.slice/crio-e2a69fb71a2668546b1376e854187d7eb5ba92ffe7ef7a7d2888cba9225effbd WatchSource:0}: Error finding container e2a69fb71a2668546b1376e854187d7eb5ba92ffe7ef7a7d2888cba9225effbd: Status 404 returned error can't find the container with id e2a69fb71a2668546b1376e854187d7eb5ba92ffe7ef7a7d2888cba9225effbd
Jul 07 14:13:59.905215 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:13:59.905196    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:14:00.254428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:00.254390    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd" event={"ID":"bb2d73eb-74e4-4204-bc66-91f0fabe1325","Type":"ContainerStarted","Data":"e2a69fb71a2668546b1376e854187d7eb5ba92ffe7ef7a7d2888cba9225effbd"}
Jul 07 14:14:03.271082 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:03.271043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd" event={"ID":"bb2d73eb-74e4-4204-bc66-91f0fabe1325","Type":"ContainerStarted","Data":"9d4bbbe497c5cf9ab3dabf214d63d6be372d4becb09cbdf4f9df2e6e9d2cd355"}
Jul 07 14:14:03.288219 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:03.288168    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-l49pd" podStartSLOduration=1.756760589 podStartE2EDuration="4.288149626s" totalImagesPullingTime="2.531389037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:03.287423958 +0000 UTC m=+408.118508455" watchObservedRunningTime="2026-07-07 14:14:03.288149626 +0000 UTC m=+408.119234113"
Jul 07 14:14:19.520754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.520721    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"]
Jul 07 14:14:19.527351 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.527324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.529951 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.529924    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 14:14:19.530316 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.530296    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 14:14:19.530500 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.530488    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 14:14:19.530769 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.530753    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 14:14:19.530882 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.530867    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-55ddl\""
Jul 07 14:14:19.540971 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.540948    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"]
Jul 07 14:14:19.616165 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.616132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e069afb2-10dc-4136-bdbe-5041472e3efa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.616165 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.616169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e069afb2-10dc-4136-bdbe-5041472e3efa-webhook-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.616419 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.616188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqbfr\" (UniqueName: \"kubernetes.io/projected/e069afb2-10dc-4136-bdbe-5041472e3efa-kube-api-access-pqbfr\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.616419 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.616288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e069afb2-10dc-4136-bdbe-5041472e3efa-manifests\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.616419 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.616358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e069afb2-10dc-4136-bdbe-5041472e3efa-tmp\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.717558 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.717524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e069afb2-10dc-4136-bdbe-5041472e3efa-webhook-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.717558 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.717559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqbfr\" (UniqueName: \"kubernetes.io/projected/e069afb2-10dc-4136-bdbe-5041472e3efa-kube-api-access-pqbfr\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.717950 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.717584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e069afb2-10dc-4136-bdbe-5041472e3efa-manifests\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.717950 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.717622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e069afb2-10dc-4136-bdbe-5041472e3efa-tmp\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.717950 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.717720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e069afb2-10dc-4136-bdbe-5041472e3efa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.718160 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.718047    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e069afb2-10dc-4136-bdbe-5041472e3efa-manifests\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.720747 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.720709    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e069afb2-10dc-4136-bdbe-5041472e3efa-tmp\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.720881 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.720812    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e069afb2-10dc-4136-bdbe-5041472e3efa-webhook-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.721003 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.720980    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e069afb2-10dc-4136-bdbe-5041472e3efa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.728246 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.728217    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqbfr\" (UniqueName: \"kubernetes.io/projected/e069afb2-10dc-4136-bdbe-5041472e3efa-kube-api-access-pqbfr\") pod \"opendatahub-operator-controller-manager-55dcd65d78-fx4c7\" (UID: \"e069afb2-10dc-4136-bdbe-5041472e3efa\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:19.838671 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:19.838560    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:20.000451 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.000370    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"]
Jul 07 14:14:20.003334 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:14:20.003301    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode069afb2_10dc_4136_bdbe_5041472e3efa.slice/crio-c24741bed4d93a66a93677827d95cfe0acc402173d2e4c2f37185652b4f7a193 WatchSource:0}: Error finding container c24741bed4d93a66a93677827d95cfe0acc402173d2e4c2f37185652b4f7a193: Status 404 returned error can't find the container with id c24741bed4d93a66a93677827d95cfe0acc402173d2e4c2f37185652b4f7a193
Jul 07 14:14:20.062873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.062839    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489488d88-286j5"]
Jul 07 14:14:20.068246 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.068222    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.071956 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.071931    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4tmln\""
Jul 07 14:14:20.072371 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.072342    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 14:14:20.072508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.072494    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 14:14:20.078064 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.078007    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 14:14:20.098659 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.098562    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489488d88-286j5"]
Jul 07 14:14:20.222513 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.222477    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-manager-config\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.222513 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.222518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4ds7\" (UniqueName: \"kubernetes.io/projected/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-kube-api-access-s4ds7\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.222764 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.222548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-cert\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.222764 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.222565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-metrics-cert\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.323901 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.323866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-manager-config\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.323901 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.323902    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4ds7\" (UniqueName: \"kubernetes.io/projected/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-kube-api-access-s4ds7\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.324162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.323937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-cert\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.324162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.323954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-metrics-cert\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.324527 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.324485    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-manager-config\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.326572 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.326549    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-metrics-cert\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.326572 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.326568    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-cert\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.337606 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.337580    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4ds7\" (UniqueName: \"kubernetes.io/projected/1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef-kube-api-access-s4ds7\") pod \"lws-controller-manager-6489488d88-286j5\" (UID: \"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef\") " pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.343246 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.343221    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7" event={"ID":"e069afb2-10dc-4136-bdbe-5041472e3efa","Type":"ContainerStarted","Data":"c24741bed4d93a66a93677827d95cfe0acc402173d2e4c2f37185652b4f7a193"}
Jul 07 14:14:20.385330 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.385300    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:20.549158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:20.549128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6489488d88-286j5"]
Jul 07 14:14:20.550942 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:14:20.550910    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2f8e11_4514_46a8_9a0a_6e9b68eac2ef.slice/crio-a3f7dc47240e6e0c75ad7332f4d7c23dc50eaf58002a4c7be151b51cfdba5776 WatchSource:0}: Error finding container a3f7dc47240e6e0c75ad7332f4d7c23dc50eaf58002a4c7be151b51cfdba5776: Status 404 returned error can't find the container with id a3f7dc47240e6e0c75ad7332f4d7c23dc50eaf58002a4c7be151b51cfdba5776
Jul 07 14:14:21.352211 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:21.352120    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5" event={"ID":"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef","Type":"ContainerStarted","Data":"a3f7dc47240e6e0c75ad7332f4d7c23dc50eaf58002a4c7be151b51cfdba5776"}
Jul 07 14:14:24.369302 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:24.369254    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7" event={"ID":"e069afb2-10dc-4136-bdbe-5041472e3efa","Type":"ContainerStarted","Data":"06afb97c633747ae897bdbb8e78ccbb16aa726b62060ecdce998ec378463fa4c"}
Jul 07 14:14:24.370828 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:24.370805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5" event={"ID":"1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef","Type":"ContainerStarted","Data":"9b72b498e1f1a22a43f62286cc9ba8b1b51add8d819bf786b5be627c948f01eb"}
Jul 07 14:14:24.370906 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:24.370861    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:24.415030 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:24.414970    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5" podStartSLOduration=1.334225454 podStartE2EDuration="4.414953309s" totalImagesPullingTime="3.080727855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:24.413600939 +0000 UTC m=+429.244685426" watchObservedRunningTime="2026-07-07 14:14:24.414953309 +0000 UTC m=+429.246037796"
Jul 07 14:14:25.377102 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:25.377064    2564 generic.go:356] "Generic (PLEG): container finished" podID="e069afb2-10dc-4136-bdbe-5041472e3efa" containerID="06afb97c633747ae897bdbb8e78ccbb16aa726b62060ecdce998ec378463fa4c" exitCode=0
Jul 07 14:14:25.377615 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:25.377139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7" event={"ID":"e069afb2-10dc-4136-bdbe-5041472e3efa","Type":"ContainerDied","Data":"06afb97c633747ae897bdbb8e78ccbb16aa726b62060ecdce998ec378463fa4c"}
Jul 07 14:14:26.383618 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:26.383580    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7" event={"ID":"e069afb2-10dc-4136-bdbe-5041472e3efa","Type":"ContainerStarted","Data":"d1a7ec1e5fae590bf78670528eac3b1c1fdb77eeb2fc81f63d2f04483624dc42"}
Jul 07 14:14:26.384094 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:26.383761    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:26.405044 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:26.404996    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7" podStartSLOduration=2.305298499 podStartE2EDuration="7.404979023s" totalImagesPullingTime="4.021230183s" totalInitContainerRuntime="1.078450341s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:26.403523472 +0000 UTC m=+431.234607959" watchObservedRunningTime="2026-07-07 14:14:26.404979023 +0000 UTC m=+431.236063511"
Jul 07 14:14:35.379995 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:35.379957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6489488d88-286j5"
Jul 07 14:14:37.390589 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:37.390558    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-fx4c7"
Jul 07 14:14:40.248455 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.248414    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"]
Jul 07 14:14:40.252407 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.252383    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.255227 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.255202    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 14:14:40.255573 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.255206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 14:14:40.255573 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.255329    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b6xcm\""
Jul 07 14:14:40.265139 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.265080    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"]
Jul 07 14:14:40.307218 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.307183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1bc8d8-eab3-47f8-9f92-586887c18815-tmp\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.307388 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.307251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxbqz\" (UniqueName: \"kubernetes.io/projected/4f1bc8d8-eab3-47f8-9f92-586887c18815-kube-api-access-lxbqz\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.307388 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.307294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1bc8d8-eab3-47f8-9f92-586887c18815-tls-certs\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.408573 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.408536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1bc8d8-eab3-47f8-9f92-586887c18815-tls-certs\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.408796 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.408612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1bc8d8-eab3-47f8-9f92-586887c18815-tmp\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.408796 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.408664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxbqz\" (UniqueName: \"kubernetes.io/projected/4f1bc8d8-eab3-47f8-9f92-586887c18815-kube-api-access-lxbqz\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.408796 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:14:40.408729    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 14:14:40.408974 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:14:40.408808    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f1bc8d8-eab3-47f8-9f92-586887c18815-tls-certs podName:4f1bc8d8-eab3-47f8-9f92-586887c18815 nodeName:}" failed. No retries permitted until 2026-07-07 14:14:40.908787504 +0000 UTC m=+445.739871969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4f1bc8d8-eab3-47f8-9f92-586887c18815-tls-certs") pod "kube-auth-proxy-769bbd759d-9fc2p" (UID: "4f1bc8d8-eab3-47f8-9f92-586887c18815") : secret "kube-auth-proxy-tls" not found
Jul 07 14:14:40.410944 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.410921    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1bc8d8-eab3-47f8-9f92-586887c18815-tmp\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.422392 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.422360    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxbqz\" (UniqueName: \"kubernetes.io/projected/4f1bc8d8-eab3-47f8-9f92-586887c18815-kube-api-access-lxbqz\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.911945 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.911911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1bc8d8-eab3-47f8-9f92-586887c18815-tls-certs\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:40.915492 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:40.915451    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f1bc8d8-eab3-47f8-9f92-586887c18815-tls-certs\") pod \"kube-auth-proxy-769bbd759d-9fc2p\" (UID: \"4f1bc8d8-eab3-47f8-9f92-586887c18815\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:41.166744 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:41.166610    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"
Jul 07 14:14:41.313562 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:41.313525    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p"]
Jul 07 14:14:41.315997 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:14:41.315968    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1bc8d8_eab3_47f8_9f92_586887c18815.slice/crio-fe5d13ad48be1cc5eea2745ba7d02533527372b3cb9e5a8b27494b2ac83ac7ce WatchSource:0}: Error finding container fe5d13ad48be1cc5eea2745ba7d02533527372b3cb9e5a8b27494b2ac83ac7ce: Status 404 returned error can't find the container with id fe5d13ad48be1cc5eea2745ba7d02533527372b3cb9e5a8b27494b2ac83ac7ce
Jul 07 14:14:41.453045 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:41.452954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p" event={"ID":"4f1bc8d8-eab3-47f8-9f92-586887c18815","Type":"ContainerStarted","Data":"fe5d13ad48be1cc5eea2745ba7d02533527372b3cb9e5a8b27494b2ac83ac7ce"}
Jul 07 14:14:44.469806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:44.469765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p" event={"ID":"4f1bc8d8-eab3-47f8-9f92-586887c18815","Type":"ContainerStarted","Data":"478a794572ff0f036f3be67268667b9be96e0115d33695ed0eaed11f942444e8"}
Jul 07 14:14:44.487875 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:14:44.487823    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-769bbd759d-9fc2p" podStartSLOduration=1.416587911 podStartE2EDuration="4.487807082s" totalImagesPullingTime="3.071219171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:44.487244851 +0000 UTC m=+449.318329339" watchObservedRunningTime="2026-07-07 14:14:44.487807082 +0000 UTC m=+449.318891568"
Jul 07 14:16:38.947790 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:38.947748    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"]
Jul 07 14:16:38.951338 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:38.951315    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:38.956372 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:38.956343    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:16:38.956517 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:38.956398    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:16:38.956517 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:38.956451    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jgl9n\""
Jul 07 14:16:38.966181 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:38.966154    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"]
Jul 07 14:16:39.052916 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.052886    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"]
Jul 07 14:16:39.053185 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:16:39.053168    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-glrl7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4" podUID="ff6522c6-2407-4832-91c3-8c3c8c1904b4"
Jul 07 14:16:39.065592 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.065554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff6522c6-2407-4832-91c3-8c3c8c1904b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" (UID: \"ff6522c6-2407-4832-91c3-8c3c8c1904b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:39.065781 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.065615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glrl7\" (UniqueName: \"kubernetes.io/projected/ff6522c6-2407-4832-91c3-8c3c8c1904b4-kube-api-access-glrl7\") pod \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" (UID: \"ff6522c6-2407-4832-91c3-8c3c8c1904b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:39.075167 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.075137    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"]
Jul 07 14:16:39.089402 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.089370    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"]
Jul 07 14:16:39.166401 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.166370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff6522c6-2407-4832-91c3-8c3c8c1904b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" (UID: \"ff6522c6-2407-4832-91c3-8c3c8c1904b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:39.166601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.166424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrl7\" (UniqueName: \"kubernetes.io/projected/ff6522c6-2407-4832-91c3-8c3c8c1904b4-kube-api-access-glrl7\") pod \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" (UID: \"ff6522c6-2407-4832-91c3-8c3c8c1904b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:39.166803 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.166782    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff6522c6-2407-4832-91c3-8c3c8c1904b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" (UID: \"ff6522c6-2407-4832-91c3-8c3c8c1904b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:39.169202 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:16:39.169176    2564 projected.go:196] Error preparing data for projected volume kube-api-access-glrl7 for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-132-63.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-132-63.ec2.internal' and this object
Jul 07 14:16:39.169343 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:16:39.169238    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff6522c6-2407-4832-91c3-8c3c8c1904b4-kube-api-access-glrl7 podName:ff6522c6-2407-4832-91c3-8c3c8c1904b4 nodeName:}" failed. No retries permitted until 2026-07-07 14:16:39.669222636 +0000 UTC m=+564.500307105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-glrl7" (UniqueName: "kubernetes.io/projected/ff6522c6-2407-4832-91c3-8c3c8c1904b4-kube-api-access-glrl7") pod "kuadrant-operator-controller-manager-55467d9f7-p5rr4" (UID: "ff6522c6-2407-4832-91c3-8c3c8c1904b4") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-132-63.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-132-63.ec2.internal' and this object
Jul 07 14:16:39.670573 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:39.670538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glrl7\" (UniqueName: \"kubernetes.io/projected/ff6522c6-2407-4832-91c3-8c3c8c1904b4-kube-api-access-glrl7\") pod \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" (UID: \"ff6522c6-2407-4832-91c3-8c3c8c1904b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:39.673188 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:16:39.673169    2564 projected.go:196] Error preparing data for projected volume kube-api-access-glrl7 for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-132-63.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-132-63.ec2.internal' and this object
Jul 07 14:16:39.673256 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:16:39.673231    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff6522c6-2407-4832-91c3-8c3c8c1904b4-kube-api-access-glrl7 podName:ff6522c6-2407-4832-91c3-8c3c8c1904b4 nodeName:}" failed. No retries permitted until 2026-07-07 14:16:40.673214993 +0000 UTC m=+565.504299458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-glrl7" (UniqueName: "kubernetes.io/projected/ff6522c6-2407-4832-91c3-8c3c8c1904b4-kube-api-access-glrl7") pod "kuadrant-operator-controller-manager-55467d9f7-p5rr4" (UID: "ff6522c6-2407-4832-91c3-8c3c8c1904b4") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-132-63.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-132-63.ec2.internal' and this object
Jul 07 14:16:40.004755 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:40.004664    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:40.011130 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:40.011108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:40.013754 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:16:40.013727    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" is forbidden: User \"system:node:ip-10-0-132-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-63.ec2.internal' and this object" podUID="ff6522c6-2407-4832-91c3-8c3c8c1904b4" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:40.073576 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:40.073539    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff6522c6-2407-4832-91c3-8c3c8c1904b4-extensions-socket-volume\") pod \"ff6522c6-2407-4832-91c3-8c3c8c1904b4\" (UID: \"ff6522c6-2407-4832-91c3-8c3c8c1904b4\") "
Jul 07 14:16:40.073837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:40.073814    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff6522c6-2407-4832-91c3-8c3c8c1904b4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ff6522c6-2407-4832-91c3-8c3c8c1904b4" (UID: "ff6522c6-2407-4832-91c3-8c3c8c1904b4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:16:40.073934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:40.073921    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glrl7\" (UniqueName: \"kubernetes.io/projected/ff6522c6-2407-4832-91c3-8c3c8c1904b4-kube-api-access-glrl7\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:16:40.073972 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:40.073937    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff6522c6-2407-4832-91c3-8c3c8c1904b4-extensions-socket-volume\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:16:41.009650 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:41.009600    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:41.012620 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:16:41.012589    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" is forbidden: User \"system:node:ip-10-0-132-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-63.ec2.internal' and this object" podUID="ff6522c6-2407-4832-91c3-8c3c8c1904b4" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:41.018050 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:16:41.018024    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-p5rr4\" is forbidden: User \"system:node:ip-10-0-132-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-63.ec2.internal' and this object" podUID="ff6522c6-2407-4832-91c3-8c3c8c1904b4" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-p5rr4"
Jul 07 14:16:41.718000 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:16:41.717966    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff6522c6-2407-4832-91c3-8c3c8c1904b4" path="/var/lib/kubelet/pods/ff6522c6-2407-4832-91c3-8c3c8c1904b4/volumes"
Jul 07 14:17:15.477410 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.477374    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"]
Jul 07 14:17:15.480754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.480730    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:15.483850 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.483724    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:17:15.483850 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.483722    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 14:17:15.483850 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.483793    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:17:15.484871 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.484854    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k7vsj\""
Jul 07 14:17:15.489414 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.489391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"]
Jul 07 14:17:15.569235 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.569210    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:17:15.570691 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.570671    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:17:15.577357 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.577332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"]
Jul 07 14:17:15.603992 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.603958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjgck\" (UniqueName: \"kubernetes.io/projected/61af2073-ee12-442c-884d-363346f753bf-kube-api-access-bjgck\") pod \"limitador-limitador-64c94fd64f-ttcqs\" (UID: \"61af2073-ee12-442c-884d-363346f753bf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:15.604171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.604036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61af2073-ee12-442c-884d-363346f753bf-config-file\") pod \"limitador-limitador-64c94fd64f-ttcqs\" (UID: \"61af2073-ee12-442c-884d-363346f753bf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:15.705028 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.704990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61af2073-ee12-442c-884d-363346f753bf-config-file\") pod \"limitador-limitador-64c94fd64f-ttcqs\" (UID: \"61af2073-ee12-442c-884d-363346f753bf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:15.705238 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.705087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjgck\" (UniqueName: \"kubernetes.io/projected/61af2073-ee12-442c-884d-363346f753bf-kube-api-access-bjgck\") pod \"limitador-limitador-64c94fd64f-ttcqs\" (UID: \"61af2073-ee12-442c-884d-363346f753bf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:15.705773 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.705747    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61af2073-ee12-442c-884d-363346f753bf-config-file\") pod \"limitador-limitador-64c94fd64f-ttcqs\" (UID: \"61af2073-ee12-442c-884d-363346f753bf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:15.713970 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.713944    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjgck\" (UniqueName: \"kubernetes.io/projected/61af2073-ee12-442c-884d-363346f753bf-kube-api-access-bjgck\") pod \"limitador-limitador-64c94fd64f-ttcqs\" (UID: \"61af2073-ee12-442c-884d-363346f753bf\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:15.791976 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.791895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:15.934227 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:15.934197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"]
Jul 07 14:17:15.936611 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:17:15.936583    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61af2073_ee12_442c_884d_363346f753bf.slice/crio-235053279e378036cf2dad992e2eeaad8974b0f261402bc4fd00a465e4f9975c WatchSource:0}: Error finding container 235053279e378036cf2dad992e2eeaad8974b0f261402bc4fd00a465e4f9975c: Status 404 returned error can't find the container with id 235053279e378036cf2dad992e2eeaad8974b0f261402bc4fd00a465e4f9975c
Jul 07 14:17:16.180548 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.180508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs" event={"ID":"61af2073-ee12-442c-884d-363346f753bf","Type":"ContainerStarted","Data":"235053279e378036cf2dad992e2eeaad8974b0f261402bc4fd00a465e4f9975c"}
Jul 07 14:17:16.277517 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.277485    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zbgt9"]
Jul 07 14:17:16.283034 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.283008    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zbgt9"
Jul 07 14:17:16.285620 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.285586    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z6vxp\""
Jul 07 14:17:16.292581 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.292553    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbgt9"]
Jul 07 14:17:16.412530 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.412493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw6j9\" (UniqueName: \"kubernetes.io/projected/1d4e4840-b545-4209-b896-300037fb8a53-kube-api-access-sw6j9\") pod \"authorino-58cd955675-zbgt9\" (UID: \"1d4e4840-b545-4209-b896-300037fb8a53\") " pod="kuadrant-system/authorino-58cd955675-zbgt9"
Jul 07 14:17:16.513607 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.513526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6j9\" (UniqueName: \"kubernetes.io/projected/1d4e4840-b545-4209-b896-300037fb8a53-kube-api-access-sw6j9\") pod \"authorino-58cd955675-zbgt9\" (UID: \"1d4e4840-b545-4209-b896-300037fb8a53\") " pod="kuadrant-system/authorino-58cd955675-zbgt9"
Jul 07 14:17:16.521827 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.521800    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6j9\" (UniqueName: \"kubernetes.io/projected/1d4e4840-b545-4209-b896-300037fb8a53-kube-api-access-sw6j9\") pod \"authorino-58cd955675-zbgt9\" (UID: \"1d4e4840-b545-4209-b896-300037fb8a53\") " pod="kuadrant-system/authorino-58cd955675-zbgt9"
Jul 07 14:17:16.594618 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.594588    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zbgt9"
Jul 07 14:17:16.742302 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:16.742269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbgt9"]
Jul 07 14:17:16.745847 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:17:16.745805    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4e4840_b545_4209_b896_300037fb8a53.slice/crio-c899edf9706e3d3fa2b1d22d71b1047fe7947849194f702f219eb96b63bf9006 WatchSource:0}: Error finding container c899edf9706e3d3fa2b1d22d71b1047fe7947849194f702f219eb96b63bf9006: Status 404 returned error can't find the container with id c899edf9706e3d3fa2b1d22d71b1047fe7947849194f702f219eb96b63bf9006
Jul 07 14:17:17.186817 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:17.186778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zbgt9" event={"ID":"1d4e4840-b545-4209-b896-300037fb8a53","Type":"ContainerStarted","Data":"c899edf9706e3d3fa2b1d22d71b1047fe7947849194f702f219eb96b63bf9006"}
Jul 07 14:17:21.213830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:21.213792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs" event={"ID":"61af2073-ee12-442c-884d-363346f753bf","Type":"ContainerStarted","Data":"5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22"}
Jul 07 14:17:21.214296 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:21.213900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:21.215233 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:21.215209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zbgt9" event={"ID":"1d4e4840-b545-4209-b896-300037fb8a53","Type":"ContainerStarted","Data":"5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae"}
Jul 07 14:17:21.232897 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:21.232852    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs" podStartSLOduration=1.486174732 podStartE2EDuration="6.232838s" totalImagesPullingTime="4.746663268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:21.232096256 +0000 UTC m=+606.063180740" watchObservedRunningTime="2026-07-07 14:17:21.232838 +0000 UTC m=+606.063922486"
Jul 07 14:17:21.246399 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:21.246351    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zbgt9" podStartSLOduration=1.2511770709999999 podStartE2EDuration="5.246335279s" totalImagesPullingTime="3.995158208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:21.246024539 +0000 UTC m=+606.077109025" watchObservedRunningTime="2026-07-07 14:17:21.246335279 +0000 UTC m=+606.077419765"
Jul 07 14:17:21.473729 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:21.473616    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbgt9"]
Jul 07 14:17:23.224250 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:23.224211    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zbgt9" podUID="1d4e4840-b545-4209-b896-300037fb8a53" containerName="authorino" containerID="cri-o://5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae" gracePeriod=30
Jul 07 14:17:23.483849 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:23.483780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zbgt9"
Jul 07 14:17:23.584593 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:23.584546    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw6j9\" (UniqueName: \"kubernetes.io/projected/1d4e4840-b545-4209-b896-300037fb8a53-kube-api-access-sw6j9\") pod \"1d4e4840-b545-4209-b896-300037fb8a53\" (UID: \"1d4e4840-b545-4209-b896-300037fb8a53\") "
Jul 07 14:17:23.586877 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:23.586845    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4e4840-b545-4209-b896-300037fb8a53-kube-api-access-sw6j9" (OuterVolumeSpecName: "kube-api-access-sw6j9") pod "1d4e4840-b545-4209-b896-300037fb8a53" (UID: "1d4e4840-b545-4209-b896-300037fb8a53"). InnerVolumeSpecName "kube-api-access-sw6j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:17:23.685417 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:23.685375    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw6j9\" (UniqueName: \"kubernetes.io/projected/1d4e4840-b545-4209-b896-300037fb8a53-kube-api-access-sw6j9\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:17:24.229702 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.229665    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d4e4840-b545-4209-b896-300037fb8a53" containerID="5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae" exitCode=0
Jul 07 14:17:24.230156 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.229751    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zbgt9"
Jul 07 14:17:24.230156 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.229801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zbgt9" event={"ID":"1d4e4840-b545-4209-b896-300037fb8a53","Type":"ContainerDied","Data":"5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae"}
Jul 07 14:17:24.230156 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.229837    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zbgt9" event={"ID":"1d4e4840-b545-4209-b896-300037fb8a53","Type":"ContainerDied","Data":"c899edf9706e3d3fa2b1d22d71b1047fe7947849194f702f219eb96b63bf9006"}
Jul 07 14:17:24.230156 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.229856    2564 scope.go:117] "RemoveContainer" containerID="5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae"
Jul 07 14:17:24.238539 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.238513    2564 scope.go:117] "RemoveContainer" containerID="5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae"
Jul 07 14:17:24.238843 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:17:24.238820    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae\": container with ID starting with 5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae not found: ID does not exist" containerID="5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae"
Jul 07 14:17:24.238898 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.238856    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae"} err="failed to get container status \"5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae\": rpc error: code = NotFound desc = could not find container \"5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae\": container with ID starting with 5756c671181a7ea386bfe2a0b093f9df9c756f0d313ce06f3aab93e7c73220ae not found: ID does not exist"
Jul 07 14:17:24.247555 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.247531    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbgt9"]
Jul 07 14:17:24.253238 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:24.253218    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zbgt9"]
Jul 07 14:17:25.714581 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:25.714548    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4e4840-b545-4209-b896-300037fb8a53" path="/var/lib/kubelet/pods/1d4e4840-b545-4209-b896-300037fb8a53/volumes"
Jul 07 14:17:32.221767 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:32.221736    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:32.471085 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:32.471047    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"]
Jul 07 14:17:32.471258 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:32.471235    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs" podUID="61af2073-ee12-442c-884d-363346f753bf" containerName="limitador" containerID="cri-o://5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22" gracePeriod=30
Jul 07 14:17:33.024527 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.024503    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:33.172052 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.172016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjgck\" (UniqueName: \"kubernetes.io/projected/61af2073-ee12-442c-884d-363346f753bf-kube-api-access-bjgck\") pod \"61af2073-ee12-442c-884d-363346f753bf\" (UID: \"61af2073-ee12-442c-884d-363346f753bf\") "
Jul 07 14:17:33.172252 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.172106    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61af2073-ee12-442c-884d-363346f753bf-config-file\") pod \"61af2073-ee12-442c-884d-363346f753bf\" (UID: \"61af2073-ee12-442c-884d-363346f753bf\") "
Jul 07 14:17:33.173044 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.172953    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61af2073-ee12-442c-884d-363346f753bf-config-file" (OuterVolumeSpecName: "config-file") pod "61af2073-ee12-442c-884d-363346f753bf" (UID: "61af2073-ee12-442c-884d-363346f753bf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:17:33.178953 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.173336    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/61af2073-ee12-442c-884d-363346f753bf-config-file\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:17:33.178953 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.175125    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61af2073-ee12-442c-884d-363346f753bf-kube-api-access-bjgck" (OuterVolumeSpecName: "kube-api-access-bjgck") pod "61af2073-ee12-442c-884d-363346f753bf" (UID: "61af2073-ee12-442c-884d-363346f753bf"). InnerVolumeSpecName "kube-api-access-bjgck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:17:33.274049 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.274016    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjgck\" (UniqueName: \"kubernetes.io/projected/61af2073-ee12-442c-884d-363346f753bf-kube-api-access-bjgck\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:17:33.274943 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.274921    2564 generic.go:356] "Generic (PLEG): container finished" podID="61af2073-ee12-442c-884d-363346f753bf" containerID="5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22" exitCode=0
Jul 07 14:17:33.275059 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.274990    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"
Jul 07 14:17:33.275059 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.275005    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs" event={"ID":"61af2073-ee12-442c-884d-363346f753bf","Type":"ContainerDied","Data":"5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22"}
Jul 07 14:17:33.275161 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.275087    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ttcqs" event={"ID":"61af2073-ee12-442c-884d-363346f753bf","Type":"ContainerDied","Data":"235053279e378036cf2dad992e2eeaad8974b0f261402bc4fd00a465e4f9975c"}
Jul 07 14:17:33.275161 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.275110    2564 scope.go:117] "RemoveContainer" containerID="5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22"
Jul 07 14:17:33.284043 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.284025    2564 scope.go:117] "RemoveContainer" containerID="5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22"
Jul 07 14:17:33.284301 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:17:33.284282    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22\": container with ID starting with 5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22 not found: ID does not exist" containerID="5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22"
Jul 07 14:17:33.284344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.284310    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22"} err="failed to get container status \"5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22\": rpc error: code = NotFound desc = could not find container \"5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22\": container with ID starting with 5afdbee107e9e61a49a2579afed8187a042453ce78caecba275d7f047e47cb22 not found: ID does not exist"
Jul 07 14:17:33.297351 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.297320    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"]
Jul 07 14:17:33.301447 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.301425    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ttcqs"]
Jul 07 14:17:33.715039 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:33.714995    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61af2073-ee12-442c-884d-363346f753bf" path="/var/lib/kubelet/pods/61af2073-ee12-442c-884d-363346f753bf/volumes"
Jul 07 14:17:37.200407 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.200377    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-pxkw5"]
Jul 07 14:17:37.200819 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.200754    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61af2073-ee12-442c-884d-363346f753bf" containerName="limitador"
Jul 07 14:17:37.200819 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.200766    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="61af2073-ee12-442c-884d-363346f753bf" containerName="limitador"
Jul 07 14:17:37.200819 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.200788    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4e4840-b545-4209-b896-300037fb8a53" containerName="authorino"
Jul 07 14:17:37.200819 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.200793    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4e4840-b545-4209-b896-300037fb8a53" containerName="authorino"
Jul 07 14:17:37.200968 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.200852    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="61af2073-ee12-442c-884d-363346f753bf" containerName="limitador"
Jul 07 14:17:37.200968 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.200862    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d4e4840-b545-4209-b896-300037fb8a53" containerName="authorino"
Jul 07 14:17:37.204933 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.204911    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:37.207854 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.207833    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pcthp\""
Jul 07 14:17:37.207980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.207834    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 14:17:37.213199 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.213159    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-pxkw5"]
Jul 07 14:17:37.311588 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.311558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvs6m\" (UniqueName: \"kubernetes.io/projected/74997465-981a-4f63-a28b-b0d4ea97668a-kube-api-access-zvs6m\") pod \"postgres-69fb4594cf-pxkw5\" (UID: \"74997465-981a-4f63-a28b-b0d4ea97668a\") " pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:37.311788 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.311688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/74997465-981a-4f63-a28b-b0d4ea97668a-data\") pod \"postgres-69fb4594cf-pxkw5\" (UID: \"74997465-981a-4f63-a28b-b0d4ea97668a\") " pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:37.412600 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.412567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/74997465-981a-4f63-a28b-b0d4ea97668a-data\") pod \"postgres-69fb4594cf-pxkw5\" (UID: \"74997465-981a-4f63-a28b-b0d4ea97668a\") " pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:37.412600 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.412603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvs6m\" (UniqueName: \"kubernetes.io/projected/74997465-981a-4f63-a28b-b0d4ea97668a-kube-api-access-zvs6m\") pod \"postgres-69fb4594cf-pxkw5\" (UID: \"74997465-981a-4f63-a28b-b0d4ea97668a\") " pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:37.412992 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.412970    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/74997465-981a-4f63-a28b-b0d4ea97668a-data\") pod \"postgres-69fb4594cf-pxkw5\" (UID: \"74997465-981a-4f63-a28b-b0d4ea97668a\") " pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:37.422755 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.422729    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvs6m\" (UniqueName: \"kubernetes.io/projected/74997465-981a-4f63-a28b-b0d4ea97668a-kube-api-access-zvs6m\") pod \"postgres-69fb4594cf-pxkw5\" (UID: \"74997465-981a-4f63-a28b-b0d4ea97668a\") " pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:37.516771 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.516685    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:37.654809 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:37.654781    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-pxkw5"]
Jul 07 14:17:37.656588 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:17:37.656563    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74997465_981a_4f63_a28b_b0d4ea97668a.slice/crio-a14fc02631e254075a2ce360f4a1ebc9c18011dbcb476317ba624b87a8247f80 WatchSource:0}: Error finding container a14fc02631e254075a2ce360f4a1ebc9c18011dbcb476317ba624b87a8247f80: Status 404 returned error can't find the container with id a14fc02631e254075a2ce360f4a1ebc9c18011dbcb476317ba624b87a8247f80
Jul 07 14:17:38.306230 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:38.306150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-pxkw5" event={"ID":"74997465-981a-4f63-a28b-b0d4ea97668a","Type":"ContainerStarted","Data":"a14fc02631e254075a2ce360f4a1ebc9c18011dbcb476317ba624b87a8247f80"}
Jul 07 14:17:43.335088 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:43.335040    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-pxkw5" event={"ID":"74997465-981a-4f63-a28b-b0d4ea97668a","Type":"ContainerStarted","Data":"0b2dbdf5a73ab54e04785d668c93d02dbbaa8a3d9dd2d9a6f057dd8a84b245d4"}
Jul 07 14:17:43.335492 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:43.335189    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:43.351852 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:43.351806    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-pxkw5" podStartSLOduration=1.683131222 podStartE2EDuration="6.351791265s" totalImagesPullingTime="4.668660043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:43.351035961 +0000 UTC m=+628.182120448" watchObservedRunningTime="2026-07-07 14:17:43.351791265 +0000 UTC m=+628.182875752"
Jul 07 14:17:49.372131 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:49.372101    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-pxkw5"
Jul 07 14:17:50.308158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.308107    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kdgxk"]
Jul 07 14:17:50.314796 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.314769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kdgxk"
Jul 07 14:17:50.316264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.316239    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kdgxk"]
Jul 07 14:17:50.317582 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.317554    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:17:50.317708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.317601    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:17:50.318735 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.318709    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z6vxp\""
Jul 07 14:17:50.436239 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.436203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g8rz\" (UniqueName: \"kubernetes.io/projected/b33f04a6-9182-4738-b40d-13d7924c02f3-kube-api-access-8g8rz\") pod \"authorino-5d4b67c446-kdgxk\" (UID: \"b33f04a6-9182-4738-b40d-13d7924c02f3\") " pod="kuadrant-system/authorino-5d4b67c446-kdgxk"
Jul 07 14:17:50.537720 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.537688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g8rz\" (UniqueName: \"kubernetes.io/projected/b33f04a6-9182-4738-b40d-13d7924c02f3-kube-api-access-8g8rz\") pod \"authorino-5d4b67c446-kdgxk\" (UID: \"b33f04a6-9182-4738-b40d-13d7924c02f3\") " pod="kuadrant-system/authorino-5d4b67c446-kdgxk"
Jul 07 14:17:50.548958 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.548923    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g8rz\" (UniqueName: \"kubernetes.io/projected/b33f04a6-9182-4738-b40d-13d7924c02f3-kube-api-access-8g8rz\") pod \"authorino-5d4b67c446-kdgxk\" (UID: \"b33f04a6-9182-4738-b40d-13d7924c02f3\") " pod="kuadrant-system/authorino-5d4b67c446-kdgxk"
Jul 07 14:17:50.553572 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.553546    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kdgxk"]
Jul 07 14:17:50.553837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.553825    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kdgxk"
Jul 07 14:17:50.583410 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.583383    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8649687695-bk82d"]
Jul 07 14:17:50.587544 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.587526    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8649687695-bk82d"
Jul 07 14:17:50.593502 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.593474    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8649687695-bk82d"]
Jul 07 14:17:50.639254 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.639198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws4db\" (UniqueName: \"kubernetes.io/projected/36c4909c-e303-44ac-8778-e283fe64e9ad-kube-api-access-ws4db\") pod \"authorino-8649687695-bk82d\" (UID: \"36c4909c-e303-44ac-8778-e283fe64e9ad\") " pod="kuadrant-system/authorino-8649687695-bk82d"
Jul 07 14:17:50.695300 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.695263    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kdgxk"]
Jul 07 14:17:50.699048 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:17:50.699012    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb33f04a6_9182_4738_b40d_13d7924c02f3.slice/crio-3e502cdabbc481b35ad70e40d772f59e7a5c28f388cb43d6308f326c47cec07f WatchSource:0}: Error finding container 3e502cdabbc481b35ad70e40d772f59e7a5c28f388cb43d6308f326c47cec07f: Status 404 returned error can't find the container with id 3e502cdabbc481b35ad70e40d772f59e7a5c28f388cb43d6308f326c47cec07f
Jul 07 14:17:50.740136 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.740102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws4db\" (UniqueName: \"kubernetes.io/projected/36c4909c-e303-44ac-8778-e283fe64e9ad-kube-api-access-ws4db\") pod \"authorino-8649687695-bk82d\" (UID: \"36c4909c-e303-44ac-8778-e283fe64e9ad\") " pod="kuadrant-system/authorino-8649687695-bk82d"
Jul 07 14:17:50.751426 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.751403    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws4db\" (UniqueName: \"kubernetes.io/projected/36c4909c-e303-44ac-8778-e283fe64e9ad-kube-api-access-ws4db\") pod \"authorino-8649687695-bk82d\" (UID: \"36c4909c-e303-44ac-8778-e283fe64e9ad\") " pod="kuadrant-system/authorino-8649687695-bk82d"
Jul 07 14:17:50.851221 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.851140    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8649687695-bk82d"]
Jul 07 14:17:50.851406 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.851395    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8649687695-bk82d"
Jul 07 14:17:50.879620 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.879587    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b9c9bb47-zn9vv"]
Jul 07 14:17:50.884171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.884149    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:17:50.887349 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.887314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 14:17:50.889198 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.889174    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b9c9bb47-zn9vv"]
Jul 07 14:17:50.942260 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.942228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch4mq\" (UniqueName: \"kubernetes.io/projected/fb1c7b77-ce34-4239-af35-9181bde52b60-kube-api-access-ch4mq\") pod \"authorino-5b9c9bb47-zn9vv\" (UID: \"fb1c7b77-ce34-4239-af35-9181bde52b60\") " pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:17:50.942403 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.942288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb1c7b77-ce34-4239-af35-9181bde52b60-tls-cert\") pod \"authorino-5b9c9bb47-zn9vv\" (UID: \"fb1c7b77-ce34-4239-af35-9181bde52b60\") " pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:17:50.989925 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:50.989897    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8649687695-bk82d"]
Jul 07 14:17:50.991895 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:17:50.991857    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36c4909c_e303_44ac_8778_e283fe64e9ad.slice/crio-30054a4fdd05034ec0459f5708df15290fa01c4ef46154a023d909a865bdaf29 WatchSource:0}: Error finding container 30054a4fdd05034ec0459f5708df15290fa01c4ef46154a023d909a865bdaf29: Status 404 returned error can't find the container with id 30054a4fdd05034ec0459f5708df15290fa01c4ef46154a023d909a865bdaf29
Jul 07 14:17:51.043646 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.043593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb1c7b77-ce34-4239-af35-9181bde52b60-tls-cert\") pod \"authorino-5b9c9bb47-zn9vv\" (UID: \"fb1c7b77-ce34-4239-af35-9181bde52b60\") " pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:17:51.043815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.043708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch4mq\" (UniqueName: \"kubernetes.io/projected/fb1c7b77-ce34-4239-af35-9181bde52b60-kube-api-access-ch4mq\") pod \"authorino-5b9c9bb47-zn9vv\" (UID: \"fb1c7b77-ce34-4239-af35-9181bde52b60\") " pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:17:51.046225 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.046207    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb1c7b77-ce34-4239-af35-9181bde52b60-tls-cert\") pod \"authorino-5b9c9bb47-zn9vv\" (UID: \"fb1c7b77-ce34-4239-af35-9181bde52b60\") " pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:17:51.052617 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.052596    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch4mq\" (UniqueName: \"kubernetes.io/projected/fb1c7b77-ce34-4239-af35-9181bde52b60-kube-api-access-ch4mq\") pod \"authorino-5b9c9bb47-zn9vv\" (UID: \"fb1c7b77-ce34-4239-af35-9181bde52b60\") " pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:17:51.196318 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.196292    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:17:51.348103 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.348077    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b9c9bb47-zn9vv"]
Jul 07 14:17:51.351041 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:17:51.351015    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb1c7b77_ce34_4239_af35_9181bde52b60.slice/crio-cb15022e3f5162ee9f40dcb00753415a83decbef8de4fedb6bf482825e9d6c95 WatchSource:0}: Error finding container cb15022e3f5162ee9f40dcb00753415a83decbef8de4fedb6bf482825e9d6c95: Status 404 returned error can't find the container with id cb15022e3f5162ee9f40dcb00753415a83decbef8de4fedb6bf482825e9d6c95
Jul 07 14:17:51.375687 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.375654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8649687695-bk82d" event={"ID":"36c4909c-e303-44ac-8778-e283fe64e9ad","Type":"ContainerStarted","Data":"30054a4fdd05034ec0459f5708df15290fa01c4ef46154a023d909a865bdaf29"}
Jul 07 14:17:51.376974 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.376945    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv" event={"ID":"fb1c7b77-ce34-4239-af35-9181bde52b60","Type":"ContainerStarted","Data":"cb15022e3f5162ee9f40dcb00753415a83decbef8de4fedb6bf482825e9d6c95"}
Jul 07 14:17:51.378568 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.378540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kdgxk" event={"ID":"b33f04a6-9182-4738-b40d-13d7924c02f3","Type":"ContainerStarted","Data":"c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47"}
Jul 07 14:17:51.378693 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.378579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kdgxk" event={"ID":"b33f04a6-9182-4738-b40d-13d7924c02f3","Type":"ContainerStarted","Data":"3e502cdabbc481b35ad70e40d772f59e7a5c28f388cb43d6308f326c47cec07f"}
Jul 07 14:17:51.378693 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.378673    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kdgxk" podUID="b33f04a6-9182-4738-b40d-13d7924c02f3" containerName="authorino" containerID="cri-o://c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47" gracePeriod=30
Jul 07 14:17:51.395256 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.395181    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kdgxk" podStartSLOduration=0.937119517 podStartE2EDuration="1.395157593s" totalImagesPullingTime="458.038076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:51.394237361 +0000 UTC m=+636.225321850" watchObservedRunningTime="2026-07-07 14:17:51.395157593 +0000 UTC m=+636.226242083"
Jul 07 14:17:51.643962 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.643939    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kdgxk"
Jul 07 14:17:51.750916 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.750832    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g8rz\" (UniqueName: \"kubernetes.io/projected/b33f04a6-9182-4738-b40d-13d7924c02f3-kube-api-access-8g8rz\") pod \"b33f04a6-9182-4738-b40d-13d7924c02f3\" (UID: \"b33f04a6-9182-4738-b40d-13d7924c02f3\") "
Jul 07 14:17:51.752996 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.752975    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33f04a6-9182-4738-b40d-13d7924c02f3-kube-api-access-8g8rz" (OuterVolumeSpecName: "kube-api-access-8g8rz") pod "b33f04a6-9182-4738-b40d-13d7924c02f3" (UID: "b33f04a6-9182-4738-b40d-13d7924c02f3"). InnerVolumeSpecName "kube-api-access-8g8rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:17:51.851597 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:51.851549    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g8rz\" (UniqueName: \"kubernetes.io/projected/b33f04a6-9182-4738-b40d-13d7924c02f3-kube-api-access-8g8rz\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:17:52.384802 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.384770    2564 generic.go:356] "Generic (PLEG): container finished" podID="b33f04a6-9182-4738-b40d-13d7924c02f3" containerID="c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47" exitCode=0
Jul 07 14:17:52.384998 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.384823    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kdgxk"
Jul 07 14:17:52.384998 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.384858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kdgxk" event={"ID":"b33f04a6-9182-4738-b40d-13d7924c02f3","Type":"ContainerDied","Data":"c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47"}
Jul 07 14:17:52.384998 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.384910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kdgxk" event={"ID":"b33f04a6-9182-4738-b40d-13d7924c02f3","Type":"ContainerDied","Data":"3e502cdabbc481b35ad70e40d772f59e7a5c28f388cb43d6308f326c47cec07f"}
Jul 07 14:17:52.384998 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.384934    2564 scope.go:117] "RemoveContainer" containerID="c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47"
Jul 07 14:17:52.386553 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.386493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8649687695-bk82d" event={"ID":"36c4909c-e303-44ac-8778-e283fe64e9ad","Type":"ContainerStarted","Data":"51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6"}
Jul 07 14:17:52.386689 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.386564    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-8649687695-bk82d" podUID="36c4909c-e303-44ac-8778-e283fe64e9ad" containerName="authorino" containerID="cri-o://51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6" gracePeriod=30
Jul 07 14:17:52.401114 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.395128    2564 scope.go:117] "RemoveContainer" containerID="c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47"
Jul 07 14:17:52.401114 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:17:52.395599    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47\": container with ID starting with c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47 not found: ID does not exist" containerID="c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47"
Jul 07 14:17:52.401114 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.395663    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47"} err="failed to get container status \"c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47\": rpc error: code = NotFound desc = could not find container \"c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47\": container with ID starting with c527a43a4a258a7a14120bed65b8565dab45da06a772c2dfec53e78d83b4db47 not found: ID does not exist"
Jul 07 14:17:52.408029 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.407984    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8649687695-bk82d" podStartSLOduration=2.064011534 podStartE2EDuration="2.407967916s" totalImagesPullingTime="343.956382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:52.406326186 +0000 UTC m=+637.237410674" watchObservedRunningTime="2026-07-07 14:17:52.407967916 +0000 UTC m=+637.239052403"
Jul 07 14:17:52.421002 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.420976    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kdgxk"]
Jul 07 14:17:52.425210 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.425183    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kdgxk"]
Jul 07 14:17:52.680006 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.679977    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8649687695-bk82d"
Jul 07 14:17:52.759110 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.759078    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws4db\" (UniqueName: \"kubernetes.io/projected/36c4909c-e303-44ac-8778-e283fe64e9ad-kube-api-access-ws4db\") pod \"36c4909c-e303-44ac-8778-e283fe64e9ad\" (UID: \"36c4909c-e303-44ac-8778-e283fe64e9ad\") "
Jul 07 14:17:52.761298 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.761271    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c4909c-e303-44ac-8778-e283fe64e9ad-kube-api-access-ws4db" (OuterVolumeSpecName: "kube-api-access-ws4db") pod "36c4909c-e303-44ac-8778-e283fe64e9ad" (UID: "36c4909c-e303-44ac-8778-e283fe64e9ad"). InnerVolumeSpecName "kube-api-access-ws4db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:17:52.860278 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:52.860239    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws4db\" (UniqueName: \"kubernetes.io/projected/36c4909c-e303-44ac-8778-e283fe64e9ad-kube-api-access-ws4db\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:17:53.392355 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.392316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv" event={"ID":"fb1c7b77-ce34-4239-af35-9181bde52b60","Type":"ContainerStarted","Data":"229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d"}
Jul 07 14:17:53.394325 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.394298    2564 generic.go:356] "Generic (PLEG): container finished" podID="36c4909c-e303-44ac-8778-e283fe64e9ad" containerID="51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6" exitCode=0
Jul 07 14:17:53.394466 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.394331    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8649687695-bk82d"
Jul 07 14:17:53.394466 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.394351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8649687695-bk82d" event={"ID":"36c4909c-e303-44ac-8778-e283fe64e9ad","Type":"ContainerDied","Data":"51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6"}
Jul 07 14:17:53.394466 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.394384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8649687695-bk82d" event={"ID":"36c4909c-e303-44ac-8778-e283fe64e9ad","Type":"ContainerDied","Data":"30054a4fdd05034ec0459f5708df15290fa01c4ef46154a023d909a865bdaf29"}
Jul 07 14:17:53.394466 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.394405    2564 scope.go:117] "RemoveContainer" containerID="51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6"
Jul 07 14:17:53.403672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.403622    2564 scope.go:117] "RemoveContainer" containerID="51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6"
Jul 07 14:17:53.403987 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:17:53.403966    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6\": container with ID starting with 51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6 not found: ID does not exist" containerID="51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6"
Jul 07 14:17:53.404061 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.403997    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6"} err="failed to get container status \"51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6\": rpc error: code = NotFound desc = could not find container \"51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6\": container with ID starting with 51d50fcc13375efeb06dd6a9bb0d0749566cd93503f58502cbb2587fff63cea6 not found: ID does not exist"
Jul 07 14:17:53.410315 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.410277    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv" podStartSLOduration=1.882376402 podStartE2EDuration="3.410262488s" totalImagesPullingTime="1.527886086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:53.408457972 +0000 UTC m=+638.239542459" watchObservedRunningTime="2026-07-07 14:17:53.410262488 +0000 UTC m=+638.241346975"
Jul 07 14:17:53.424904 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.424875    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8649687695-bk82d"]
Jul 07 14:17:53.426690 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.426664    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8649687695-bk82d"]
Jul 07 14:17:53.715471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.715380    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c4909c-e303-44ac-8778-e283fe64e9ad" path="/var/lib/kubelet/pods/36c4909c-e303-44ac-8778-e283fe64e9ad/volumes"
Jul 07 14:17:53.715977 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:53.715882    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b33f04a6-9182-4738-b40d-13d7924c02f3" path="/var/lib/kubelet/pods/b33f04a6-9182-4738-b40d-13d7924c02f3/volumes"
Jul 07 14:17:57.779762 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.779727    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f9ff6bd79-vpfk7"]
Jul 07 14:17:57.780168 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.780151    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c4909c-e303-44ac-8778-e283fe64e9ad" containerName="authorino"
Jul 07 14:17:57.780212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.780171    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c4909c-e303-44ac-8778-e283fe64e9ad" containerName="authorino"
Jul 07 14:17:57.780212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.780187    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33f04a6-9182-4738-b40d-13d7924c02f3" containerName="authorino"
Jul 07 14:17:57.780212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.780192    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33f04a6-9182-4738-b40d-13d7924c02f3" containerName="authorino"
Jul 07 14:17:57.780344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.780264    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33f04a6-9182-4738-b40d-13d7924c02f3" containerName="authorino"
Jul 07 14:17:57.780344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.780272    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c4909c-e303-44ac-8778-e283fe64e9ad" containerName="authorino"
Jul 07 14:17:57.798841 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.798813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f9ff6bd79-vpfk7"]
Jul 07 14:17:57.799012 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.798932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:17:57.802065 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.802031    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 14:17:57.802937 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.802919    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 14:17:57.803174 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.803155    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hr2nw\""
Jul 07 14:17:57.906573 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.906541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-webhook-cert\") pod \"maas-controller-6f9ff6bd79-vpfk7\" (UID: \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\") " pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:17:57.906812 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.906729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gpbt\" (UniqueName: \"kubernetes.io/projected/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-kube-api-access-5gpbt\") pod \"maas-controller-6f9ff6bd79-vpfk7\" (UID: \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\") " pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:17:57.962313 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.962277    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65757b9647-szqz2"]
Jul 07 14:17:57.964854 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.964837    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:17:57.973274 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:57.973249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65757b9647-szqz2"]
Jul 07 14:17:58.007900 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.007855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-webhook-cert\") pod \"maas-controller-6f9ff6bd79-vpfk7\" (UID: \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\") " pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:17:58.008100 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.007992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gpbt\" (UniqueName: \"kubernetes.io/projected/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-kube-api-access-5gpbt\") pod \"maas-controller-6f9ff6bd79-vpfk7\" (UID: \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\") " pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:17:58.010523 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.010504    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-webhook-cert\") pod \"maas-controller-6f9ff6bd79-vpfk7\" (UID: \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\") " pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:17:58.017620 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.017594    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gpbt\" (UniqueName: \"kubernetes.io/projected/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-kube-api-access-5gpbt\") pod \"maas-controller-6f9ff6bd79-vpfk7\" (UID: \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\") " pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:17:58.109076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.108995    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-webhook-cert\") pod \"maas-controller-65757b9647-szqz2\" (UID: \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\") " pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:17:58.109076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.109030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh926\" (UniqueName: \"kubernetes.io/projected/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-kube-api-access-mh926\") pod \"maas-controller-65757b9647-szqz2\" (UID: \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\") " pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:17:58.110830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.110811    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:17:58.210111 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.210036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-webhook-cert\") pod \"maas-controller-65757b9647-szqz2\" (UID: \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\") " pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:17:58.210111 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.210085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh926\" (UniqueName: \"kubernetes.io/projected/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-kube-api-access-mh926\") pod \"maas-controller-65757b9647-szqz2\" (UID: \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\") " pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:17:58.212804 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.212779    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-webhook-cert\") pod \"maas-controller-65757b9647-szqz2\" (UID: \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\") " pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:17:58.219921 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.219887    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh926\" (UniqueName: \"kubernetes.io/projected/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-kube-api-access-mh926\") pod \"maas-controller-65757b9647-szqz2\" (UID: \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\") " pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:17:58.249194 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.249166    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f9ff6bd79-vpfk7"]
Jul 07 14:17:58.252132 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:17:58.252099    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb147830_0a0b_4bf1_a853_7e616ceb2cfc.slice/crio-d11a1b6fa4a69c61c6a219fdc2f9e7d03bc41664f2de2c14aae3192df8cdae05 WatchSource:0}: Error finding container d11a1b6fa4a69c61c6a219fdc2f9e7d03bc41664f2de2c14aae3192df8cdae05: Status 404 returned error can't find the container with id d11a1b6fa4a69c61c6a219fdc2f9e7d03bc41664f2de2c14aae3192df8cdae05
Jul 07 14:17:58.276772 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.276736    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:17:58.410753 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.410726    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65757b9647-szqz2"]
Jul 07 14:17:58.412803 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:17:58.412775    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38435e28_8b6a_44dd_ab0f_75b3f35b5b38.slice/crio-9bc64cb61597650e9185da579556da2f9d0f5af98eff4ec792a1eb314a2763ee WatchSource:0}: Error finding container 9bc64cb61597650e9185da579556da2f9d0f5af98eff4ec792a1eb314a2763ee: Status 404 returned error can't find the container with id 9bc64cb61597650e9185da579556da2f9d0f5af98eff4ec792a1eb314a2763ee
Jul 07 14:17:58.420672 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.420614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65757b9647-szqz2" event={"ID":"38435e28-8b6a-44dd-ab0f-75b3f35b5b38","Type":"ContainerStarted","Data":"9bc64cb61597650e9185da579556da2f9d0f5af98eff4ec792a1eb314a2763ee"}
Jul 07 14:17:58.421773 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:17:58.421752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7" event={"ID":"eb147830-0a0b-4bf1-a853-7e616ceb2cfc","Type":"ContainerStarted","Data":"d11a1b6fa4a69c61c6a219fdc2f9e7d03bc41664f2de2c14aae3192df8cdae05"}
Jul 07 14:18:01.442946 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:01.442847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7" event={"ID":"eb147830-0a0b-4bf1-a853-7e616ceb2cfc","Type":"ContainerStarted","Data":"f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa"}
Jul 07 14:18:01.442946 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:01.442927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:18:01.444339 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:01.444316    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65757b9647-szqz2" event={"ID":"38435e28-8b6a-44dd-ab0f-75b3f35b5b38","Type":"ContainerStarted","Data":"33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1"}
Jul 07 14:18:01.444443 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:01.444432    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:18:01.468496 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:01.468443    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7" podStartSLOduration=1.5324316919999998 podStartE2EDuration="4.468427431s" totalImagesPullingTime="2.935995739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:18:01.466387207 +0000 UTC m=+646.297471695" watchObservedRunningTime="2026-07-07 14:18:01.468427431 +0000 UTC m=+646.299511921"
Jul 07 14:18:01.488572 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:01.488515    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65757b9647-szqz2" podStartSLOduration=1.708798969 podStartE2EDuration="4.488498725s" totalImagesPullingTime="2.779699756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:18:01.486886212 +0000 UTC m=+646.317970702" watchObservedRunningTime="2026-07-07 14:18:01.488498725 +0000 UTC m=+646.319583213"
Jul 07 14:18:12.454431 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.454393    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:18:12.454917 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.454723    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:18:12.512733 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.512701    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f9ff6bd79-vpfk7"]
Jul 07 14:18:12.512935 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.512903    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7" podUID="eb147830-0a0b-4bf1-a853-7e616ceb2cfc" containerName="manager" containerID="cri-o://f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa" gracePeriod=30
Jul 07 14:18:12.763079 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.763055    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:18:12.845670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.845610    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-webhook-cert\") pod \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\" (UID: \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\") "
Jul 07 14:18:12.845841 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.845705    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gpbt\" (UniqueName: \"kubernetes.io/projected/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-kube-api-access-5gpbt\") pod \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\" (UID: \"eb147830-0a0b-4bf1-a853-7e616ceb2cfc\") "
Jul 07 14:18:12.847951 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.847918    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eb147830-0a0b-4bf1-a853-7e616ceb2cfc" (UID: "eb147830-0a0b-4bf1-a853-7e616ceb2cfc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:18:12.848074 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.848056    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-kube-api-access-5gpbt" (OuterVolumeSpecName: "kube-api-access-5gpbt") pod "eb147830-0a0b-4bf1-a853-7e616ceb2cfc" (UID: "eb147830-0a0b-4bf1-a853-7e616ceb2cfc"). InnerVolumeSpecName "kube-api-access-5gpbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:18:12.946820 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.946785    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-webhook-cert\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:18:12.946820 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:12.946813    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gpbt\" (UniqueName: \"kubernetes.io/projected/eb147830-0a0b-4bf1-a853-7e616ceb2cfc-kube-api-access-5gpbt\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:18:13.506586 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.506553    2564 generic.go:356] "Generic (PLEG): container finished" podID="eb147830-0a0b-4bf1-a853-7e616ceb2cfc" containerID="f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa" exitCode=0
Jul 07 14:18:13.507100 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.506600    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7" event={"ID":"eb147830-0a0b-4bf1-a853-7e616ceb2cfc","Type":"ContainerDied","Data":"f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa"}
Jul 07 14:18:13.507100 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.506605    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7"
Jul 07 14:18:13.507100 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.506661    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f9ff6bd79-vpfk7" event={"ID":"eb147830-0a0b-4bf1-a853-7e616ceb2cfc","Type":"ContainerDied","Data":"d11a1b6fa4a69c61c6a219fdc2f9e7d03bc41664f2de2c14aae3192df8cdae05"}
Jul 07 14:18:13.507100 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.506682    2564 scope.go:117] "RemoveContainer" containerID="f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa"
Jul 07 14:18:13.516423 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.516241    2564 scope.go:117] "RemoveContainer" containerID="f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa"
Jul 07 14:18:13.516556 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:18:13.516538    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa\": container with ID starting with f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa not found: ID does not exist" containerID="f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa"
Jul 07 14:18:13.516599 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.516565    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa"} err="failed to get container status \"f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa\": rpc error: code = NotFound desc = could not find container \"f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa\": container with ID starting with f5cc816d0d991b680cb848c32b318e511cd64b953a12c5ced4ac76ccac56d2aa not found: ID does not exist"
Jul 07 14:18:13.530480 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.530457    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f9ff6bd79-vpfk7"]
Jul 07 14:18:13.535232 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.535208    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f9ff6bd79-vpfk7"]
Jul 07 14:18:13.714491 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:13.714458    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb147830-0a0b-4bf1-a853-7e616ceb2cfc" path="/var/lib/kubelet/pods/eb147830-0a0b-4bf1-a853-7e616ceb2cfc/volumes"
Jul 07 14:18:30.723180 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.723140    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-gt8ff"]
Jul 07 14:18:30.723582 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.723561    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb147830-0a0b-4bf1-a853-7e616ceb2cfc" containerName="manager"
Jul 07 14:18:30.723582 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.723573    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb147830-0a0b-4bf1-a853-7e616ceb2cfc" containerName="manager"
Jul 07 14:18:30.723678 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.723670    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb147830-0a0b-4bf1-a853-7e616ceb2cfc" containerName="manager"
Jul 07 14:18:30.726873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.726857    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:30.729701 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.729681    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 14:18:30.735300 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.735279    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-gt8ff"]
Jul 07 14:18:30.752962 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.752930    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7jbfb"]
Jul 07 14:18:30.755539 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.755522    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:30.758221 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.758199    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7b7z5\""
Jul 07 14:18:30.766453 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.766429    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7jbfb"]
Jul 07 14:18:30.793875 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.793844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scpqd\" (UniqueName: \"kubernetes.io/projected/6ea2d898-32c2-453f-831f-76e907c8228e-kube-api-access-scpqd\") pod \"payload-processing-58f86c7798-7jbfb\" (UID: \"6ea2d898-32c2-453f-831f-76e907c8228e\") " pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:30.794041 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.793900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq6l8\" (UniqueName: \"kubernetes.io/projected/130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7-kube-api-access-dq6l8\") pod \"payload-pre-processing-7964457696-gt8ff\" (UID: \"130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7\") " pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:30.794041 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.793961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-gt8ff\" (UID: \"130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7\") " pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:30.794041 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.794010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ea2d898-32c2-453f-831f-76e907c8228e-plugins-config-volume\") pod \"payload-processing-58f86c7798-7jbfb\" (UID: \"6ea2d898-32c2-453f-831f-76e907c8228e\") " pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:30.895121 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.895087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq6l8\" (UniqueName: \"kubernetes.io/projected/130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7-kube-api-access-dq6l8\") pod \"payload-pre-processing-7964457696-gt8ff\" (UID: \"130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7\") " pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:30.895309 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.895134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-gt8ff\" (UID: \"130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7\") " pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:30.895375 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.895309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ea2d898-32c2-453f-831f-76e907c8228e-plugins-config-volume\") pod \"payload-processing-58f86c7798-7jbfb\" (UID: \"6ea2d898-32c2-453f-831f-76e907c8228e\") " pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:30.895432 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.895409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scpqd\" (UniqueName: \"kubernetes.io/projected/6ea2d898-32c2-453f-831f-76e907c8228e-kube-api-access-scpqd\") pod \"payload-processing-58f86c7798-7jbfb\" (UID: \"6ea2d898-32c2-453f-831f-76e907c8228e\") " pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:30.895895 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.895877    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7-plugins-config-volume\") pod \"payload-pre-processing-7964457696-gt8ff\" (UID: \"130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7\") " pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:30.895967 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.895941    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ea2d898-32c2-453f-831f-76e907c8228e-plugins-config-volume\") pod \"payload-processing-58f86c7798-7jbfb\" (UID: \"6ea2d898-32c2-453f-831f-76e907c8228e\") " pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:30.906204 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.906172    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scpqd\" (UniqueName: \"kubernetes.io/projected/6ea2d898-32c2-453f-831f-76e907c8228e-kube-api-access-scpqd\") pod \"payload-processing-58f86c7798-7jbfb\" (UID: \"6ea2d898-32c2-453f-831f-76e907c8228e\") " pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:30.906417 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:30.906397    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq6l8\" (UniqueName: \"kubernetes.io/projected/130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7-kube-api-access-dq6l8\") pod \"payload-pre-processing-7964457696-gt8ff\" (UID: \"130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7\") " pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:31.038760 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:31.038671    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:31.072783 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:31.067283    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:31.201944 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:31.201912    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-gt8ff"]
Jul 07 14:18:31.203985 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:18:31.203951    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130310bc_e3ee_46c3_a7c8_e3baf7b7cbd7.slice/crio-d7d35e6f2c568756e8597387df653a943088903342f90a4d38035064b2263959 WatchSource:0}: Error finding container d7d35e6f2c568756e8597387df653a943088903342f90a4d38035064b2263959: Status 404 returned error can't find the container with id d7d35e6f2c568756e8597387df653a943088903342f90a4d38035064b2263959
Jul 07 14:18:31.226679 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:31.226658    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-7jbfb"]
Jul 07 14:18:31.228433 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:18:31.228412    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea2d898_32c2_453f_831f_76e907c8228e.slice/crio-c6e99a9312a03e478860e292b680eff3a097f01cf8476d5e80d26e2c39e329c0 WatchSource:0}: Error finding container c6e99a9312a03e478860e292b680eff3a097f01cf8476d5e80d26e2c39e329c0: Status 404 returned error can't find the container with id c6e99a9312a03e478860e292b680eff3a097f01cf8476d5e80d26e2c39e329c0
Jul 07 14:18:31.594971 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:31.594937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7jbfb" event={"ID":"6ea2d898-32c2-453f-831f-76e907c8228e","Type":"ContainerStarted","Data":"c6e99a9312a03e478860e292b680eff3a097f01cf8476d5e80d26e2c39e329c0"}
Jul 07 14:18:31.596115 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:31.596089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff" event={"ID":"130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7","Type":"ContainerStarted","Data":"d7d35e6f2c568756e8597387df653a943088903342f90a4d38035064b2263959"}
Jul 07 14:18:33.609282 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:33.609177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-7jbfb" event={"ID":"6ea2d898-32c2-453f-831f-76e907c8228e","Type":"ContainerStarted","Data":"b51a7e664e0c42bc4ea85c9119ceb3da1addb15fdd716006b42d196d1bf169b1"}
Jul 07 14:18:33.609752 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:33.609331    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:33.610949 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:33.610919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff" event={"ID":"130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7","Type":"ContainerStarted","Data":"94d4b6f3b7bba262580d5e35dc8415d52c41f25e807264611ced5e2e4345e7fb"}
Jul 07 14:18:33.611088 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:33.611058    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:18:33.627951 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:33.627895    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-7jbfb" podStartSLOduration=1.6647430810000001 podStartE2EDuration="3.627875053s" totalImagesPullingTime="1.963131972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:18:33.627068093 +0000 UTC m=+678.458152580" watchObservedRunningTime="2026-07-07 14:18:33.627875053 +0000 UTC m=+678.458959541"
Jul 07 14:18:33.643007 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:33.642953    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff" podStartSLOduration=2.014054334 podStartE2EDuration="3.642937937s" totalImagesPullingTime="1.628883603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:18:33.641663342 +0000 UTC m=+678.472747830" watchObservedRunningTime="2026-07-07 14:18:33.642937937 +0000 UTC m=+678.474022436"
Jul 07 14:18:44.617864 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:44.617835    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-7jbfb"
Jul 07 14:18:44.618525 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:18:44.618083    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-gt8ff"
Jul 07 14:19:16.096376 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.096259    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"]
Jul 07 14:19:16.100270 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.100249    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.103179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.103153    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 14:19:16.104307 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.104287    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 14:19:16.104307 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.104298    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kcktd\""
Jul 07 14:19:16.104458 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.104295    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 07 14:19:16.113772 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.113745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"]
Jul 07 14:19:16.204185 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.204145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.204185 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.204184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.204422 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.204219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.204422 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.204303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.204422 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.204320    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9379f39f-6777-4b4d-8542-3ce9899627d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.204422 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.204335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s8jk\" (UniqueName: \"kubernetes.io/projected/9379f39f-6777-4b4d-8542-3ce9899627d2-kube-api-access-5s8jk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.305497 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.305455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.305497 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.305496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9379f39f-6777-4b4d-8542-3ce9899627d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.305800 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.305528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s8jk\" (UniqueName: \"kubernetes.io/projected/9379f39f-6777-4b4d-8542-3ce9899627d2-kube-api-access-5s8jk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.305800 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.305584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.305800 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.305606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.305800 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.305696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.305996 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.305949    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.305996 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.305965    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.306112 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.306022    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.308115 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.308090    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9379f39f-6777-4b4d-8542-3ce9899627d2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.308326 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.308306    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9379f39f-6777-4b4d-8542-3ce9899627d2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.317469 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.317441    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s8jk\" (UniqueName: \"kubernetes.io/projected/9379f39f-6777-4b4d-8542-3ce9899627d2-kube-api-access-5s8jk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-lj5sc\" (UID: \"9379f39f-6777-4b4d-8542-3ce9899627d2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.411143 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.411104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:16.555263 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.555240    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"]
Jul 07 14:19:16.556813 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:19:16.556786    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9379f39f_6777_4b4d_8542_3ce9899627d2.slice/crio-4a0d7b24abec8357dbe81d7f89274a307306dfd7d5f2d064c0a40d482aafb961 WatchSource:0}: Error finding container 4a0d7b24abec8357dbe81d7f89274a307306dfd7d5f2d064c0a40d482aafb961: Status 404 returned error can't find the container with id 4a0d7b24abec8357dbe81d7f89274a307306dfd7d5f2d064c0a40d482aafb961
Jul 07 14:19:16.558327 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.558306    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:19:16.825041 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:16.824955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc" event={"ID":"9379f39f-6777-4b4d-8542-3ce9899627d2","Type":"ContainerStarted","Data":"4a0d7b24abec8357dbe81d7f89274a307306dfd7d5f2d064c0a40d482aafb961"}
Jul 07 14:19:18.842377 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:18.842335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc" event={"ID":"9379f39f-6777-4b4d-8542-3ce9899627d2","Type":"ContainerStarted","Data":"b5f94d1ab15466d3090d2acd8cead0ba1d992caf93d82ba1e3ea1bfa10720011"}
Jul 07 14:19:18.862174 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:18.862123    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc" podStartSLOduration=1.608323447 podStartE2EDuration="2.862101612s" totalImagesPullingTime="1.253778165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:19:18.86034796 +0000 UTC m=+723.691432448" watchObservedRunningTime="2026-07-07 14:19:18.862101612 +0000 UTC m=+723.693186098"
Jul 07 14:19:26.411252 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:26.411216    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:26.411691 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:26.411299    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:26.423956 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:26.423926    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:26.892271 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:26.892240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-lj5sc"
Jul 07 14:19:37.415360 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.415328    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"]
Jul 07 14:19:37.419552 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.419533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.422421 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.422400    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 14:19:37.431682 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.431616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"]
Jul 07 14:19:37.520947 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.520911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.520947 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.520952    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxf8m\" (UniqueName: \"kubernetes.io/projected/850fce8a-3aef-43c2-b095-198ee88eb39a-kube-api-access-rxf8m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.521195 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.521001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/850fce8a-3aef-43c2-b095-198ee88eb39a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.521195 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.521041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.521195 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.521105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.521195 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.521160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.622540 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.622500    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.622540 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.622543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.622837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.622570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.622837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.622592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxf8m\" (UniqueName: \"kubernetes.io/projected/850fce8a-3aef-43c2-b095-198ee88eb39a-kube-api-access-rxf8m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.622837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.622661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/850fce8a-3aef-43c2-b095-198ee88eb39a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.622837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.622695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.623068 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.623040    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.623128 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.623076    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.623128 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.623117    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.625114 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.625093    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/850fce8a-3aef-43c2-b095-198ee88eb39a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.625417 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.625390    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/850fce8a-3aef-43c2-b095-198ee88eb39a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.631323 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.631293    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxf8m\" (UniqueName: \"kubernetes.io/projected/850fce8a-3aef-43c2-b095-198ee88eb39a-kube-api-access-rxf8m\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks\" (UID: \"850fce8a-3aef-43c2-b095-198ee88eb39a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.730162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.730088    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:37.865716 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.865692    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"]
Jul 07 14:19:37.867803 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:19:37.867779    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850fce8a_3aef_43c2_b095_198ee88eb39a.slice/crio-7ab8f284fd1bd7b58d69ee088410d38b426b6f7fc356ed0f11a1a270ddc24370 WatchSource:0}: Error finding container 7ab8f284fd1bd7b58d69ee088410d38b426b6f7fc356ed0f11a1a270ddc24370: Status 404 returned error can't find the container with id 7ab8f284fd1bd7b58d69ee088410d38b426b6f7fc356ed0f11a1a270ddc24370
Jul 07 14:19:37.934958 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:37.934917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks" event={"ID":"850fce8a-3aef-43c2-b095-198ee88eb39a","Type":"ContainerStarted","Data":"7ab8f284fd1bd7b58d69ee088410d38b426b6f7fc356ed0f11a1a270ddc24370"}
Jul 07 14:19:38.941591 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:38.941552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks" event={"ID":"850fce8a-3aef-43c2-b095-198ee88eb39a","Type":"ContainerStarted","Data":"cacf8904cbc7a53c4fd75adc14f90964d5d6cd3430b2f9b92a7e41d77a6cff8f"}
Jul 07 14:19:38.961551 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:38.961495    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks" podStartSLOduration=1.744338168 podStartE2EDuration="1.961479048s" totalImagesPullingTime="217.14088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:19:38.96100549 +0000 UTC m=+743.792089977" watchObservedRunningTime="2026-07-07 14:19:38.961479048 +0000 UTC m=+743.792563534"
Jul 07 14:19:47.730799 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:47.730758    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:47.731285 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:47.730820    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:47.743669 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:47.743624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:19:48.002521 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:19:48.002430    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks"
Jul 07 14:21:04.488923 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.488888    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b9c9bb47-zn9vv"]
Jul 07 14:21:04.489425 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.489107    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv" podUID="fb1c7b77-ce34-4239-af35-9181bde52b60" containerName="authorino" containerID="cri-o://229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d" gracePeriod=30
Jul 07 14:21:04.741062 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.740993    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:21:04.748723 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.748698    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb1c7b77-ce34-4239-af35-9181bde52b60-tls-cert\") pod \"fb1c7b77-ce34-4239-af35-9181bde52b60\" (UID: \"fb1c7b77-ce34-4239-af35-9181bde52b60\") "
Jul 07 14:21:04.748860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.748760    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch4mq\" (UniqueName: \"kubernetes.io/projected/fb1c7b77-ce34-4239-af35-9181bde52b60-kube-api-access-ch4mq\") pod \"fb1c7b77-ce34-4239-af35-9181bde52b60\" (UID: \"fb1c7b77-ce34-4239-af35-9181bde52b60\") "
Jul 07 14:21:04.750936 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.750907    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb1c7b77-ce34-4239-af35-9181bde52b60-kube-api-access-ch4mq" (OuterVolumeSpecName: "kube-api-access-ch4mq") pod "fb1c7b77-ce34-4239-af35-9181bde52b60" (UID: "fb1c7b77-ce34-4239-af35-9181bde52b60"). InnerVolumeSpecName "kube-api-access-ch4mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:21:04.761353 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.761249    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb1c7b77-ce34-4239-af35-9181bde52b60-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fb1c7b77-ce34-4239-af35-9181bde52b60" (UID: "fb1c7b77-ce34-4239-af35-9181bde52b60"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:21:04.849920 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.849886    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fb1c7b77-ce34-4239-af35-9181bde52b60-tls-cert\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:21:04.849920 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:04.849914    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch4mq\" (UniqueName: \"kubernetes.io/projected/fb1c7b77-ce34-4239-af35-9181bde52b60-kube-api-access-ch4mq\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:21:05.378105 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.378056    2564 generic.go:356] "Generic (PLEG): container finished" podID="fb1c7b77-ce34-4239-af35-9181bde52b60" containerID="229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d" exitCode=0
Jul 07 14:21:05.378279 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.378102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv" event={"ID":"fb1c7b77-ce34-4239-af35-9181bde52b60","Type":"ContainerDied","Data":"229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d"}
Jul 07 14:21:05.378279 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.378120    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv"
Jul 07 14:21:05.378279 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.378149    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b9c9bb47-zn9vv" event={"ID":"fb1c7b77-ce34-4239-af35-9181bde52b60","Type":"ContainerDied","Data":"cb15022e3f5162ee9f40dcb00753415a83decbef8de4fedb6bf482825e9d6c95"}
Jul 07 14:21:05.378279 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.378167    2564 scope.go:117] "RemoveContainer" containerID="229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d"
Jul 07 14:21:05.388498 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.388477    2564 scope.go:117] "RemoveContainer" containerID="229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d"
Jul 07 14:21:05.388877 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:21:05.388856    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d\": container with ID starting with 229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d not found: ID does not exist" containerID="229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d"
Jul 07 14:21:05.388963 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.388890    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d"} err="failed to get container status \"229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d\": rpc error: code = NotFound desc = could not find container \"229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d\": container with ID starting with 229c8c635ca0bf94001ff39e027a8581990584ca6881c4d8eca7683e991c0d6d not found: ID does not exist"
Jul 07 14:21:05.401471 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.401433    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5b9c9bb47-zn9vv"]
Jul 07 14:21:05.406088 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.406054    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5b9c9bb47-zn9vv"]
Jul 07 14:21:05.715396 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:21:05.715315    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb1c7b77-ce34-4239-af35-9181bde52b60" path="/var/lib/kubelet/pods/fb1c7b77-ce34-4239-af35-9181bde52b60/volumes"
Jul 07 14:22:15.603453 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:15.603359    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:22:15.603951 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:15.603564    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:22:17.132773 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.132740    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65757b9647-szqz2"]
Jul 07 14:22:17.133158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.132953    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-65757b9647-szqz2" podUID="38435e28-8b6a-44dd-ab0f-75b3f35b5b38" containerName="manager" containerID="cri-o://33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1" gracePeriod=30
Jul 07 14:22:17.389390 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.389321    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:22:17.434382 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.434347    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-webhook-cert\") pod \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\" (UID: \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\") "
Jul 07 14:22:17.434579 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.434442    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh926\" (UniqueName: \"kubernetes.io/projected/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-kube-api-access-mh926\") pod \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\" (UID: \"38435e28-8b6a-44dd-ab0f-75b3f35b5b38\") "
Jul 07 14:22:17.437025 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.436988    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "38435e28-8b6a-44dd-ab0f-75b3f35b5b38" (UID: "38435e28-8b6a-44dd-ab0f-75b3f35b5b38"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:22:17.437146 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.437088    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-kube-api-access-mh926" (OuterVolumeSpecName: "kube-api-access-mh926") pod "38435e28-8b6a-44dd-ab0f-75b3f35b5b38" (UID: "38435e28-8b6a-44dd-ab0f-75b3f35b5b38"). InnerVolumeSpecName "kube-api-access-mh926". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:22:17.535378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.535349    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-webhook-cert\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:22:17.535378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.535376    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh926\" (UniqueName: \"kubernetes.io/projected/38435e28-8b6a-44dd-ab0f-75b3f35b5b38-kube-api-access-mh926\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:22:17.736838 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.736806    2564 generic.go:356] "Generic (PLEG): container finished" podID="38435e28-8b6a-44dd-ab0f-75b3f35b5b38" containerID="33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1" exitCode=0
Jul 07 14:22:17.737007 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.736848    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65757b9647-szqz2"
Jul 07 14:22:17.737007 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.736882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65757b9647-szqz2" event={"ID":"38435e28-8b6a-44dd-ab0f-75b3f35b5b38","Type":"ContainerDied","Data":"33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1"}
Jul 07 14:22:17.737007 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.736930    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65757b9647-szqz2" event={"ID":"38435e28-8b6a-44dd-ab0f-75b3f35b5b38","Type":"ContainerDied","Data":"9bc64cb61597650e9185da579556da2f9d0f5af98eff4ec792a1eb314a2763ee"}
Jul 07 14:22:17.737007 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.736953    2564 scope.go:117] "RemoveContainer" containerID="33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1"
Jul 07 14:22:17.745759 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.745742    2564 scope.go:117] "RemoveContainer" containerID="33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1"
Jul 07 14:22:17.746034 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:22:17.746016    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1\": container with ID starting with 33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1 not found: ID does not exist" containerID="33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1"
Jul 07 14:22:17.746111 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.746045    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1"} err="failed to get container status \"33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1\": rpc error: code = NotFound desc = could not find container \"33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1\": container with ID starting with 33ae3be7471cd8c1f8c705bccb89b2a1eda0b2fdbf270d9f8fdac066b535bbc1 not found: ID does not exist"
Jul 07 14:22:17.755402 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.755378    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65757b9647-szqz2"]
Jul 07 14:22:17.759458 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:17.759432    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65757b9647-szqz2"]
Jul 07 14:22:18.501895 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.501860    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65757b9647-6nxtv"]
Jul 07 14:22:18.502399 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.502383    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb1c7b77-ce34-4239-af35-9181bde52b60" containerName="authorino"
Jul 07 14:22:18.502399 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.502401    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb1c7b77-ce34-4239-af35-9181bde52b60" containerName="authorino"
Jul 07 14:22:18.502490 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.502415    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38435e28-8b6a-44dd-ab0f-75b3f35b5b38" containerName="manager"
Jul 07 14:22:18.502490 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.502420    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="38435e28-8b6a-44dd-ab0f-75b3f35b5b38" containerName="manager"
Jul 07 14:22:18.502490 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.502483    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="38435e28-8b6a-44dd-ab0f-75b3f35b5b38" containerName="manager"
Jul 07 14:22:18.502582 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.502492    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb1c7b77-ce34-4239-af35-9181bde52b60" containerName="authorino"
Jul 07 14:22:18.506785 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.506768    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:18.510739 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.510717    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-hr2nw\""
Jul 07 14:22:18.510833 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.510745    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 14:22:18.510833 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.510720    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 14:22:18.515056 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.515032    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65757b9647-6nxtv"]
Jul 07 14:22:18.542196 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.542166    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20c4048e-5c78-49c3-a853-14d9fe31410e-webhook-cert\") pod \"maas-controller-65757b9647-6nxtv\" (UID: \"20c4048e-5c78-49c3-a853-14d9fe31410e\") " pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:18.542378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.542233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28gb6\" (UniqueName: \"kubernetes.io/projected/20c4048e-5c78-49c3-a853-14d9fe31410e-kube-api-access-28gb6\") pod \"maas-controller-65757b9647-6nxtv\" (UID: \"20c4048e-5c78-49c3-a853-14d9fe31410e\") " pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:18.643299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.643267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28gb6\" (UniqueName: \"kubernetes.io/projected/20c4048e-5c78-49c3-a853-14d9fe31410e-kube-api-access-28gb6\") pod \"maas-controller-65757b9647-6nxtv\" (UID: \"20c4048e-5c78-49c3-a853-14d9fe31410e\") " pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:18.643464 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.643346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20c4048e-5c78-49c3-a853-14d9fe31410e-webhook-cert\") pod \"maas-controller-65757b9647-6nxtv\" (UID: \"20c4048e-5c78-49c3-a853-14d9fe31410e\") " pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:18.645884 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.645861    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/20c4048e-5c78-49c3-a853-14d9fe31410e-webhook-cert\") pod \"maas-controller-65757b9647-6nxtv\" (UID: \"20c4048e-5c78-49c3-a853-14d9fe31410e\") " pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:18.651420 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.651387    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28gb6\" (UniqueName: \"kubernetes.io/projected/20c4048e-5c78-49c3-a853-14d9fe31410e-kube-api-access-28gb6\") pod \"maas-controller-65757b9647-6nxtv\" (UID: \"20c4048e-5c78-49c3-a853-14d9fe31410e\") " pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:18.818541 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.818442    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:18.954705 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:18.954680    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65757b9647-6nxtv"]
Jul 07 14:22:18.956777 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:22:18.956753    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c4048e_5c78_49c3_a853_14d9fe31410e.slice/crio-7de2948dcef3faf01b1640b820951dcd21a00f15cf9b8bd7273dd9a6c1218005 WatchSource:0}: Error finding container 7de2948dcef3faf01b1640b820951dcd21a00f15cf9b8bd7273dd9a6c1218005: Status 404 returned error can't find the container with id 7de2948dcef3faf01b1640b820951dcd21a00f15cf9b8bd7273dd9a6c1218005
Jul 07 14:22:19.715593 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:19.715561    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38435e28-8b6a-44dd-ab0f-75b3f35b5b38" path="/var/lib/kubelet/pods/38435e28-8b6a-44dd-ab0f-75b3f35b5b38/volumes"
Jul 07 14:22:19.750473 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:19.750438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65757b9647-6nxtv" event={"ID":"20c4048e-5c78-49c3-a853-14d9fe31410e","Type":"ContainerStarted","Data":"7e99ea50b0e95983a06f581ed07eecebe64079c10ddb697aedbaf7e34e3de2a5"}
Jul 07 14:22:19.750654 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:19.750493    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65757b9647-6nxtv" event={"ID":"20c4048e-5c78-49c3-a853-14d9fe31410e","Type":"ContainerStarted","Data":"7de2948dcef3faf01b1640b820951dcd21a00f15cf9b8bd7273dd9a6c1218005"}
Jul 07 14:22:19.750654 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:19.750540    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:22:19.767503 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:19.767453    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65757b9647-6nxtv" podStartSLOduration=1.090818571 podStartE2EDuration="1.767437181s" totalImagesPullingTime="676.61861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:22:19.766354979 +0000 UTC m=+904.597439465" watchObservedRunningTime="2026-07-07 14:22:19.767437181 +0000 UTC m=+904.598521691"
Jul 07 14:22:30.761252 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:22:30.761222    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65757b9647-6nxtv"
Jul 07 14:27:15.635003 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:27:15.634973    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:27:15.637025 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:27:15.637004    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:30:00.136443 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.136409    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723910-h7b4f"]
Jul 07 14:30:00.139966 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.139947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f"
Jul 07 14:30:00.142798 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.142774    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-kthmm\""
Jul 07 14:30:00.158978 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.158951    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723910-h7b4f"]
Jul 07 14:30:00.248961 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.248917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrm42\" (UniqueName: \"kubernetes.io/projected/650b084a-9db0-4b2b-8d19-a5e500fa358e-kube-api-access-rrm42\") pod \"maas-api-key-cleanup-29723910-h7b4f\" (UID: \"650b084a-9db0-4b2b-8d19-a5e500fa358e\") " pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f"
Jul 07 14:30:00.349892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.349855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrm42\" (UniqueName: \"kubernetes.io/projected/650b084a-9db0-4b2b-8d19-a5e500fa358e-kube-api-access-rrm42\") pod \"maas-api-key-cleanup-29723910-h7b4f\" (UID: \"650b084a-9db0-4b2b-8d19-a5e500fa358e\") " pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f"
Jul 07 14:30:00.358768 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.358734    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrm42\" (UniqueName: \"kubernetes.io/projected/650b084a-9db0-4b2b-8d19-a5e500fa358e-kube-api-access-rrm42\") pod \"maas-api-key-cleanup-29723910-h7b4f\" (UID: \"650b084a-9db0-4b2b-8d19-a5e500fa358e\") " pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f"
Jul 07 14:30:00.458474 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.458382    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f"
Jul 07 14:30:00.803307 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.803283    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723910-h7b4f"]
Jul 07 14:30:00.805266 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:30:00.805239    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod650b084a_9db0_4b2b_8d19_a5e500fa358e.slice/crio-3c3ad642be8128281aeab167e0f58d87a7630e89299d5fea3cc6e2604ffccf85 WatchSource:0}: Error finding container 3c3ad642be8128281aeab167e0f58d87a7630e89299d5fea3cc6e2604ffccf85: Status 404 returned error can't find the container with id 3c3ad642be8128281aeab167e0f58d87a7630e89299d5fea3cc6e2604ffccf85
Jul 07 14:30:00.807162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:00.807141    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:30:01.033058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:01.033023    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f" event={"ID":"650b084a-9db0-4b2b-8d19-a5e500fa358e","Type":"ContainerStarted","Data":"3c3ad642be8128281aeab167e0f58d87a7630e89299d5fea3cc6e2604ffccf85"}
Jul 07 14:30:04.051989 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:04.051885    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f" event={"ID":"650b084a-9db0-4b2b-8d19-a5e500fa358e","Type":"ContainerStarted","Data":"804ae6385fa77cf2bca3a39460ab95eb7f55fd92e23b265a9b309ea22a33876e"}
Jul 07 14:30:04.067086 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:04.067039    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f" podStartSLOduration=1.475453033 podStartE2EDuration="4.067023071s" totalImagesPullingTime="2.591570038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:04.066147101 +0000 UTC m=+1368.897231589" watchObservedRunningTime="2026-07-07 14:30:04.067023071 +0000 UTC m=+1368.898107558"
Jul 07 14:30:05.058448 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:05.058410    2564 generic.go:356] "Generic (PLEG): container finished" podID="650b084a-9db0-4b2b-8d19-a5e500fa358e" containerID="804ae6385fa77cf2bca3a39460ab95eb7f55fd92e23b265a9b309ea22a33876e" exitCode=0
Jul 07 14:30:05.058874 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:05.058463    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f" event={"ID":"650b084a-9db0-4b2b-8d19-a5e500fa358e","Type":"ContainerDied","Data":"804ae6385fa77cf2bca3a39460ab95eb7f55fd92e23b265a9b309ea22a33876e"}
Jul 07 14:30:06.197771 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:06.197743    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f"
Jul 07 14:30:06.307033 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:06.306999    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrm42\" (UniqueName: \"kubernetes.io/projected/650b084a-9db0-4b2b-8d19-a5e500fa358e-kube-api-access-rrm42\") pod \"650b084a-9db0-4b2b-8d19-a5e500fa358e\" (UID: \"650b084a-9db0-4b2b-8d19-a5e500fa358e\") "
Jul 07 14:30:06.309090 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:06.309066    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/650b084a-9db0-4b2b-8d19-a5e500fa358e-kube-api-access-rrm42" (OuterVolumeSpecName: "kube-api-access-rrm42") pod "650b084a-9db0-4b2b-8d19-a5e500fa358e" (UID: "650b084a-9db0-4b2b-8d19-a5e500fa358e"). InnerVolumeSpecName "kube-api-access-rrm42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:30:06.408014 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:06.407958    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrm42\" (UniqueName: \"kubernetes.io/projected/650b084a-9db0-4b2b-8d19-a5e500fa358e-kube-api-access-rrm42\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:30:07.069872 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:07.069845    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f"
Jul 07 14:30:07.069872 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:07.069874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723910-h7b4f" event={"ID":"650b084a-9db0-4b2b-8d19-a5e500fa358e","Type":"ContainerDied","Data":"3c3ad642be8128281aeab167e0f58d87a7630e89299d5fea3cc6e2604ffccf85"}
Jul 07 14:30:07.070099 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:30:07.069916    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c3ad642be8128281aeab167e0f58d87a7630e89299d5fea3cc6e2604ffccf85"
Jul 07 14:32:15.673016 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:32:15.672988    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:32:15.676408 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:32:15.676384    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:37:15.710028 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:15.709999    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:37:15.715139 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:15.715112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:37:25.422277 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.422237    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"]
Jul 07 14:37:25.422720 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.422682    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="650b084a-9db0-4b2b-8d19-a5e500fa358e" containerName="cleanup"
Jul 07 14:37:25.422720 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.422696    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="650b084a-9db0-4b2b-8d19-a5e500fa358e" containerName="cleanup"
Jul 07 14:37:25.422816 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.422768    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="650b084a-9db0-4b2b-8d19-a5e500fa358e" containerName="cleanup"
Jul 07 14:37:25.431006 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.430974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.434604 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.434572    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-184c55e7\"/\"e2e-lifecycle-model-184c55e7-kserve-self-signed-certs\""
Jul 07 14:37:25.434604 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.434591    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-184c55e7\"/\"kube-root-ca.crt\""
Jul 07 14:37:25.434604 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.434602    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-184c55e7\"/\"openshift-service-ca.crt\""
Jul 07 14:37:25.434879 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.434666    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-184c55e7\"/\"default-dockercfg-6hn74\""
Jul 07 14:37:25.435834 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.435808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"]
Jul 07 14:37:25.605702 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.605627    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-dshm\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.605875 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.605738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tmp-dir\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.605875 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.605764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-model-cache\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.605875 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.605810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tls-certs\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.605875 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.605860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-home\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.606006 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.605893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxj59\" (UniqueName: \"kubernetes.io/projected/9ca119ad-af51-4f6e-89bb-89a56a8c80df-kube-api-access-sxj59\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.707445 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.707359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tls-certs\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.707445 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.707404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-home\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.707445 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.707431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxj59\" (UniqueName: \"kubernetes.io/projected/9ca119ad-af51-4f6e-89bb-89a56a8c80df-kube-api-access-sxj59\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.707753 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.707487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-dshm\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.707753 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.707651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tmp-dir\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.707753 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.707706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-model-cache\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.708212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.707863    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-home\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.708212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.707943    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tmp-dir\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.708212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.708002    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-model-cache\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.710156 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.710134    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tls-certs\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.710326 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.710304    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-dshm\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.715758 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.715732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxj59\" (UniqueName: \"kubernetes.io/projected/9ca119ad-af51-4f6e-89bb-89a56a8c80df-kube-api-access-sxj59\") pod \"e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") " pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.742795 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.742758    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:25.877578 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:25.877548    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"]
Jul 07 14:37:25.879352 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:37:25.879327    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ca119ad_af51_4f6e_89bb_89a56a8c80df.slice/crio-4f5dde053cffc7946491d610d6f91275818d7e4e01a2609e78ecffc00b8ac01d WatchSource:0}: Error finding container 4f5dde053cffc7946491d610d6f91275818d7e4e01a2609e78ecffc00b8ac01d: Status 404 returned error can't find the container with id 4f5dde053cffc7946491d610d6f91275818d7e4e01a2609e78ecffc00b8ac01d
Jul 07 14:37:26.267104 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:26.267071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b" event={"ID":"9ca119ad-af51-4f6e-89bb-89a56a8c80df","Type":"ContainerStarted","Data":"ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1"}
Jul 07 14:37:26.267298 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:26.267114    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b" event={"ID":"9ca119ad-af51-4f6e-89bb-89a56a8c80df","Type":"ContainerStarted","Data":"4f5dde053cffc7946491d610d6f91275818d7e4e01a2609e78ecffc00b8ac01d"}
Jul 07 14:37:26.284050 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:26.283999    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b" podStartSLOduration=1.283982329 podStartE2EDuration="1.283982329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:26.282412592 +0000 UTC m=+1811.113497079" watchObservedRunningTime="2026-07-07 14:37:26.283982329 +0000 UTC m=+1811.115066815"
Jul 07 14:37:35.743135 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:35.743102    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:35.743610 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:35.743164    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:35.756358 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:35.756330    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:36.329239 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:36.329200    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:37:58.073242 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:37:58.073201    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"]
Jul 07 14:38:13.095270 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.095213    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b" podUID="9ca119ad-af51-4f6e-89bb-89a56a8c80df" containerName="main" containerID="cri-o://ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1" gracePeriod=45
Jul 07 14:38:13.354697 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.354610    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:38:13.372585 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.372550    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-dshm\") pod \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") "
Jul 07 14:38:13.372585 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.372588    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-home\") pod \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") "
Jul 07 14:38:13.372848 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.372706    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-model-cache\") pod \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") "
Jul 07 14:38:13.372848 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.372739    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxj59\" (UniqueName: \"kubernetes.io/projected/9ca119ad-af51-4f6e-89bb-89a56a8c80df-kube-api-access-sxj59\") pod \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") "
Jul 07 14:38:13.372848 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.372802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tls-certs\") pod \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") "
Jul 07 14:38:13.373011 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.372878    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-home" (OuterVolumeSpecName: "home") pod "9ca119ad-af51-4f6e-89bb-89a56a8c80df" (UID: "9ca119ad-af51-4f6e-89bb-89a56a8c80df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:13.373011 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.372927    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tmp-dir\") pod \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\" (UID: \"9ca119ad-af51-4f6e-89bb-89a56a8c80df\") "
Jul 07 14:38:13.373119 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.372991    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ca119ad-af51-4f6e-89bb-89a56a8c80df" (UID: "9ca119ad-af51-4f6e-89bb-89a56a8c80df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:13.373325 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.373283    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ca119ad-af51-4f6e-89bb-89a56a8c80df" (UID: "9ca119ad-af51-4f6e-89bb-89a56a8c80df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:13.373430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.373326    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-home\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:38:13.373430 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.373348    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-model-cache\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:38:13.375244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.375207    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca119ad-af51-4f6e-89bb-89a56a8c80df-kube-api-access-sxj59" (OuterVolumeSpecName: "kube-api-access-sxj59") pod "9ca119ad-af51-4f6e-89bb-89a56a8c80df" (UID: "9ca119ad-af51-4f6e-89bb-89a56a8c80df"). InnerVolumeSpecName "kube-api-access-sxj59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:38:13.375378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.375356    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ca119ad-af51-4f6e-89bb-89a56a8c80df" (UID: "9ca119ad-af51-4f6e-89bb-89a56a8c80df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:38:13.375378 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.375366    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-dshm" (OuterVolumeSpecName: "dshm") pod "9ca119ad-af51-4f6e-89bb-89a56a8c80df" (UID: "9ca119ad-af51-4f6e-89bb-89a56a8c80df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:13.474350 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.474315    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-dshm\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:38:13.474350 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.474346    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxj59\" (UniqueName: \"kubernetes.io/projected/9ca119ad-af51-4f6e-89bb-89a56a8c80df-kube-api-access-sxj59\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:38:13.474350 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.474358    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tls-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:38:13.474610 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.474367    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ca119ad-af51-4f6e-89bb-89a56a8c80df-tmp-dir\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:38:13.504607 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.504568    2564 generic.go:356] "Generic (PLEG): container finished" podID="9ca119ad-af51-4f6e-89bb-89a56a8c80df" containerID="ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1" exitCode=0
Jul 07 14:38:13.504784 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.504613    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"
Jul 07 14:38:13.504784 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.504615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b" event={"ID":"9ca119ad-af51-4f6e-89bb-89a56a8c80df","Type":"ContainerDied","Data":"ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1"}
Jul 07 14:38:13.504784 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.504739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b" event={"ID":"9ca119ad-af51-4f6e-89bb-89a56a8c80df","Type":"ContainerDied","Data":"4f5dde053cffc7946491d610d6f91275818d7e4e01a2609e78ecffc00b8ac01d"}
Jul 07 14:38:13.504784 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.504766    2564 scope.go:117] "RemoveContainer" containerID="ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1"
Jul 07 14:38:13.514054 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.514037    2564 scope.go:117] "RemoveContainer" containerID="ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1"
Jul 07 14:38:13.514323 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:38:13.514305    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1\": container with ID starting with ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1 not found: ID does not exist" containerID="ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1"
Jul 07 14:38:13.514368 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.514333    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1"} err="failed to get container status \"ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1\": rpc error: code = NotFound desc = could not find container \"ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1\": container with ID starting with ef26f05b590a4c891a4b2ba8a36b1bb78956fb090114d4d3eb11504ff2ef54a1 not found: ID does not exist"
Jul 07 14:38:13.524787 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.524759    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"]
Jul 07 14:38:13.528934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.528909    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-184c55e7/e2e-lifecycle-model-184c55e7-kserve-5cd6d7d959-h675b"]
Jul 07 14:38:13.714728 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:38:13.714693    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca119ad-af51-4f6e-89bb-89a56a8c80df" path="/var/lib/kubelet/pods/9ca119ad-af51-4f6e-89bb-89a56a8c80df/volumes"
Jul 07 14:39:42.589331 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.589293    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"]
Jul 07 14:39:42.590011 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.589993    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca119ad-af51-4f6e-89bb-89a56a8c80df" containerName="main"
Jul 07 14:39:42.590070 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.590015    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca119ad-af51-4f6e-89bb-89a56a8c80df" containerName="main"
Jul 07 14:39:42.590131 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.590120    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca119ad-af51-4f6e-89bb-89a56a8c80df" containerName="main"
Jul 07 14:39:42.599811 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.599761    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.604230 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.604202    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:39:42.604804 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.604778    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8d4709-openshift-default-dockercfg-wssl6\""
Jul 07 14:39:42.607225 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.607199    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"]
Jul 07 14:39:42.692744 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.692704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-data\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.692960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.692774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istiod-ca-cert\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.692960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.692824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-credential-socket\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.692960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.692869    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-envoy\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.692960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.692892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpl68\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-kube-api-access-zpl68\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.692960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.692918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-podinfo\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.692960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.692948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-socket\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.693269 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.692983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-certs\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.693269 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.693054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-token\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794330 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-data\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794526 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istiod-ca-cert\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794526 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-credential-socket\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794526 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-envoy\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794526 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpl68\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-kube-api-access-zpl68\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794526 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-podinfo\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794526 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-socket\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794526 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-certs\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794942 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-token\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.794942 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.794778    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-data\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.795191 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.795165    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-credential-socket\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.795336 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.795226    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-certs\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.795336 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.795267    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-socket\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.795467 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.795443    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istiod-ca-cert\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.797177 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.797153    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-envoy\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.797404 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.797385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-podinfo\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.801942 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.801922    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-token\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.802111 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.802083    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpl68\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-kube-api-access-zpl68\") pod \"e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") " pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:42.915268 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:42.915235    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:43.055212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:43.055179    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"]
Jul 07 14:39:43.057135 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:39:43.057107    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb7b913_8042_44bd_8df5_1058b8ddbb9b.slice/crio-eabb1a6e0dbf3c60581ccb01192ea18acb664b944f81ac80e03549800638ba46 WatchSource:0}: Error finding container eabb1a6e0dbf3c60581ccb01192ea18acb664b944f81ac80e03549800638ba46: Status 404 returned error can't find the container with id eabb1a6e0dbf3c60581ccb01192ea18acb664b944f81ac80e03549800638ba46
Jul 07 14:39:43.059531 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:43.059515    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:39:43.959867 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:43.959826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" event={"ID":"9fb7b913-8042-44bd-8df5-1058b8ddbb9b","Type":"ContainerStarted","Data":"eabb1a6e0dbf3c60581ccb01192ea18acb664b944f81ac80e03549800638ba46"}
Jul 07 14:39:45.773836 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:45.773800    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:39:45.774126 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:45.773874    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:39:45.774126 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:45.773900    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:39:45.974944 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:45.974909    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" event={"ID":"9fb7b913-8042-44bd-8df5-1058b8ddbb9b","Type":"ContainerStarted","Data":"579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178"}
Jul 07 14:39:45.997869 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:45.997815    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" podStartSLOduration=1.284039514 podStartE2EDuration="3.997799738s" totalImagesPullingTime="2.713760224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:45.996060111 +0000 UTC m=+1950.827144600" watchObservedRunningTime="2026-07-07 14:39:45.997799738 +0000 UTC m=+1950.828884225"
Jul 07 14:39:46.915505 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:46.915473    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:46.920329 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:46.920302    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:46.980915 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:46.980874    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:39:46.982005 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:39:46.981983    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:40:01.202335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.202303    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"]
Jul 07 14:40:01.206125 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.206106    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.209221 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.209200    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fd6585\"/\"openshift-service-ca.crt\""
Jul 07 14:40:01.210339 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.210321    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fd6585\"/\"test-model-fd6585-kserve-self-signed-certs\""
Jul 07 14:40:01.210416 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.210322    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fd6585\"/\"kube-root-ca.crt\""
Jul 07 14:40:01.210416 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.210406    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fd6585\"/\"default-dockercfg-vdpwg\""
Jul 07 14:40:01.217533 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.217507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"]
Jul 07 14:40:01.282757 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.282716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5v9q\" (UniqueName: \"kubernetes.io/projected/8ab8ec06-45ab-4f2b-9721-6897b8954b12-kube-api-access-n5v9q\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.282757 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.282763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tmp-dir\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.282992 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.282802    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-home\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.282992 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.282832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-dshm\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.282992 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.282855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-model-cache\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.282992 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.282978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tls-certs\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384240 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tls-certs\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384440 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5v9q\" (UniqueName: \"kubernetes.io/projected/8ab8ec06-45ab-4f2b-9721-6897b8954b12-kube-api-access-n5v9q\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384440 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tmp-dir\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384440 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384309    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-home\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384440 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-dshm\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384440 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-model-cache\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384822 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384801    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tmp-dir\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384904 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384856    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-home\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.384904 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.384884    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-model-cache\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.386742 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.386720    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-dshm\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.387103 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.387082    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tls-certs\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.393145 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.393117    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5v9q\" (UniqueName: \"kubernetes.io/projected/8ab8ec06-45ab-4f2b-9721-6897b8954b12-kube-api-access-n5v9q\") pod \"test-model-fd6585-kserve-778d5d67f7-c4lqj\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") " pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.518598 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.518507    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:01.673502 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:01.673475    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"]
Jul 07 14:40:01.676912 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:40:01.676879    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ab8ec06_45ab_4f2b_9721_6897b8954b12.slice/crio-c6c29246cb5d1d4b28ec067e607f140c8e640ae3120586727a2fecf774bb104d WatchSource:0}: Error finding container c6c29246cb5d1d4b28ec067e607f140c8e640ae3120586727a2fecf774bb104d: Status 404 returned error can't find the container with id c6c29246cb5d1d4b28ec067e607f140c8e640ae3120586727a2fecf774bb104d
Jul 07 14:40:02.060643 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:02.060587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj" event={"ID":"8ab8ec06-45ab-4f2b-9721-6897b8954b12","Type":"ContainerStarted","Data":"6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a"}
Jul 07 14:40:02.060822 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:02.060654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj" event={"ID":"8ab8ec06-45ab-4f2b-9721-6897b8954b12","Type":"ContainerStarted","Data":"c6c29246cb5d1d4b28ec067e607f140c8e640ae3120586727a2fecf774bb104d"}
Jul 07 14:40:02.078943 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:02.078885    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj" podStartSLOduration=1.078870117 podStartE2EDuration="1.078870117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:02.076832029 +0000 UTC m=+1966.907916516" watchObservedRunningTime="2026-07-07 14:40:02.078870117 +0000 UTC m=+1966.909954650"
Jul 07 14:40:02.377539 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:02.377503    2564 patch_prober.go:28] interesting pod/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:58474->10.133.0.44:15021: read: connection reset by peer" start-of-body=
Jul 07 14:40:02.377977 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:02.377574    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:58474->10.133.0.44:15021: read: connection reset by peer"
Jul 07 14:40:03.066554 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:03.066519    2564 generic.go:356] "Generic (PLEG): container finished" podID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerID="579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178" exitCode=0
Jul 07 14:40:03.066742 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:03.066594    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" event={"ID":"9fb7b913-8042-44bd-8df5-1058b8ddbb9b","Type":"ContainerDied","Data":"579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178"}
Jul 07 14:40:03.067158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:03.067142    2564 scope.go:117] "RemoveContainer" containerID="579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178"
Jul 07 14:40:03.068139 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:03.068109    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:40:03.068205 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:03.068191    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:40:03.068243 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:03.068232    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:40:04.073971 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:04.073937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" event={"ID":"9fb7b913-8042-44bd-8df5-1058b8ddbb9b","Type":"ContainerStarted","Data":"fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06"}
Jul 07 14:40:04.915764 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:04.915645    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:40:04.916394 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:04.916364    2564 patch_prober.go:28] interesting pod/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 07 14:40:04.916586 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:04.916561    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 07 14:40:05.916485 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:05.916383    2564 patch_prober.go:28] interesting pod/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 07 14:40:05.917085 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:05.917050    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 07 14:40:06.915911 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:06.915871    2564 patch_prober.go:28] interesting pod/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 07 14:40:06.916210 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:06.916175    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 07 14:40:07.916795 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:07.916752    2564 patch_prober.go:28] interesting pod/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 07 14:40:07.917289 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:07.916824    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 07 14:40:08.919095 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:08.919062    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:40:08.919507 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:08.919435    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:40:08.920244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:08.920229    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:40:11.519311 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:11.519266    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:11.519740 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:11.519328    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:11.531756 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:11.531726    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:12.139805 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:12.139778    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:40:50.712472 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:40:50.712434    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"]
Jul 07 14:41:05.735705 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:05.735620    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj" podUID="8ab8ec06-45ab-4f2b-9721-6897b8954b12" containerName="main" containerID="cri-o://6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a" gracePeriod=45
Jul 07 14:41:05.983317 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:05.983291    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:41:06.125035 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.124951    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-home\") pod \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") "
Jul 07 14:41:06.125035 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.124995    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tls-certs\") pod \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") "
Jul 07 14:41:06.125035 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125035    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-dshm\") pod \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") "
Jul 07 14:41:06.125301 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125082    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tmp-dir\") pod \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") "
Jul 07 14:41:06.125301 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-model-cache\") pod \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") "
Jul 07 14:41:06.125301 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125181    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5v9q\" (UniqueName: \"kubernetes.io/projected/8ab8ec06-45ab-4f2b-9721-6897b8954b12-kube-api-access-n5v9q\") pod \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\" (UID: \"8ab8ec06-45ab-4f2b-9721-6897b8954b12\") "
Jul 07 14:41:06.125301 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125217    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-home" (OuterVolumeSpecName: "home") pod "8ab8ec06-45ab-4f2b-9721-6897b8954b12" (UID: "8ab8ec06-45ab-4f2b-9721-6897b8954b12"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:06.125505 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125403    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ab8ec06-45ab-4f2b-9721-6897b8954b12" (UID: "8ab8ec06-45ab-4f2b-9721-6897b8954b12"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:06.125505 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125425    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ab8ec06-45ab-4f2b-9721-6897b8954b12" (UID: "8ab8ec06-45ab-4f2b-9721-6897b8954b12"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:06.125585 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125551    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tmp-dir\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:06.125585 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125565    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-model-cache\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:06.125585 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.125574    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-home\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:06.127479 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.127454    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-dshm" (OuterVolumeSpecName: "dshm") pod "8ab8ec06-45ab-4f2b-9721-6897b8954b12" (UID: "8ab8ec06-45ab-4f2b-9721-6897b8954b12"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:06.127597 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.127497    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ab8ec06-45ab-4f2b-9721-6897b8954b12" (UID: "8ab8ec06-45ab-4f2b-9721-6897b8954b12"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:41:06.127597 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.127511    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab8ec06-45ab-4f2b-9721-6897b8954b12-kube-api-access-n5v9q" (OuterVolumeSpecName: "kube-api-access-n5v9q") pod "8ab8ec06-45ab-4f2b-9721-6897b8954b12" (UID: "8ab8ec06-45ab-4f2b-9721-6897b8954b12"). InnerVolumeSpecName "kube-api-access-n5v9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:41:06.226793 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.226754    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ab8ec06-45ab-4f2b-9721-6897b8954b12-tls-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:06.226793 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.226783    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ab8ec06-45ab-4f2b-9721-6897b8954b12-dshm\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:06.226793 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.226792    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5v9q\" (UniqueName: \"kubernetes.io/projected/8ab8ec06-45ab-4f2b-9721-6897b8954b12-kube-api-access-n5v9q\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:06.400968 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.400930    2564 generic.go:356] "Generic (PLEG): container finished" podID="8ab8ec06-45ab-4f2b-9721-6897b8954b12" containerID="6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a" exitCode=0
Jul 07 14:41:06.401138 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.400978    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"
Jul 07 14:41:06.401138 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.400996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj" event={"ID":"8ab8ec06-45ab-4f2b-9721-6897b8954b12","Type":"ContainerDied","Data":"6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a"}
Jul 07 14:41:06.401138 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.401034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj" event={"ID":"8ab8ec06-45ab-4f2b-9721-6897b8954b12","Type":"ContainerDied","Data":"c6c29246cb5d1d4b28ec067e607f140c8e640ae3120586727a2fecf774bb104d"}
Jul 07 14:41:06.401138 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.401057    2564 scope.go:117] "RemoveContainer" containerID="6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a"
Jul 07 14:41:06.411017 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.410997    2564 scope.go:117] "RemoveContainer" containerID="6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a"
Jul 07 14:41:06.411293 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:41:06.411264    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a\": container with ID starting with 6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a not found: ID does not exist" containerID="6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a"
Jul 07 14:41:06.411395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.411300    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a"} err="failed to get container status \"6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a\": rpc error: code = NotFound desc = could not find container \"6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a\": container with ID starting with 6f1a738cb76aba81da804194f39620e80da827683c8b689315b081965818282a not found: ID does not exist"
Jul 07 14:41:06.422978 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.422942    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"]
Jul 07 14:41:06.426070 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:06.426048    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fd6585/test-model-fd6585-kserve-778d5d67f7-c4lqj"]
Jul 07 14:41:07.715316 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:07.715278    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ab8ec06-45ab-4f2b-9721-6897b8954b12" path="/var/lib/kubelet/pods/8ab8ec06-45ab-4f2b-9721-6897b8954b12/volumes"
Jul 07 14:41:41.116366 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:41.116326    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"]
Jul 07 14:41:41.116880 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:41.116587    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy" containerID="cri-o://fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06" gracePeriod=30
Jul 07 14:41:41.993650 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:41.993593    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"]
Jul 07 14:41:41.994046 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:41.994032    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab8ec06-45ab-4f2b-9721-6897b8954b12" containerName="main"
Jul 07 14:41:41.994046 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:41.994047    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab8ec06-45ab-4f2b-9721-6897b8954b12" containerName="main"
Jul 07 14:41:41.994177 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:41.994122    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab8ec06-45ab-4f2b-9721-6897b8954b12" containerName="main"
Jul 07 14:41:41.997364 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:41.997343    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:41.999892 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:41.999871    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-cdb540-openshift-default-dockercfg-6bgjf\""
Jul 07 14:41:42.008065 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.008039    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"]
Jul 07 14:41:42.075019 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.074978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-credential-socket\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.075019 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.075026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-envoy\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.075297 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.075096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-certs\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.075297 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.075154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-token\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.075297 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.075197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-data\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.075297 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.075220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-podinfo\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.075297 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.075254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istiod-ca-cert\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.075297 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.075296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-socket\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.075543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.075321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hj4x\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-kube-api-access-2hj4x\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-certs\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176172 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-token\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-data\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-podinfo\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istiod-ca-cert\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176283    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-socket\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hj4x\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-kube-api-access-2hj4x\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-credential-socket\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-envoy\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176621    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-certs\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.176765 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176701    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-data\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.177202 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176791    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-socket\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.177202 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.176995    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-credential-socket\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.177202 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.177099    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istiod-ca-cert\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.178868 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.178844    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-envoy\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.179219 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.179203    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-podinfo\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.184224 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.184201    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-token\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.184576 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.184553    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hj4x\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-kube-api-access-2hj4x\") pod \"e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") " pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.309054 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.308957    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:42.458140 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.458104    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"]
Jul 07 14:41:42.461013 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:41:42.460984    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914fc486_0994_4ea9_b91b_6bff4d1e65d8.slice/crio-88ee625d64c1c06978d6d3deea3f7d3a839b9340394cc6c82c69ecad1adf94cd WatchSource:0}: Error finding container 88ee625d64c1c06978d6d3deea3f7d3a839b9340394cc6c82c69ecad1adf94cd: Status 404 returned error can't find the container with id 88ee625d64c1c06978d6d3deea3f7d3a839b9340394cc6c82c69ecad1adf94cd
Jul 07 14:41:42.463265 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.463234    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:41:42.463346 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.463302    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:41:42.463346 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.463331    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:41:42.591400 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.591306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" event={"ID":"914fc486-0994-4ea9-b91b-6bff4d1e65d8","Type":"ContainerStarted","Data":"31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f"}
Jul 07 14:41:42.591400 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.591366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" event={"ID":"914fc486-0994-4ea9-b91b-6bff4d1e65d8","Type":"ContainerStarted","Data":"88ee625d64c1c06978d6d3deea3f7d3a839b9340394cc6c82c69ecad1adf94cd"}
Jul 07 14:41:42.613233 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:42.613174    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" podStartSLOduration=1.613151034 podStartE2EDuration="1.613151034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:41:42.609840668 +0000 UTC m=+2067.440925155" watchObservedRunningTime="2026-07-07 14:41:42.613151034 +0000 UTC m=+2067.444235522"
Jul 07 14:41:43.309194 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:43.309155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:43.314597 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:43.314571    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:43.597347 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:43.597263    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:43.598356 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:43.598318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:41:46.379850 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.379828    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:41:46.521303 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521264    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-data\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521503 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-certs\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521503 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521347    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-envoy\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521503 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521369    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-token\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521503 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521386    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpl68\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-kube-api-access-zpl68\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521503 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521440    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istiod-ca-cert\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521503 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521471    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-podinfo\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521878 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521545    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-credential-socket\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521878 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521569    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-socket\") pod \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\" (UID: \"9fb7b913-8042-44bd-8df5-1058b8ddbb9b\") "
Jul 07 14:41:46.521878 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521781    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:46.522042 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.521942    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:46.522103 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.522050    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.522103 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.522066    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-workload-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.522200 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.522133    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:46.522200 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.522169    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:41:46.522302 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.522227    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:46.524040 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.524011    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:41:46.524142 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.524037    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:41:46.524142 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.524068    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:46.524368 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.524350    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-kube-api-access-zpl68" (OuterVolumeSpecName: "kube-api-access-zpl68") pod "9fb7b913-8042-44bd-8df5-1058b8ddbb9b" (UID: "9fb7b913-8042-44bd-8df5-1058b8ddbb9b"). InnerVolumeSpecName "kube-api-access-zpl68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:41:46.612884 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.612851    2564 generic.go:356] "Generic (PLEG): container finished" podID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerID="fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06" exitCode=0
Jul 07 14:41:46.613051 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.612902    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"
Jul 07 14:41:46.613051 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.612916    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" event={"ID":"9fb7b913-8042-44bd-8df5-1058b8ddbb9b","Type":"ContainerDied","Data":"fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06"}
Jul 07 14:41:46.613051 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.612979    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s" event={"ID":"9fb7b913-8042-44bd-8df5-1058b8ddbb9b","Type":"ContainerDied","Data":"eabb1a6e0dbf3c60581ccb01192ea18acb664b944f81ac80e03549800638ba46"}
Jul 07 14:41:46.613051 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.613011    2564 scope.go:117] "RemoveContainer" containerID="fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06"
Jul 07 14:41:46.622608 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.622589    2564 scope.go:117] "RemoveContainer" containerID="579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178"
Jul 07 14:41:46.623115 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.623082    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istiod-ca-cert\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.623115 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.623105    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-podinfo\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.623244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.623119    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-credential-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.623244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.623134    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-data\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.623244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.623145    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-envoy\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.623244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.623152    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-istio-token\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.623244 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.623160    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpl68\" (UniqueName: \"kubernetes.io/projected/9fb7b913-8042-44bd-8df5-1058b8ddbb9b-kube-api-access-zpl68\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:41:46.631029 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.631012    2564 scope.go:117] "RemoveContainer" containerID="fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06"
Jul 07 14:41:46.631288 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:41:46.631267    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06\": container with ID starting with fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06 not found: ID does not exist" containerID="fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06"
Jul 07 14:41:46.631334 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.631296    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06"} err="failed to get container status \"fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06\": rpc error: code = NotFound desc = could not find container \"fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06\": container with ID starting with fc7fcb9b9eb99e99aaddf2c4722b4bdea595f1f8288ae5cc0841211d4994bf06 not found: ID does not exist"
Jul 07 14:41:46.631334 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.631314    2564 scope.go:117] "RemoveContainer" containerID="579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178"
Jul 07 14:41:46.631539 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:41:46.631521    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178\": container with ID starting with 579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178 not found: ID does not exist" containerID="579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178"
Jul 07 14:41:46.631645 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.631542    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178"} err="failed to get container status \"579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178\": rpc error: code = NotFound desc = could not find container \"579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178\": container with ID starting with 579388244ccbde2eb7090ddabaa81ff3df85796b8864875f327d92e4d6a8a178 not found: ID does not exist"
Jul 07 14:41:46.644058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.644031    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"]
Jul 07 14:41:46.648076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:46.648053    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8d4709-openshift-default-6fcf4cf4f5-wbx9s"]
Jul 07 14:41:47.720811 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:47.720778    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" path="/var/lib/kubelet/pods/9fb7b913-8042-44bd-8df5-1058b8ddbb9b/volumes"
Jul 07 14:41:50.662506 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.662463    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"]
Jul 07 14:41:50.662983 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.662967    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy"
Jul 07 14:41:50.663048 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.662985    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy"
Jul 07 14:41:50.663048 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.662997    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy"
Jul 07 14:41:50.663048 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.663002    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy"
Jul 07 14:41:50.663158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.663061    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy"
Jul 07 14:41:50.663158 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.663072    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb7b913-8042-44bd-8df5-1058b8ddbb9b" containerName="istio-proxy"
Jul 07 14:41:50.666519 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.666499    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.669101 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.669080    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8c73bb-openshift-default-dockercfg-ms2nq\""
Jul 07 14:41:50.677214 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.677184    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"]
Jul 07 14:41:50.765510 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-envoy\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.765510 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-socket\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.765775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-token\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.765775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-podinfo\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.765775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-certs\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.765775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbbda3f5-f69f-4f10-87ae-623f925da912-istiod-ca-cert\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.765775 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-data\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.765957 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-credential-socket\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.765957 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.765804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7tp\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-kube-api-access-fr7tp\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866558 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbbda3f5-f69f-4f10-87ae-623f925da912-istiod-ca-cert\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866558 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-data\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-credential-socket\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7tp\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-kube-api-access-fr7tp\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-envoy\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-socket\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-token\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-podinfo\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.866830 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.866825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-certs\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.867188 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.867088    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-socket\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.867523 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.867311    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-credential-socket\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.867523 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.867446    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbbda3f5-f69f-4f10-87ae-623f925da912-istiod-ca-cert\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.867523 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.867477    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-certs\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.867747 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.867527    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-data\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.869687 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.869659    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-envoy\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.869799 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.869766    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-podinfo\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.874391 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.874364    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-token\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.874747 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.874724    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7tp\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-kube-api-access-fr7tp\") pod \"e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") " pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:50.980053 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:50.979948    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:51.126205 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:51.126164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"]
Jul 07 14:41:51.127697 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:41:51.127669    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbda3f5_f69f_4f10_87ae_623f925da912.slice/crio-d8d8cbc00b48021c4016250b2bdfae4577e3993f1ca519c01dfa79206674c1a5 WatchSource:0}: Error finding container d8d8cbc00b48021c4016250b2bdfae4577e3993f1ca519c01dfa79206674c1a5: Status 404 returned error can't find the container with id d8d8cbc00b48021c4016250b2bdfae4577e3993f1ca519c01dfa79206674c1a5
Jul 07 14:41:51.129944 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:51.129914    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:41:51.130042 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:51.129983    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:41:51.130042 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:51.130015    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:41:51.640261 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:51.640227    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" event={"ID":"dbbda3f5-f69f-4f10-87ae-623f925da912","Type":"ContainerStarted","Data":"f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959"}
Jul 07 14:41:51.640451 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:51.640277    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" event={"ID":"dbbda3f5-f69f-4f10-87ae-623f925da912","Type":"ContainerStarted","Data":"d8d8cbc00b48021c4016250b2bdfae4577e3993f1ca519c01dfa79206674c1a5"}
Jul 07 14:41:51.660685 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:51.660611    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" podStartSLOduration=1.6605944799999999 podStartE2EDuration="1.66059448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:41:51.658426477 +0000 UTC m=+2076.489510965" watchObservedRunningTime="2026-07-07 14:41:51.66059448 +0000 UTC m=+2076.491678967"
Jul 07 14:41:51.980478 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:51.980390    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:52.985540 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:52.985513    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:53.650763 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:53.650729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:53.651562 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:53.651536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:41:59.638815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:59.638772    2564 patch_prober.go:28] interesting pod/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 14:41:59.639240 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:41:59.638841    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 14:42:00.689564 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:00.689530    2564 generic.go:356] "Generic (PLEG): container finished" podID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerID="31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f" exitCode=0
Jul 07 14:42:00.690032 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:00.689601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" event={"ID":"914fc486-0994-4ea9-b91b-6bff4d1e65d8","Type":"ContainerDied","Data":"31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f"}
Jul 07 14:42:00.690032 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:00.690016    2564 scope.go:117] "RemoveContainer" containerID="31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f"
Jul 07 14:42:00.691062 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:00.691034    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:00.691163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:00.691118    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:00.691226 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:00.691164    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:01.697153 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:01.697111    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" event={"ID":"914fc486-0994-4ea9-b91b-6bff4d1e65d8","Type":"ContainerStarted","Data":"773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036"}
Jul 07 14:42:02.309838 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:02.309804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:42:02.310145 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:02.309838    2564 patch_prober.go:28] interesting pod/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 14:42:02.310318 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:02.310295    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 14:42:03.309847 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:03.309799    2564 patch_prober.go:28] interesting pod/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 14:42:03.310382 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:03.309891    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 14:42:04.309978 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:04.309939    2564 patch_prober.go:28] interesting pod/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 14:42:04.310570 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:04.310536    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 14:42:05.310162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:05.310117    2564 patch_prober.go:28] interesting pod/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 07 14:42:05.310692 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:05.310199    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 07 14:42:06.313906 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:06.313871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:42:06.314387 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:06.314252    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:42:06.315135 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:06.315114    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:42:07.747190 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:07.747157    2564 generic.go:356] "Generic (PLEG): container finished" podID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerID="f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959" exitCode=0
Jul 07 14:42:07.747722 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:07.747225    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" event={"ID":"dbbda3f5-f69f-4f10-87ae-623f925da912","Type":"ContainerDied","Data":"f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959"}
Jul 07 14:42:07.747885 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:07.747865    2564 scope.go:117] "RemoveContainer" containerID="f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959"
Jul 07 14:42:07.748942 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:07.748916    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:07.749007 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:07.748983    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:07.749046 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:07.749015    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:08.651283 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:08.651245    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:42:08.754832 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:08.754788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" event={"ID":"dbbda3f5-f69f-4f10-87ae-623f925da912","Type":"ContainerStarted","Data":"395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de"}
Jul 07 14:42:08.980798 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:08.980704    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:42:08.981956 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:08.981930    2564 patch_prober.go:28] interesting pod/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 14:42:08.982088 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:08.981977    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 14:42:09.980474 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:09.980434    2564 patch_prober.go:28] interesting pod/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 14:42:09.980903 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:09.980527    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 14:42:10.981012 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:10.980973    2564 patch_prober.go:28] interesting pod/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 14:42:10.981401 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:10.981031    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 14:42:11.981137 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:11.981098    2564 patch_prober.go:28] interesting pod/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 14:42:11.981550 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:11.981173    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 14:42:12.982547 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:12.982514    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"]
Jul 07 14:42:12.983162 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:12.982790    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy" containerID="cri-o://773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036" gracePeriod=30
Jul 07 14:42:12.985082 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:12.985053    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:42:12.985330 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:12.985306    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:42:12.986123 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:12.986102    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:42:15.744589 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:15.744558    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:42:15.749411 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:15.749391    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:42:18.260022 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.259996    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:42:18.365539 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365501    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-credential-socket\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.365539 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365539    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-socket\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.365831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365614    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istiod-ca-cert\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.365831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365694    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-podinfo\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.365831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365739    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-data\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.365831 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365771    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hj4x\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-kube-api-access-2hj4x\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.366047 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365925    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:18.366047 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365950    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:18.366047 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.365926    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-envoy\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.366214 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366087    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-certs\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.366214 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366150    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-token\") pod \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\" (UID: \"914fc486-0994-4ea9-b91b-6bff4d1e65d8\") "
Jul 07 14:42:18.366214 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366157    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:42:18.366354 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366308    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:18.366550 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366531    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istiod-ca-cert\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.366666 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366558    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.366666 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366572    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-credential-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.366666 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366586    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-workload-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.366994 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.366966    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:18.368170 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.368150    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-kube-api-access-2hj4x" (OuterVolumeSpecName: "kube-api-access-2hj4x") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "kube-api-access-2hj4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:42:18.368449 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.368436    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:42:18.368581 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.368549    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:18.368581 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.368552    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "914fc486-0994-4ea9-b91b-6bff4d1e65d8" (UID: "914fc486-0994-4ea9-b91b-6bff4d1e65d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:42:18.467625 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.467589    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-data\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.467625 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.467621    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hj4x\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-kube-api-access-2hj4x\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.467870 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.467663    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-envoy\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.467870 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.467673    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-token\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.467870 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.467681    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914fc486-0994-4ea9-b91b-6bff4d1e65d8-istio-podinfo\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:18.807805 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.807767    2564 generic.go:356] "Generic (PLEG): container finished" podID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerID="773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036" exitCode=0
Jul 07 14:42:18.807976 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.807825    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"
Jul 07 14:42:18.807976 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.807855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" event={"ID":"914fc486-0994-4ea9-b91b-6bff4d1e65d8","Type":"ContainerDied","Data":"773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036"}
Jul 07 14:42:18.807976 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.807915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m" event={"ID":"914fc486-0994-4ea9-b91b-6bff4d1e65d8","Type":"ContainerDied","Data":"88ee625d64c1c06978d6d3deea3f7d3a839b9340394cc6c82c69ecad1adf94cd"}
Jul 07 14:42:18.807976 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.807937    2564 scope.go:117] "RemoveContainer" containerID="773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036"
Jul 07 14:42:18.817243 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.817220    2564 scope.go:117] "RemoveContainer" containerID="31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f"
Jul 07 14:42:18.825996 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.825976    2564 scope.go:117] "RemoveContainer" containerID="773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036"
Jul 07 14:42:18.826328 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:42:18.826309    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036\": container with ID starting with 773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036 not found: ID does not exist" containerID="773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036"
Jul 07 14:42:18.826380 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.826339    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036"} err="failed to get container status \"773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036\": rpc error: code = NotFound desc = could not find container \"773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036\": container with ID starting with 773175c053d45e3d52bdb9c910245982dd780eac054e878c8faf8f996f92a036 not found: ID does not exist"
Jul 07 14:42:18.826380 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.826359    2564 scope.go:117] "RemoveContainer" containerID="31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f"
Jul 07 14:42:18.826617 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:42:18.826596    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f\": container with ID starting with 31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f not found: ID does not exist" containerID="31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f"
Jul 07 14:42:18.826722 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.826679    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f"} err="failed to get container status \"31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f\": rpc error: code = NotFound desc = could not find container \"31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f\": container with ID starting with 31e76d2880b8a5acf1b12d60dbf0d52de93a1fea22e3c29915357ef02e78f93f not found: ID does not exist"
Jul 07 14:42:18.829754 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.829729    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"]
Jul 07 14:42:18.833999 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:18.833977    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-cdb540-openshift-default-6f47494c95-j2x4m"]
Jul 07 14:42:19.714815 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:19.714782    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" path="/var/lib/kubelet/pods/914fc486-0994-4ea9-b91b-6bff4d1e65d8/volumes"
Jul 07 14:42:19.936226 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:19.936186    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"]
Jul 07 14:42:19.936488 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:19.936457    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy" containerID="cri-o://395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de" gracePeriod=30
Jul 07 14:42:20.802594 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.802555    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"]
Jul 07 14:42:20.803159 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.803138    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy"
Jul 07 14:42:20.803260 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.803161    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy"
Jul 07 14:42:20.803322 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.803303    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy"
Jul 07 14:42:20.803322 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.803318    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy"
Jul 07 14:42:20.806394 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.806372    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.809150 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.809128    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-cc2ffa-openshift-default-dockercfg-thqtd\""
Jul 07 14:42:20.817606 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.817576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"]
Jul 07 14:42:20.893044 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjr7f\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-kube-api-access-mjr7f\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.893264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db397305-e674-46ec-8177-d743ace0670d-istiod-ca-cert\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.893264 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db397305-e674-46ec-8177-d743ace0670d-istio-podinfo\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.893395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-envoy\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.893395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-data\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.893501 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-certs\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.893501 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-socket\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.893611 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-istio-token\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.893611 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.893581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-credential-socket\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-credential-socket\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994706 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjr7f\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-kube-api-access-mjr7f\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994706 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db397305-e674-46ec-8177-d743ace0670d-istiod-ca-cert\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994706 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db397305-e674-46ec-8177-d743ace0670d-istio-podinfo\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994706 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-envoy\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994927 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-data\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994927 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-certs\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994927 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-socket\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994927 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-istio-token\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.994927 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.994898    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-credential-socket\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.995193 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.995043    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-data\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.995330 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.995293    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db397305-e674-46ec-8177-d743ace0670d-istiod-ca-cert\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.995453 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.995332    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-socket\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.995453 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.995355    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-certs\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.997199 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.997178    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-envoy\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:20.997402 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:20.997384    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db397305-e674-46ec-8177-d743ace0670d-istio-podinfo\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:21.002850 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.002822    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-istio-token\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:21.002957 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.002935    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjr7f\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-kube-api-access-mjr7f\") pod \"e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") " pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:21.119098 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.119007    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:21.259970 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.259933    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"]
Jul 07 14:42:21.262841 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:42:21.262807    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb397305_e674_46ec_8177_d743ace0670d.slice/crio-0bc7ae94d8c7f075e527633cf9452b89d85502e6168c3e25c5e1d6d25776c86b WatchSource:0}: Error finding container 0bc7ae94d8c7f075e527633cf9452b89d85502e6168c3e25c5e1d6d25776c86b: Status 404 returned error can't find the container with id 0bc7ae94d8c7f075e527633cf9452b89d85502e6168c3e25c5e1d6d25776c86b
Jul 07 14:42:21.265140 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.265107    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:21.265232 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.265176    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:21.265232 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.265205    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:21.826255 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.826219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" event={"ID":"db397305-e674-46ec-8177-d743ace0670d","Type":"ContainerStarted","Data":"fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c"}
Jul 07 14:42:21.826662 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.826274    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" event={"ID":"db397305-e674-46ec-8177-d743ace0670d","Type":"ContainerStarted","Data":"0bc7ae94d8c7f075e527633cf9452b89d85502e6168c3e25c5e1d6d25776c86b"}
Jul 07 14:42:21.848891 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:21.848831    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" podStartSLOduration=1.848816249 podStartE2EDuration="1.848816249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:42:21.845649161 +0000 UTC m=+2106.676733666" watchObservedRunningTime="2026-07-07 14:42:21.848816249 +0000 UTC m=+2106.679900736"
Jul 07 14:42:22.119901 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:22.119806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:22.124908 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:22.124882    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:22.835185 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:22.835153    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:22.836199 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:22.836176    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:25.201286 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.201203    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:42:25.337960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.337925    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-data\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.337960 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.337979    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-token\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.338288 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338021    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-certs\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.338288 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338056    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-socket\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.338288 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-envoy\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.338288 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338161    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-podinfo\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.338288 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338195    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbbda3f5-f69f-4f10-87ae-623f925da912-istiod-ca-cert\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.338288 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338225    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-credential-socket\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.338613 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338406    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr7tp\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-kube-api-access-fr7tp\") pod \"dbbda3f5-f69f-4f10-87ae-623f925da912\" (UID: \"dbbda3f5-f69f-4f10-87ae-623f925da912\") "
Jul 07 14:42:25.338903 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338407    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:25.338903 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338432    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:25.338903 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338768    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbbda3f5-f69f-4f10-87ae-623f925da912-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:42:25.339167 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338913    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:25.339167 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.338939    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:25.340624 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.340598    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:25.340752 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.340622    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:42:25.340847 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.340828    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-kube-api-access-fr7tp" (OuterVolumeSpecName: "kube-api-access-fr7tp") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "kube-api-access-fr7tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:42:25.340929 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.340907    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbbda3f5-f69f-4f10-87ae-623f925da912" (UID: "dbbda3f5-f69f-4f10-87ae-623f925da912"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:42:25.440009 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.439974    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr7tp\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-kube-api-access-fr7tp\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.440009 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.440001    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-data\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.440009 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.440010    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-token\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.440009 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.440018    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.440274 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.440028    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-workload-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.440274 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.440036    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-envoy\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.440274 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.440043    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbbda3f5-f69f-4f10-87ae-623f925da912-istio-podinfo\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.440274 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.440051    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbbda3f5-f69f-4f10-87ae-623f925da912-istiod-ca-cert\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.440274 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.440058    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbbda3f5-f69f-4f10-87ae-623f925da912-credential-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:42:25.851708 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.851676    2564 generic.go:356] "Generic (PLEG): container finished" podID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerID="395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de" exitCode=0
Jul 07 14:42:25.851891 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.851724    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"
Jul 07 14:42:25.851891 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.851759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" event={"ID":"dbbda3f5-f69f-4f10-87ae-623f925da912","Type":"ContainerDied","Data":"395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de"}
Jul 07 14:42:25.851891 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.851819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd" event={"ID":"dbbda3f5-f69f-4f10-87ae-623f925da912","Type":"ContainerDied","Data":"d8d8cbc00b48021c4016250b2bdfae4577e3993f1ca519c01dfa79206674c1a5"}
Jul 07 14:42:25.851891 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.851845    2564 scope.go:117] "RemoveContainer" containerID="395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de"
Jul 07 14:42:25.861735 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.861713    2564 scope.go:117] "RemoveContainer" containerID="f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959"
Jul 07 14:42:25.870021 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.869992    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"]
Jul 07 14:42:25.871263 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.871234    2564 scope.go:117] "RemoveContainer" containerID="395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de"
Jul 07 14:42:25.872192 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:42:25.872023    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de\": container with ID starting with 395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de not found: ID does not exist" containerID="395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de"
Jul 07 14:42:25.872192 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.872067    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de"} err="failed to get container status \"395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de\": rpc error: code = NotFound desc = could not find container \"395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de\": container with ID starting with 395d9601fc7c020d7a0082274114088d5b3628e922ce3f55de8a2a332c4726de not found: ID does not exist"
Jul 07 14:42:25.872192 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.872094    2564 scope.go:117] "RemoveContainer" containerID="f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959"
Jul 07 14:42:25.872606 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:42:25.872583    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959\": container with ID starting with f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959 not found: ID does not exist" containerID="f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959"
Jul 07 14:42:25.872736 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.872616    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959"} err="failed to get container status \"f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959\": rpc error: code = NotFound desc = could not find container \"f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959\": container with ID starting with f0452b0c33bb412d72224d8b4079595f62c2cdff9273db97cbed92cf47a1e959 not found: ID does not exist"
Jul 07 14:42:25.874491 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:25.874468    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8c73bb-openshift-default-565f5fd895-6plsd"]
Jul 07 14:42:27.716089 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:27.716051    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" path="/var/lib/kubelet/pods/dbbda3f5-f69f-4f10-87ae-623f925da912/volumes"
Jul 07 14:42:29.123670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.107740    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"]
Jul 07 14:42:29.123670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.123033    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy"
Jul 07 14:42:29.123670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.123056    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="914fc486-0994-4ea9-b91b-6bff4d1e65d8" containerName="istio-proxy"
Jul 07 14:42:29.123670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.123076    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy"
Jul 07 14:42:29.123670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.123085    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy"
Jul 07 14:42:29.123670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.123105    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy"
Jul 07 14:42:29.123670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.123116    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy"
Jul 07 14:42:29.123670 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.123216    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy"
Jul 07 14:42:29.133788 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.133747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"]
Jul 07 14:42:29.133978 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.133894    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.137834 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.137806    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-332265-openshift-default-dockercfg-7pwf7\""
Jul 07 14:42:29.172078 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae392889-4bb3-4c16-a399-84204aa8116e-istiod-ca-cert\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.172078 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-credential-socket\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.172335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-envoy\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.172335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172195    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwz9k\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-kube-api-access-lwz9k\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.172335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-istio-token\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.172335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-data\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.172335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-socket\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.172335 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae392889-4bb3-4c16-a399-84204aa8116e-istio-podinfo\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.172695 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.172369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-certs\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-envoy\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwz9k\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-kube-api-access-lwz9k\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-istio-token\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-data\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-socket\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae392889-4bb3-4c16-a399-84204aa8116e-istio-podinfo\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-certs\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae392889-4bb3-4c16-a399-84204aa8116e-istiod-ca-cert\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273727 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-credential-socket\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273727 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273698    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-data\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273737    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-socket\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273837 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273814    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-certs\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.273929 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.273826    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-credential-socket\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.274468 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.274443    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae392889-4bb3-4c16-a399-84204aa8116e-istiod-ca-cert\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.275654 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.275618    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-envoy\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.276119 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.276096    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae392889-4bb3-4c16-a399-84204aa8116e-istio-podinfo\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.281069 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.281043    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-istio-token\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.281450 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.281429    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwz9k\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-kube-api-access-lwz9k\") pod \"e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") " pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.455790 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.455745    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:29.622543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.622498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"]
Jul 07 14:42:29.630844 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:42:29.630813    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae392889_4bb3_4c16_a399_84204aa8116e.slice/crio-9e2e2f53bc16378aed17763008144737401be0d32acc96486834e09738c8dd64 WatchSource:0}: Error finding container 9e2e2f53bc16378aed17763008144737401be0d32acc96486834e09738c8dd64: Status 404 returned error can't find the container with id 9e2e2f53bc16378aed17763008144737401be0d32acc96486834e09738c8dd64
Jul 07 14:42:29.633299 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.633258    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:29.633375 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.633355    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:29.633409 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.633397    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:29.877077 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.877043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" event={"ID":"ae392889-4bb3-4c16-a399-84204aa8116e","Type":"ContainerStarted","Data":"0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842"}
Jul 07 14:42:29.877283 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.877097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" event={"ID":"ae392889-4bb3-4c16-a399-84204aa8116e","Type":"ContainerStarted","Data":"9e2e2f53bc16378aed17763008144737401be0d32acc96486834e09738c8dd64"}
Jul 07 14:42:29.897040 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:29.896985    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" podStartSLOduration=0.896968139 podStartE2EDuration="896.968139ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:42:29.894938359 +0000 UTC m=+2114.726022847" watchObservedRunningTime="2026-07-07 14:42:29.896968139 +0000 UTC m=+2114.728052626"
Jul 07 14:42:30.456904 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:30.456862    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:30.462021 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:30.461993    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:30.882790 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:30.882758    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:30.883912 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:30.883889    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:35.923422 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:35.921598    2564 generic.go:356] "Generic (PLEG): container finished" podID="db397305-e674-46ec-8177-d743ace0670d" containerID="fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c" exitCode=0
Jul 07 14:42:35.923422 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:35.921726    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" event={"ID":"db397305-e674-46ec-8177-d743ace0670d","Type":"ContainerDied","Data":"fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c"}
Jul 07 14:42:35.923422 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:35.922267    2564 scope.go:117] "RemoveContainer" containerID="fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c"
Jul 07 14:42:35.924493 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:35.924042    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:35.924493 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:35.924121    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:35.924493 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:35.924179    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:36.937014 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:36.936973    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" event={"ID":"db397305-e674-46ec-8177-d743ace0670d","Type":"ContainerStarted","Data":"86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890"}
Jul 07 14:42:37.121501 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:37.121464    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:37.121730 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:37.121686    2564 patch_prober.go:28] interesting pod/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 14:42:37.121812 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:37.121746    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 14:42:37.835547 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:37.835504    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:38.119900 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:38.119789    2564 patch_prober.go:28] interesting pod/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 14:42:38.119900 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:38.119861    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 14:42:39.119836 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:39.119788    2564 patch_prober.go:28] interesting pod/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 14:42:39.120059 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:39.119890    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 14:42:40.120032 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:40.119575    2564 patch_prober.go:28] interesting pod/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 07 14:42:40.120032 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:40.119677    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 07 14:42:41.123767 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:41.123737    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:41.124766 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:41.124742    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:42:42.975977 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:42.975894    2564 generic.go:356] "Generic (PLEG): container finished" podID="ae392889-4bb3-4c16-a399-84204aa8116e" containerID="0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842" exitCode=0
Jul 07 14:42:42.975977 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:42.975964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" event={"ID":"ae392889-4bb3-4c16-a399-84204aa8116e","Type":"ContainerDied","Data":"0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842"}
Jul 07 14:42:42.976477 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:42.976401    2564 scope.go:117] "RemoveContainer" containerID="0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842"
Jul 07 14:42:42.977454 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:42.977430    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:42.977520 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:42.977503    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:42.977560 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:42.977539    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:42:43.983453 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:43.983409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" event={"ID":"ae392889-4bb3-4c16-a399-84204aa8116e","Type":"ContainerStarted","Data":"10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd"}
Jul 07 14:42:44.456288 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:44.456247    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:44.457568 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:44.457527    2564 patch_prober.go:28] interesting pod/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:42:44.457727 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:44.457589    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 14:42:45.456187 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:45.456148    2564 patch_prober.go:28] interesting pod/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:42:45.456580 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:45.456213    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 14:42:45.883719 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:45.883691    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:46.456733 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:46.456689    2564 patch_prober.go:28] interesting pod/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:42:46.457151 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:46.456784    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 14:42:47.456556 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:47.456516    2564 patch_prober.go:28] interesting pod/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:42:47.456782 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:47.456580    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 07 14:42:48.460808 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:48.460773    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:42:48.461857 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:42:48.461835    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:43:16.446937 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.445791    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"]
Jul 07 14:43:16.446937 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.446905    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbda3f5-f69f-4f10-87ae-623f925da912" containerName="istio-proxy"
Jul 07 14:43:16.450348 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.450303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.452869 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.452844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"]
Jul 07 14:43:16.453440 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.453420    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"kube-root-ca.crt\""
Jul 07 14:43:16.453813 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.453796    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"openshift-service-ca.crt\""
Jul 07 14:43:16.454726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.454706    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"auth-test-model-332265-kserve-self-signed-certs\""
Jul 07 14:43:16.454829 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.454809    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"default-dockercfg-qzf7d\""
Jul 07 14:43:16.558906 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.558862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-model-cache\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.559112 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.558917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-home\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.559112 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.558990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7bdb615-be98-45c0-8257-d00eef4dec4b-tls-certs\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.559112 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.559042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-dshm\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.559243 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.559142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-tmp-dir\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.559243 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.559180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jsg6\" (UniqueName: \"kubernetes.io/projected/a7bdb615-be98-45c0-8257-d00eef4dec4b-kube-api-access-5jsg6\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.660437 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.660399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-dshm\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.660697 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.660491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-tmp-dir\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.660697 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.660520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jsg6\" (UniqueName: \"kubernetes.io/projected/a7bdb615-be98-45c0-8257-d00eef4dec4b-kube-api-access-5jsg6\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.660697 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.660559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-model-cache\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.660697 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.660599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-home\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.660697 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.660682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7bdb615-be98-45c0-8257-d00eef4dec4b-tls-certs\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.661000 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.660941    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-tmp-dir\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.661000 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.660989    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-home\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.661108 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.661010    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-model-cache\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.662959 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.662934    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-dshm\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.663239 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.663220    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7bdb615-be98-45c0-8257-d00eef4dec4b-tls-certs\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.673543 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.673516    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jsg6\" (UniqueName: \"kubernetes.io/projected/a7bdb615-be98-45c0-8257-d00eef4dec4b-kube-api-access-5jsg6\") pod \"auth-test-model-332265-kserve-5c75cb64c9-jzf26\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") " pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.761314 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.761223    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:16.899686 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:16.899659    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"]
Jul 07 14:43:16.901289 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:43:16.901262    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7bdb615_be98_45c0_8257_d00eef4dec4b.slice/crio-9f6075aef60f961938688939460c2d7c7b111a1bd503074a3d793adcdfb49e89 WatchSource:0}: Error finding container 9f6075aef60f961938688939460c2d7c7b111a1bd503074a3d793adcdfb49e89: Status 404 returned error can't find the container with id 9f6075aef60f961938688939460c2d7c7b111a1bd503074a3d793adcdfb49e89
Jul 07 14:43:17.156689 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:17.156614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26" event={"ID":"a7bdb615-be98-45c0-8257-d00eef4dec4b","Type":"ContainerStarted","Data":"3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a"}
Jul 07 14:43:17.156689 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:17.156692    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26" event={"ID":"a7bdb615-be98-45c0-8257-d00eef4dec4b","Type":"ContainerStarted","Data":"9f6075aef60f961938688939460c2d7c7b111a1bd503074a3d793adcdfb49e89"}
Jul 07 14:43:17.184081 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:17.184031    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26" podStartSLOduration=1.184014044 podStartE2EDuration="1.184014044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:43:17.18173188 +0000 UTC m=+2162.012816369" watchObservedRunningTime="2026-07-07 14:43:17.184014044 +0000 UTC m=+2162.015098538"
Jul 07 14:43:26.761705 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:26.761658    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:26.762179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:26.761722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:26.774909 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:26.774872    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:43:27.218601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:43:27.218568    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:45:27.292555 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:27.292518    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"]
Jul 07 14:45:42.313314 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.313265    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26" podUID="a7bdb615-be98-45c0-8257-d00eef4dec4b" containerName="main" containerID="cri-o://3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a" gracePeriod=45
Jul 07 14:45:42.574792 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.574731    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:45:42.611933 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.611901    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jsg6\" (UniqueName: \"kubernetes.io/projected/a7bdb615-be98-45c0-8257-d00eef4dec4b-kube-api-access-5jsg6\") pod \"a7bdb615-be98-45c0-8257-d00eef4dec4b\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") "
Jul 07 14:45:42.611933 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.611938    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-home\") pod \"a7bdb615-be98-45c0-8257-d00eef4dec4b\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") "
Jul 07 14:45:42.612163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.611958    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-tmp-dir\") pod \"a7bdb615-be98-45c0-8257-d00eef4dec4b\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") "
Jul 07 14:45:42.612163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612052    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-model-cache\") pod \"a7bdb615-be98-45c0-8257-d00eef4dec4b\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") "
Jul 07 14:45:42.612163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612092    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-dshm\") pod \"a7bdb615-be98-45c0-8257-d00eef4dec4b\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") "
Jul 07 14:45:42.612163 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612135    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7bdb615-be98-45c0-8257-d00eef4dec4b-tls-certs\") pod \"a7bdb615-be98-45c0-8257-d00eef4dec4b\" (UID: \"a7bdb615-be98-45c0-8257-d00eef4dec4b\") "
Jul 07 14:45:42.612372 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612241    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a7bdb615-be98-45c0-8257-d00eef4dec4b" (UID: "a7bdb615-be98-45c0-8257-d00eef4dec4b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:45:42.612372 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612257    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-home" (OuterVolumeSpecName: "home") pod "a7bdb615-be98-45c0-8257-d00eef4dec4b" (UID: "a7bdb615-be98-45c0-8257-d00eef4dec4b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:45:42.612476 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612389    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a7bdb615-be98-45c0-8257-d00eef4dec4b" (UID: "a7bdb615-be98-45c0-8257-d00eef4dec4b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:45:42.612567 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612551    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-home\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:45:42.612626 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612596    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-tmp-dir\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:45:42.612626 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.612611    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-model-cache\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:45:42.614662 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.614614    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7bdb615-be98-45c0-8257-d00eef4dec4b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a7bdb615-be98-45c0-8257-d00eef4dec4b" (UID: "a7bdb615-be98-45c0-8257-d00eef4dec4b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:45:42.614781 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.614764    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-dshm" (OuterVolumeSpecName: "dshm") pod "a7bdb615-be98-45c0-8257-d00eef4dec4b" (UID: "a7bdb615-be98-45c0-8257-d00eef4dec4b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:45:42.614781 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.614771    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7bdb615-be98-45c0-8257-d00eef4dec4b-kube-api-access-5jsg6" (OuterVolumeSpecName: "kube-api-access-5jsg6") pod "a7bdb615-be98-45c0-8257-d00eef4dec4b" (UID: "a7bdb615-be98-45c0-8257-d00eef4dec4b"). InnerVolumeSpecName "kube-api-access-5jsg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:45:42.713490 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.713437    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7bdb615-be98-45c0-8257-d00eef4dec4b-dshm\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:45:42.713490 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.713483    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7bdb615-be98-45c0-8257-d00eef4dec4b-tls-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:45:42.713490 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.713495    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jsg6\" (UniqueName: \"kubernetes.io/projected/a7bdb615-be98-45c0-8257-d00eef4dec4b-kube-api-access-5jsg6\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:45:42.925179 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.925145    2564 generic.go:356] "Generic (PLEG): container finished" podID="a7bdb615-be98-45c0-8257-d00eef4dec4b" containerID="3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a" exitCode=0
Jul 07 14:45:42.925349 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.925190    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"
Jul 07 14:45:42.925349 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.925222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26" event={"ID":"a7bdb615-be98-45c0-8257-d00eef4dec4b","Type":"ContainerDied","Data":"3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a"}
Jul 07 14:45:42.925349 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.925266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26" event={"ID":"a7bdb615-be98-45c0-8257-d00eef4dec4b","Type":"ContainerDied","Data":"9f6075aef60f961938688939460c2d7c7b111a1bd503074a3d793adcdfb49e89"}
Jul 07 14:45:42.925349 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.925287    2564 scope.go:117] "RemoveContainer" containerID="3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a"
Jul 07 14:45:42.937601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.936802    2564 scope.go:117] "RemoveContainer" containerID="3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a"
Jul 07 14:45:42.937601 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:45:42.937530    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a\": container with ID starting with 3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a not found: ID does not exist" containerID="3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a"
Jul 07 14:45:42.937601 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.937562    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a"} err="failed to get container status \"3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a\": rpc error: code = NotFound desc = could not find container \"3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a\": container with ID starting with 3984536851efb049e7d0859987632b5c4bee4947acc24dd61122928af1a7434a not found: ID does not exist"
Jul 07 14:45:42.947136 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.947111    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"]
Jul 07 14:45:42.949058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:42.949035    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-332265/auth-test-model-332265-kserve-5c75cb64c9-jzf26"]
Jul 07 14:45:43.715036 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:43.714995    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7bdb615-be98-45c0-8257-d00eef4dec4b" path="/var/lib/kubelet/pods/a7bdb615-be98-45c0-8257-d00eef4dec4b/volumes"
Jul 07 14:45:59.113916 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.113878    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"]
Jul 07 14:45:59.114570 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.114552    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7bdb615-be98-45c0-8257-d00eef4dec4b" containerName="main"
Jul 07 14:45:59.114619 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.114574    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7bdb615-be98-45c0-8257-d00eef4dec4b" containerName="main"
Jul 07 14:45:59.114742 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.114730    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7bdb615-be98-45c0-8257-d00eef4dec4b" containerName="main"
Jul 07 14:45:59.118399 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.118376    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.121416 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.121390    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"default-dockercfg-qzf7d\""
Jul 07 14:45:59.122838 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.122816    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"openshift-service-ca.crt\""
Jul 07 14:45:59.122984 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.122905    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"sub-test-model-332265-kserve-self-signed-certs\""
Jul 07 14:45:59.123064 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.122816    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"kube-root-ca.crt\""
Jul 07 14:45:59.127386 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.126780    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"]
Jul 07 14:45:59.279465 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.279432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g995\" (UniqueName: \"kubernetes.io/projected/cb69989b-f417-45fd-aca3-061c3cb8aa7a-kube-api-access-4g995\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.279465 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.279469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-home\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.279778 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.279492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tmp-dir\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.279778 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.279572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-dshm\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.279778 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.279705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-model-cache\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.279778 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.279744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tls-certs\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.380501 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.380473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g995\" (UniqueName: \"kubernetes.io/projected/cb69989b-f417-45fd-aca3-061c3cb8aa7a-kube-api-access-4g995\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.380704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.380510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-home\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.380704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.380530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tmp-dir\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.380704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.380555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-dshm\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.380704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.380593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-model-cache\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.380704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.380613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tls-certs\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.380983 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.380925    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-home\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.380983 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.380967    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tmp-dir\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.381089 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.381070    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-model-cache\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.382990 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.382968    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-dshm\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.383142 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.383125    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tls-certs\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.388213 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.388187    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g995\" (UniqueName: \"kubernetes.io/projected/cb69989b-f417-45fd-aca3-061c3cb8aa7a-kube-api-access-4g995\") pod \"sub-test-model-332265-kserve-7bd5dbbf89-csxwd\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") " pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.429969 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.429938    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:45:59.567835 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:45:59.567805    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"]
Jul 07 14:45:59.569620 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:45:59.569594    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb69989b_f417_45fd_aca3_061c3cb8aa7a.slice/crio-b629e61fc184caba452bb99b873da4c0c8f332ecad7f828d02d64bd388f85719 WatchSource:0}: Error finding container b629e61fc184caba452bb99b873da4c0c8f332ecad7f828d02d64bd388f85719: Status 404 returned error can't find the container with id b629e61fc184caba452bb99b873da4c0c8f332ecad7f828d02d64bd388f85719
Jul 07 14:46:00.020607 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:00.020565    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd" event={"ID":"cb69989b-f417-45fd-aca3-061c3cb8aa7a","Type":"ContainerStarted","Data":"183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6"}
Jul 07 14:46:00.020607 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:00.020607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd" event={"ID":"cb69989b-f417-45fd-aca3-061c3cb8aa7a","Type":"ContainerStarted","Data":"b629e61fc184caba452bb99b873da4c0c8f332ecad7f828d02d64bd388f85719"}
Jul 07 14:46:00.037873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:00.037817    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd" podStartSLOduration=1.037799466 podStartE2EDuration="1.037799466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:00.036784688 +0000 UTC m=+2324.867869175" watchObservedRunningTime="2026-07-07 14:46:00.037799466 +0000 UTC m=+2324.868883952"
Jul 07 14:46:09.430496 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:09.430413    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:46:09.430496 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:09.430462    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:46:09.443055 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:09.443028    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:46:10.083748 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:10.083712    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:46:44.518470 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:44.518429    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"]
Jul 07 14:46:59.539704 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.539624    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd" podUID="cb69989b-f417-45fd-aca3-061c3cb8aa7a" containerName="main" containerID="cri-o://183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6" gracePeriod=45
Jul 07 14:46:59.803561 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.803498    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:46:59.878917 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.878865    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-home\") pod \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") "
Jul 07 14:46:59.879098 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.878986    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g995\" (UniqueName: \"kubernetes.io/projected/cb69989b-f417-45fd-aca3-061c3cb8aa7a-kube-api-access-4g995\") pod \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") "
Jul 07 14:46:59.879098 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879018    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tls-certs\") pod \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") "
Jul 07 14:46:59.879098 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-dshm\") pod \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") "
Jul 07 14:46:59.879243 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879173    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tmp-dir\") pod \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") "
Jul 07 14:46:59.879243 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879187    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-home" (OuterVolumeSpecName: "home") pod "cb69989b-f417-45fd-aca3-061c3cb8aa7a" (UID: "cb69989b-f417-45fd-aca3-061c3cb8aa7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:46:59.879243 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879204    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-model-cache\") pod \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\" (UID: \"cb69989b-f417-45fd-aca3-061c3cb8aa7a\") "
Jul 07 14:46:59.879440 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879418    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb69989b-f417-45fd-aca3-061c3cb8aa7a" (UID: "cb69989b-f417-45fd-aca3-061c3cb8aa7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:46:59.879524 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879489    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb69989b-f417-45fd-aca3-061c3cb8aa7a" (UID: "cb69989b-f417-45fd-aca3-061c3cb8aa7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:46:59.879686 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879608    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tmp-dir\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.879686 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879647    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-model-cache\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.879686 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.879662    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-home\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.881322 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.881296    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-dshm" (OuterVolumeSpecName: "dshm") pod "cb69989b-f417-45fd-aca3-061c3cb8aa7a" (UID: "cb69989b-f417-45fd-aca3-061c3cb8aa7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:46:59.881751 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.881732    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb69989b-f417-45fd-aca3-061c3cb8aa7a" (UID: "cb69989b-f417-45fd-aca3-061c3cb8aa7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:46:59.881819 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.881754    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb69989b-f417-45fd-aca3-061c3cb8aa7a-kube-api-access-4g995" (OuterVolumeSpecName: "kube-api-access-4g995") pod "cb69989b-f417-45fd-aca3-061c3cb8aa7a" (UID: "cb69989b-f417-45fd-aca3-061c3cb8aa7a"). InnerVolumeSpecName "kube-api-access-4g995". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:46:59.981129 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.981092    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g995\" (UniqueName: \"kubernetes.io/projected/cb69989b-f417-45fd-aca3-061c3cb8aa7a-kube-api-access-4g995\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.981129 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.981124    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb69989b-f417-45fd-aca3-061c3cb8aa7a-tls-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.981327 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:46:59.981138    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb69989b-f417-45fd-aca3-061c3cb8aa7a-dshm\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:47:00.346444 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.346406    2564 generic.go:356] "Generic (PLEG): container finished" podID="cb69989b-f417-45fd-aca3-061c3cb8aa7a" containerID="183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6" exitCode=0
Jul 07 14:47:00.346661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.346454    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"
Jul 07 14:47:00.346661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.346504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd" event={"ID":"cb69989b-f417-45fd-aca3-061c3cb8aa7a","Type":"ContainerDied","Data":"183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6"}
Jul 07 14:47:00.346661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.346555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd" event={"ID":"cb69989b-f417-45fd-aca3-061c3cb8aa7a","Type":"ContainerDied","Data":"b629e61fc184caba452bb99b873da4c0c8f332ecad7f828d02d64bd388f85719"}
Jul 07 14:47:00.346661 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.346578    2564 scope.go:117] "RemoveContainer" containerID="183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6"
Jul 07 14:47:00.356131 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.356111    2564 scope.go:117] "RemoveContainer" containerID="183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6"
Jul 07 14:47:00.356394 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:47:00.356375    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6\": container with ID starting with 183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6 not found: ID does not exist" containerID="183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6"
Jul 07 14:47:00.356439 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.356403    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6"} err="failed to get container status \"183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6\": rpc error: code = NotFound desc = could not find container \"183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6\": container with ID starting with 183bb3113f9e3c3f6db5238473363d31eca6bd517d03167b810cd79a9aa610c6 not found: ID does not exist"
Jul 07 14:47:00.367806 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.367779    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"]
Jul 07 14:47:00.371292 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:00.371269    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-332265/sub-test-model-332265-kserve-7bd5dbbf89-csxwd"]
Jul 07 14:47:01.715002 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:01.714966    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb69989b-f417-45fd-aca3-061c3cb8aa7a" path="/var/lib/kubelet/pods/cb69989b-f417-45fd-aca3-061c3cb8aa7a/volumes"
Jul 07 14:47:10.801360 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.801323    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"]
Jul 07 14:47:10.801789 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.801760    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb69989b-f417-45fd-aca3-061c3cb8aa7a" containerName="main"
Jul 07 14:47:10.801789 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.801772    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb69989b-f417-45fd-aca3-061c3cb8aa7a" containerName="main"
Jul 07 14:47:10.801867 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.801848    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb69989b-f417-45fd-aca3-061c3cb8aa7a" containerName="main"
Jul 07 14:47:10.806514 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.806491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.810867 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.810819    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"default-dockercfg-qzf7d\""
Jul 07 14:47:10.810867 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.810858    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"rate-test-model-332265-kserve-self-signed-certs\""
Jul 07 14:47:10.811096 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.810895    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"kube-root-ca.crt\""
Jul 07 14:47:10.811096 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.810985    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-332265\"/\"openshift-service-ca.crt\""
Jul 07 14:47:10.812217 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.812197    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"]
Jul 07 14:47:10.895010 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.894965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-dshm\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.895212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.895090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tmp-dir\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.895212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.895156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tls-certs\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.895212 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.895191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-home\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.895396 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.895223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmwp5\" (UniqueName: \"kubernetes.io/projected/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-kube-api-access-bmwp5\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.895396 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.895245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-model-cache\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.996504 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.996463    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tmp-dir\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.996726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.996524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tls-certs\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.996726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.996552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-home\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.996726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.996574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmwp5\" (UniqueName: \"kubernetes.io/projected/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-kube-api-access-bmwp5\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.996726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.996593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-model-cache\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.996726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.996670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-dshm\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.997008 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.996974    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tmp-dir\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.997140 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.996983    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-home\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.997140 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.997072    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-model-cache\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.999145 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.999121    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-dshm\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:10.999395 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:10.999375    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tls-certs\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:11.004433 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:11.004407    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmwp5\" (UniqueName: \"kubernetes.io/projected/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-kube-api-access-bmwp5\") pod \"rate-test-model-332265-kserve-5f68848df9-bd8gv\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") " pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:11.118113 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:11.118009    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:11.267801 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:11.267651    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"]
Jul 07 14:47:11.270786 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:47:11.270752    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11efb8c8_ea29_4e2a_80b0_4d86cf1631ba.slice/crio-e9e0122ec4f7cda71cd405e334394a2cd1cda19d640ebda60ce7e8919dcefb96 WatchSource:0}: Error finding container e9e0122ec4f7cda71cd405e334394a2cd1cda19d640ebda60ce7e8919dcefb96: Status 404 returned error can't find the container with id e9e0122ec4f7cda71cd405e334394a2cd1cda19d640ebda60ce7e8919dcefb96
Jul 07 14:47:11.404931 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:11.404893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv" event={"ID":"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba","Type":"ContainerStarted","Data":"21058efe68f62e306b136448cbda7fcc3dd3e11b47e8b88bc551afd889af6b6c"}
Jul 07 14:47:11.405137 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:11.404942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv" event={"ID":"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba","Type":"ContainerStarted","Data":"e9e0122ec4f7cda71cd405e334394a2cd1cda19d640ebda60ce7e8919dcefb96"}
Jul 07 14:47:11.423407 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:11.423344    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv" podStartSLOduration=1.423316149 podStartE2EDuration="1.423316149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:47:11.420071107 +0000 UTC m=+2396.251155595" watchObservedRunningTime="2026-07-07 14:47:11.423316149 +0000 UTC m=+2396.254400635"
Jul 07 14:47:15.777483 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:15.777453    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:47:15.787202 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:15.787179    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:47:21.118996 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:21.118960    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:21.119447 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:21.119010    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:21.131753 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:21.131724    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:21.467305 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:21.467275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:47:52.492010 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:47:52.491974    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"]
Jul 07 14:48:07.513735 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.513669    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv" podUID="11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" containerName="main" containerID="cri-o://21058efe68f62e306b136448cbda7fcc3dd3e11b47e8b88bc551afd889af6b6c" gracePeriod=45
Jul 07 14:48:07.697009 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.696974    2564 generic.go:356] "Generic (PLEG): container finished" podID="11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" containerID="21058efe68f62e306b136448cbda7fcc3dd3e11b47e8b88bc551afd889af6b6c" exitCode=0
Jul 07 14:48:07.697161 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.697018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv" event={"ID":"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba","Type":"ContainerDied","Data":"21058efe68f62e306b136448cbda7fcc3dd3e11b47e8b88bc551afd889af6b6c"}
Jul 07 14:48:07.776673 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.776597    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:48:07.867453 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867418    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tmp-dir\") pod \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") "
Jul 07 14:48:07.867682 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867463    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-model-cache\") pod \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") "
Jul 07 14:48:07.867682 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867500    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-home\") pod \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") "
Jul 07 14:48:07.867682 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867526    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tls-certs\") pod \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") "
Jul 07 14:48:07.867682 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867576    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-dshm\") pod \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") "
Jul 07 14:48:07.867924 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867720    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmwp5\" (UniqueName: \"kubernetes.io/projected/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-kube-api-access-bmwp5\") pod \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\" (UID: \"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba\") "
Jul 07 14:48:07.867924 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867792    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" (UID: "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:07.867924 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867820    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" (UID: "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:07.867924 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.867834    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-home" (OuterVolumeSpecName: "home") pod "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" (UID: "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:07.868130 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.868038    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tmp-dir\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.868130 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.868055    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-model-cache\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.868130 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.868069    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-home\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.870002 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.869970    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" (UID: "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:48:07.870111 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.870005    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-dshm" (OuterVolumeSpecName: "dshm") pod "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" (UID: "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:07.870111 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.870017    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-kube-api-access-bmwp5" (OuterVolumeSpecName: "kube-api-access-bmwp5") pod "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" (UID: "11efb8c8-ea29-4e2a-80b0-4d86cf1631ba"). InnerVolumeSpecName "kube-api-access-bmwp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:48:07.968710 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.968669    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmwp5\" (UniqueName: \"kubernetes.io/projected/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-kube-api-access-bmwp5\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.968710 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.968702    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-tls-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.968710 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:07.968715    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba-dshm\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:08.704819 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:08.704788    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"
Jul 07 14:48:08.705289 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:08.704837    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv" event={"ID":"11efb8c8-ea29-4e2a-80b0-4d86cf1631ba","Type":"ContainerDied","Data":"e9e0122ec4f7cda71cd405e334394a2cd1cda19d640ebda60ce7e8919dcefb96"}
Jul 07 14:48:08.705289 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:08.704896    2564 scope.go:117] "RemoveContainer" containerID="21058efe68f62e306b136448cbda7fcc3dd3e11b47e8b88bc551afd889af6b6c"
Jul 07 14:48:08.727207 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:08.727175    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"]
Jul 07 14:48:08.732326 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:08.732300    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-332265/rate-test-model-332265-kserve-5f68848df9-bd8gv"]
Jul 07 14:48:09.714420 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:09.714382    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" path="/var/lib/kubelet/pods/11efb8c8-ea29-4e2a-80b0-4d86cf1631ba/volumes"
Jul 07 14:48:36.289847 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:36.289809    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"]
Jul 07 14:48:36.290385 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:36.290041    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy" containerID="cri-o://86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890" gracePeriod=30
Jul 07 14:48:41.127293 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.127253    2564 patch_prober.go:28] interesting pod/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 14:48:41.127690 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.127317    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:48:41.550104 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.550077    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:48:41.603840 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.603804    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-socket\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604039 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.603852    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-credential-socket\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604039 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.603908    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjr7f\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-kube-api-access-mjr7f\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604039 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.603958    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-certs\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604039 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604012    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db397305-e674-46ec-8177-d743ace0670d-istio-podinfo\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604263 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604059    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-data\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604263 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604098    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db397305-e674-46ec-8177-d743ace0670d-istiod-ca-cert\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604263 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604106    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:41.604263 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-envoy\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604263 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604174    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-istio-token\") pod \"db397305-e674-46ec-8177-d743ace0670d\" (UID: \"db397305-e674-46ec-8177-d743ace0670d\") "
Jul 07 14:48:41.604263 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604225    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:41.604577 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604321    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:41.604577 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604485    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db397305-e674-46ec-8177-d743ace0670d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:48:41.604731 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604578    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.604731 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604598    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-credential-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.604731 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.604617    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-workload-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.605312 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.605279    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-data" (OuterVolumeSpecName: "istio-data") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:41.606508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.606471    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db397305-e674-46ec-8177-d743ace0670d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:48:41.606508 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.606494    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:41.606668 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.606532    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-kube-api-access-mjr7f" (OuterVolumeSpecName: "kube-api-access-mjr7f") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "kube-api-access-mjr7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:48:41.606668 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.606545    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-istio-token" (OuterVolumeSpecName: "istio-token") pod "db397305-e674-46ec-8177-d743ace0670d" (UID: "db397305-e674-46ec-8177-d743ace0670d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:48:41.706171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.706085    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjr7f\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-kube-api-access-mjr7f\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.706171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.706118    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db397305-e674-46ec-8177-d743ace0670d-istio-podinfo\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.706171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.706128    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-data\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.706171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.706137    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db397305-e674-46ec-8177-d743ace0670d-istiod-ca-cert\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.706171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.706145    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db397305-e674-46ec-8177-d743ace0670d-istio-envoy\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.706171 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.706153    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db397305-e674-46ec-8177-d743ace0670d-istio-token\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:41.876828 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.876792    2564 generic.go:356] "Generic (PLEG): container finished" podID="db397305-e674-46ec-8177-d743ace0670d" containerID="86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890" exitCode=0
Jul 07 14:48:41.877045 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.876843    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"
Jul 07 14:48:41.877045 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.876875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" event={"ID":"db397305-e674-46ec-8177-d743ace0670d","Type":"ContainerDied","Data":"86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890"}
Jul 07 14:48:41.877045 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.876927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4" event={"ID":"db397305-e674-46ec-8177-d743ace0670d","Type":"ContainerDied","Data":"0bc7ae94d8c7f075e527633cf9452b89d85502e6168c3e25c5e1d6d25776c86b"}
Jul 07 14:48:41.877045 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.876949    2564 scope.go:117] "RemoveContainer" containerID="86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890"
Jul 07 14:48:41.886376 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.886359    2564 scope.go:117] "RemoveContainer" containerID="fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c"
Jul 07 14:48:41.893903 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.893876    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"]
Jul 07 14:48:41.895232 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.895203    2564 scope.go:117] "RemoveContainer" containerID="86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890"
Jul 07 14:48:41.895511 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:48:41.895488    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890\": container with ID starting with 86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890 not found: ID does not exist" containerID="86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890"
Jul 07 14:48:41.895600 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.895522    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890"} err="failed to get container status \"86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890\": rpc error: code = NotFound desc = could not find container \"86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890\": container with ID starting with 86f32b40ccf3dbd1b7d257d691ef4d382d139ad5571c5ab710b9af1bce916890 not found: ID does not exist"
Jul 07 14:48:41.895600 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.895546    2564 scope.go:117] "RemoveContainer" containerID="fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c"
Jul 07 14:48:41.895829 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:48:41.895812    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c\": container with ID starting with fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c not found: ID does not exist" containerID="fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c"
Jul 07 14:48:41.895873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.895835    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c"} err="failed to get container status \"fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c\": rpc error: code = NotFound desc = could not find container \"fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c\": container with ID starting with fe459cbd9766fa1ac3b00663bc2eb843be74e7dd878b50b333cf22c918d96b3c not found: ID does not exist"
Jul 07 14:48:41.901350 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:41.901325    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-cc2ffa-openshift-default-76576b465f-wh6s4"]
Jul 07 14:48:43.170943 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:43.170908    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"]
Jul 07 14:48:43.171380 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:43.171133    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy" containerID="cri-o://10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd" gracePeriod=30
Jul 07 14:48:43.715692 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:43.715614    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db397305-e674-46ec-8177-d743ace0670d" path="/var/lib/kubelet/pods/db397305-e674-46ec-8177-d743ace0670d/volumes"
Jul 07 14:48:48.428459 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.428431    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:48:48.577069 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.576962    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-istio-token\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577069 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577017    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-credential-socket\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577069 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577035    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwz9k\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-kube-api-access-lwz9k\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577069 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577082    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-certs\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577391 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577109    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-data\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577391 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577231    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae392889-4bb3-4c16-a399-84204aa8116e-istiod-ca-cert\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577391 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577286    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-envoy\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577391 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577313    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:48.577391 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577347    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae392889-4bb3-4c16-a399-84204aa8116e-istio-podinfo\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577391 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577378    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-socket\") pod \"ae392889-4bb3-4c16-a399-84204aa8116e\" (UID: \"ae392889-4bb3-4c16-a399-84204aa8116e\") "
Jul 07 14:48:48.577736 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577486    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:48.577736 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577703    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae392889-4bb3-4c16-a399-84204aa8116e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:48:48.577845 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577811    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:48.577947 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577914    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae392889-4bb3-4c16-a399-84204aa8116e-istiod-ca-cert\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.577947 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577938    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.577947 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577949    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-credential-socket\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.577947 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.577958    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-workload-certs\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.578415 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.578284    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:48.579785 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.579757    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:48.579887 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.579794    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-kube-api-access-lwz9k" (OuterVolumeSpecName: "kube-api-access-lwz9k") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "kube-api-access-lwz9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:48:48.580005 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.579986    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:48:48.580058 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.580039    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae392889-4bb3-4c16-a399-84204aa8116e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae392889-4bb3-4c16-a399-84204aa8116e" (UID: "ae392889-4bb3-4c16-a399-84204aa8116e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:48:48.678777 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.678738    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-istio-token\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.678777 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.678770    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwz9k\" (UniqueName: \"kubernetes.io/projected/ae392889-4bb3-4c16-a399-84204aa8116e-kube-api-access-lwz9k\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.678777 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.678781    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-data\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.679020 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.678792    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae392889-4bb3-4c16-a399-84204aa8116e-istio-envoy\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.679020 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.678800    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae392889-4bb3-4c16-a399-84204aa8116e-istio-podinfo\") on node \"ip-10-0-132-63.ec2.internal\" DevicePath \"\""
Jul 07 14:48:48.916490 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.916448    2564 generic.go:356] "Generic (PLEG): container finished" podID="ae392889-4bb3-4c16-a399-84204aa8116e" containerID="10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd" exitCode=0
Jul 07 14:48:48.916726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.916498    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"
Jul 07 14:48:48.916726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.916516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" event={"ID":"ae392889-4bb3-4c16-a399-84204aa8116e","Type":"ContainerDied","Data":"10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd"}
Jul 07 14:48:48.916726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.916570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz" event={"ID":"ae392889-4bb3-4c16-a399-84204aa8116e","Type":"ContainerDied","Data":"9e2e2f53bc16378aed17763008144737401be0d32acc96486834e09738c8dd64"}
Jul 07 14:48:48.916726 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.916599    2564 scope.go:117] "RemoveContainer" containerID="10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd"
Jul 07 14:48:48.926521 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.926500    2564 scope.go:117] "RemoveContainer" containerID="0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842"
Jul 07 14:48:48.935421 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.935387    2564 scope.go:117] "RemoveContainer" containerID="10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd"
Jul 07 14:48:48.935844 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:48:48.935795    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd\": container with ID starting with 10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd not found: ID does not exist" containerID="10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd"
Jul 07 14:48:48.935969 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.935837    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd"} err="failed to get container status \"10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd\": rpc error: code = NotFound desc = could not find container \"10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd\": container with ID starting with 10f0bede03d43f8662b21ed97cdfd115a2ff3a3cfedab58ec1306c5fc5d744fd not found: ID does not exist"
Jul 07 14:48:48.935969 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.935861    2564 scope.go:117] "RemoveContainer" containerID="0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842"
Jul 07 14:48:48.936242 ip-10-0-132-63 kubenswrapper[2564]: E0707 14:48:48.936220    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842\": container with ID starting with 0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842 not found: ID does not exist" containerID="0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842"
Jul 07 14:48:48.936327 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.936250    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842"} err="failed to get container status \"0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842\": rpc error: code = NotFound desc = could not find container \"0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842\": container with ID starting with 0f7d2ac2d487a77c51f4dbe354413968af38864512fa30d608413e25113d7842 not found: ID does not exist"
Jul 07 14:48:48.938598 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.938577    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"]
Jul 07 14:48:48.941703 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.941677    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-332265-openshift-default-857c4fcbb7-d9kkz"]
Jul 07 14:48:48.980045 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:48.980016    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723910-h7b4f_650b084a-9db0-4b2b-8d19-a5e500fa358e/cleanup/0.log"
Jul 07 14:48:49.239150 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:49.239073    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65757b9647-6nxtv_20c4048e-5c78-49c3-a853-14d9fe31410e/manager/0.log"
Jul 07 14:48:49.715733 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:49.715698    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" path="/var/lib/kubelet/pods/ae392889-4bb3-4c16-a399-84204aa8116e/volumes"
Jul 07 14:48:49.868944 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:49.868916    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55dcd65d78-fx4c7_e069afb2-10dc-4136-bdbe-5041472e3efa/manager/0.log"
Jul 07 14:48:49.879731 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:49.879704    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55dcd65d78-fx4c7_e069afb2-10dc-4136-bdbe-5041472e3efa/copy-manifests/0.log"
Jul 07 14:48:49.989003 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:49.988914    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-pxkw5_74997465-981a-4f63-a28b-b0d4ea97668a/postgres/0.log"
Jul 07 14:48:52.738859 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:52.738819    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769bbd759d-9fc2p_4f1bc8d8-eab3-47f8-9f92-586887c18815/kube-auth-proxy/0.log"
Jul 07 14:48:52.975444 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:52.975403    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-gt8ff_130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7/payload-pre-processing/0.log"
Jul 07 14:48:53.090950 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:53.090856    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7jbfb_6ea2d898-32c2-453f-831f-76e907c8228e/payload-processing/0.log"
Jul 07 14:48:53.200307 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:53.200274    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76bd7978f-vbn26_9870b139-e587-4211-a0f3-210bf678bb37/router/0.log"
Jul 07 14:48:53.655370 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:53.655333    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-lj5sc_9379f39f-6777-4b4d-8542-3ce9899627d2/main/0.log"
Jul 07 14:48:53.877974 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:53.877941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbfnlks_850fce8a-3aef-43c2-b095-198ee88eb39a/main/0.log"
Jul 07 14:48:58.123075 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123039    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tp4qk/must-gather-56vvn"]
Jul 07 14:48:58.123472 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123439    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" containerName="main"
Jul 07 14:48:58.123472 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123449    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" containerName="main"
Jul 07 14:48:58.123472 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123465    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy"
Jul 07 14:48:58.123472 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123470    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy"
Jul 07 14:48:58.123602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123486    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy"
Jul 07 14:48:58.123602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123492    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy"
Jul 07 14:48:58.123602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123499    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy"
Jul 07 14:48:58.123602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123504    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy"
Jul 07 14:48:58.123602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123514    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy"
Jul 07 14:48:58.123602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123519    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy"
Jul 07 14:48:58.123602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123591    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy"
Jul 07 14:48:58.123602 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123601    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy"
Jul 07 14:48:58.123873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123607    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="db397305-e674-46ec-8177-d743ace0670d" containerName="istio-proxy"
Jul 07 14:48:58.123873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123613    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="11efb8c8-ea29-4e2a-80b0-4d86cf1631ba" containerName="main"
Jul 07 14:48:58.123873 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.123746    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae392889-4bb3-4c16-a399-84204aa8116e" containerName="istio-proxy"
Jul 07 14:48:58.126868 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.126850    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp4qk/must-gather-56vvn"
Jul 07 14:48:58.129687 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.129664    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tp4qk\"/\"openshift-service-ca.crt\""
Jul 07 14:48:58.131059 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.131034    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tp4qk\"/\"default-dockercfg-rzd2q\""
Jul 07 14:48:58.131206 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.131082    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tp4qk\"/\"kube-root-ca.crt\""
Jul 07 14:48:58.136273 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.136249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp4qk/must-gather-56vvn"]
Jul 07 14:48:58.267625 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.267590    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b991af64-201c-4bac-a72d-74d2b6a02122-must-gather-output\") pod \"must-gather-56vvn\" (UID: \"b991af64-201c-4bac-a72d-74d2b6a02122\") " pod="openshift-must-gather-tp4qk/must-gather-56vvn"
Jul 07 14:48:58.267834 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.267672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqbtr\" (UniqueName: \"kubernetes.io/projected/b991af64-201c-4bac-a72d-74d2b6a02122-kube-api-access-zqbtr\") pod \"must-gather-56vvn\" (UID: \"b991af64-201c-4bac-a72d-74d2b6a02122\") " pod="openshift-must-gather-tp4qk/must-gather-56vvn"
Jul 07 14:48:58.368562 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.368509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b991af64-201c-4bac-a72d-74d2b6a02122-must-gather-output\") pod \"must-gather-56vvn\" (UID: \"b991af64-201c-4bac-a72d-74d2b6a02122\") " pod="openshift-must-gather-tp4qk/must-gather-56vvn"
Jul 07 14:48:58.368786 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.368600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqbtr\" (UniqueName: \"kubernetes.io/projected/b991af64-201c-4bac-a72d-74d2b6a02122-kube-api-access-zqbtr\") pod \"must-gather-56vvn\" (UID: \"b991af64-201c-4bac-a72d-74d2b6a02122\") " pod="openshift-must-gather-tp4qk/must-gather-56vvn"
Jul 07 14:48:58.368933 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.368913    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b991af64-201c-4bac-a72d-74d2b6a02122-must-gather-output\") pod \"must-gather-56vvn\" (UID: \"b991af64-201c-4bac-a72d-74d2b6a02122\") " pod="openshift-must-gather-tp4qk/must-gather-56vvn"
Jul 07 14:48:58.376833 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.376813    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqbtr\" (UniqueName: \"kubernetes.io/projected/b991af64-201c-4bac-a72d-74d2b6a02122-kube-api-access-zqbtr\") pod \"must-gather-56vvn\" (UID: \"b991af64-201c-4bac-a72d-74d2b6a02122\") " pod="openshift-must-gather-tp4qk/must-gather-56vvn"
Jul 07 14:48:58.436955 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.436907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp4qk/must-gather-56vvn"
Jul 07 14:48:58.577134 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.577109    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp4qk/must-gather-56vvn"]
Jul 07 14:48:58.579564 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:48:58.579535    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb991af64_201c_4bac_a72d_74d2b6a02122.slice/crio-b1912c78062b86558fd41a39c5a907886286d4e0055d254daff59eac9a07b36b WatchSource:0}: Error finding container b1912c78062b86558fd41a39c5a907886286d4e0055d254daff59eac9a07b36b: Status 404 returned error can't find the container with id b1912c78062b86558fd41a39c5a907886286d4e0055d254daff59eac9a07b36b
Jul 07 14:48:58.581367 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.581352    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:48:58.968810 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:48:58.968763    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp4qk/must-gather-56vvn" event={"ID":"b991af64-201c-4bac-a72d-74d2b6a02122","Type":"ContainerStarted","Data":"b1912c78062b86558fd41a39c5a907886286d4e0055d254daff59eac9a07b36b"}
Jul 07 14:49:00.983934 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:00.983889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp4qk/must-gather-56vvn" event={"ID":"b991af64-201c-4bac-a72d-74d2b6a02122","Type":"ContainerStarted","Data":"c48f80ed68a18acd74cc7fa2724ba522f97859ea951582844b277390e91ca4b3"}
Jul 07 14:49:00.984361 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:00.983952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp4qk/must-gather-56vvn" event={"ID":"b991af64-201c-4bac-a72d-74d2b6a02122","Type":"ContainerStarted","Data":"87057c38645f99c4187800f44061ae6b941a335d571a4172c673c710a241edf8"}
Jul 07 14:49:01.000500 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:01.000418    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tp4qk/must-gather-56vvn" podStartSLOduration=1.689305299 podStartE2EDuration="3.000396035s" totalImagesPullingTime="1.311090736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:49:00.998967891 +0000 UTC m=+2505.830052377" watchObservedRunningTime="2026-07-07 14:49:01.000396035 +0000 UTC m=+2505.831480523"
Jul 07 14:49:01.403243 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:01.403207    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s67dg_9543d7a4-1d14-4bf6-badf-95b774682013/global-pull-secret-syncer/0.log"
Jul 07 14:49:01.587406 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:01.587372    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kwpfm_83dd5e8e-402f-48b9-a913-1b0eb178101f/konnectivity-agent/0.log"
Jul 07 14:49:01.612694 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:01.612666    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-63.ec2.internal_4f78f1e5224e3338e6765aa113711a8e/haproxy/0.log"
Jul 07 14:49:09.953094 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:09.953014    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7l4gl_8f1af4ad-bf0d-416a-a084-1461692f8307/kube-state-metrics/0.log"
Jul 07 14:49:09.968991 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:09.968958    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7l4gl_8f1af4ad-bf0d-416a-a084-1461692f8307/kube-rbac-proxy-main/0.log"
Jul 07 14:49:09.995315 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:09.995287    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7l4gl_8f1af4ad-bf0d-416a-a084-1461692f8307/kube-rbac-proxy-self/0.log"
Jul 07 14:49:10.080688 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.080624    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn55k_e8595a3a-364c-4c88-b30c-98d4ad4bbc63/node-exporter/0.log"
Jul 07 14:49:10.100427 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.100397    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn55k_e8595a3a-364c-4c88-b30c-98d4ad4bbc63/kube-rbac-proxy/0.log"
Jul 07 14:49:10.120854 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.120828    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn55k_e8595a3a-364c-4c88-b30c-98d4ad4bbc63/init-textfile/0.log"
Jul 07 14:49:10.305618 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.305523    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fsfd6_4fa338ad-3179-4a34-b805-c35c869abb08/kube-rbac-proxy-main/0.log"
Jul 07 14:49:10.324942 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.324905    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fsfd6_4fa338ad-3179-4a34-b805-c35c869abb08/kube-rbac-proxy-self/0.log"
Jul 07 14:49:10.344169 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.344136    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-fsfd6_4fa338ad-3179-4a34-b805-c35c869abb08/openshift-state-metrics/0.log"
Jul 07 14:49:10.377980 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.377939    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ab50c5f6-a760-44b2-932c-8e5fabd0861b/prometheus/0.log"
Jul 07 14:49:10.398940 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.398914    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ab50c5f6-a760-44b2-932c-8e5fabd0861b/config-reloader/0.log"
Jul 07 14:49:10.418447 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.418414    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ab50c5f6-a760-44b2-932c-8e5fabd0861b/thanos-sidecar/0.log"
Jul 07 14:49:10.438492 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.438456    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ab50c5f6-a760-44b2-932c-8e5fabd0861b/kube-rbac-proxy-web/0.log"
Jul 07 14:49:10.457780 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.457748    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ab50c5f6-a760-44b2-932c-8e5fabd0861b/kube-rbac-proxy/0.log"
Jul 07 14:49:10.476785 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.476753    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ab50c5f6-a760-44b2-932c-8e5fabd0861b/kube-rbac-proxy-thanos/0.log"
Jul 07 14:49:10.497808 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.497773    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ab50c5f6-a760-44b2-932c-8e5fabd0861b/init-config-reloader/0.log"
Jul 07 14:49:10.527877 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.527845    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4kj52_fdc4afbe-5e80-4328-99da-069815c7ec00/prometheus-operator/0.log"
Jul 07 14:49:10.546756 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.546727    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4kj52_fdc4afbe-5e80-4328-99da-069815c7ec00/kube-rbac-proxy/0.log"
Jul 07 14:49:10.572284 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.572183    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-46v56_d67a7fde-9c40-4951-94c7-5017011177a7/prometheus-operator-admission-webhook/0.log"
Jul 07 14:49:10.602277 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.602243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c85f8b586-jxbfw_3ae13a15-87a5-43f8-9e68-65d92211e5fb/telemeter-client/0.log"
Jul 07 14:49:10.621290 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.621238    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c85f8b586-jxbfw_3ae13a15-87a5-43f8-9e68-65d92211e5fb/reload/0.log"
Jul 07 14:49:10.640496 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.640464    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c85f8b586-jxbfw_3ae13a15-87a5-43f8-9e68-65d92211e5fb/kube-rbac-proxy/0.log"
Jul 07 14:49:10.666472 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.666443    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/thanos-query/0.log"
Jul 07 14:49:10.685011 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.684976    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/kube-rbac-proxy-web/0.log"
Jul 07 14:49:10.705161 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.705136    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/kube-rbac-proxy/0.log"
Jul 07 14:49:10.723341 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.723307    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/prom-label-proxy/0.log"
Jul 07 14:49:10.741354 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.741320    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/kube-rbac-proxy-rules/0.log"
Jul 07 14:49:10.760400 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:10.760371    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85c6bf7d45-qrq6b_ced40f1d-ffb2-426d-b1fd-a5935722b33e/kube-rbac-proxy-metrics/0.log"
Jul 07 14:49:11.843384 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.843342    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"]
Jul 07 14:49:11.851967 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.851932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:11.856753 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.856704    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"]
Jul 07 14:49:11.915149 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.915103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-sys\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:11.915354 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.915208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-lib-modules\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:11.915354 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.915248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-podres\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:11.915354 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.915270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqtms\" (UniqueName: \"kubernetes.io/projected/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-kube-api-access-mqtms\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:11.915516 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.915356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-proc\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:11.947189 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:11.947158    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-594lf_b1f5e365-9efd-4a80-b21c-5b446aab6340/networking-console-plugin/0.log"
Jul 07 14:49:12.016949 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.016906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-sys\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.017161 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.017005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-lib-modules\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.017161 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.017049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-podres\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.017161 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.017075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqtms\" (UniqueName: \"kubernetes.io/projected/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-kube-api-access-mqtms\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.017344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.017164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-proc\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.017344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.017277    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-proc\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.017344 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.017338    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-sys\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.017509 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.017451    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-lib-modules\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.017566 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.017520    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-podres\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.026387 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.026348    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqtms\" (UniqueName: \"kubernetes.io/projected/2b6246ae-0f39-48d4-86b5-1ed7b60ecc81-kube-api-access-mqtms\") pod \"perf-node-gather-daemonset-g9z6g\" (UID: \"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.171759 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.171718    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:12.370026 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.369907    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"]
Jul 07 14:49:12.375112 ip-10-0-132-63 kubenswrapper[2564]: W0707 14:49:12.375063    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b6246ae_0f39_48d4_86b5_1ed7b60ecc81.slice/crio-9fbc37f5335d742fd3f074dda5ebeb9fa20881013850a8baa63a5f0710f47c45 WatchSource:0}: Error finding container 9fbc37f5335d742fd3f074dda5ebeb9fa20881013850a8baa63a5f0710f47c45: Status 404 returned error can't find the container with id 9fbc37f5335d742fd3f074dda5ebeb9fa20881013850a8baa63a5f0710f47c45
Jul 07 14:49:12.660318 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.660292    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/2.log"
Jul 07 14:49:12.669341 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:12.669304    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-vxntv_6ba46223-105a-42fa-911d-7a49fb4d061a/console-operator/3.log"
Jul 07 14:49:13.077047 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:13.077007    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g" event={"ID":"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81","Type":"ContainerStarted","Data":"a968f1438823337b7b721f7d8cf685e0d3f9a630a89e7d4070840cf7f591431d"}
Jul 07 14:49:13.077487 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:13.077102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g" event={"ID":"2b6246ae-0f39-48d4-86b5-1ed7b60ecc81","Type":"ContainerStarted","Data":"9fbc37f5335d742fd3f074dda5ebeb9fa20881013850a8baa63a5f0710f47c45"}
Jul 07 14:49:13.077487 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:13.077143    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:13.093561 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:13.093491    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g" podStartSLOduration=2.093467785 podStartE2EDuration="2.093467785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:49:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:49:13.091228568 +0000 UTC m=+2517.922313056" watchObservedRunningTime="2026-07-07 14:49:13.093467785 +0000 UTC m=+2517.924552273"
Jul 07 14:49:13.743364 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:13.743334    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-rhslw_ada37b9b-b6df-4438-8103-a24766866f67/volume-data-source-validator/0.log"
Jul 07 14:49:14.737129 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:14.737098    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bnq5v_4be4ed7e-4a00-4ab0-8b9c-02276c6511cf/dns/0.log"
Jul 07 14:49:14.755541 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:14.755511    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bnq5v_4be4ed7e-4a00-4ab0-8b9c-02276c6511cf/kube-rbac-proxy/0.log"
Jul 07 14:49:14.870446 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:14.870411    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-65fwj_6d939d2a-40f6-4fec-8cc8-3c0e5334d502/dns-node-resolver/0.log"
Jul 07 14:49:15.528966 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:15.528935    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xr9q6_18a01f98-93bb-4b3e-8786-f20c762b3b0b/node-ca/0.log"
Jul 07 14:49:16.593252 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:16.593216    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769bbd759d-9fc2p_4f1bc8d8-eab3-47f8-9f92-586887c18815/kube-auth-proxy/0.log"
Jul 07 14:49:16.702975 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:16.702940    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-gt8ff_130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7/payload-pre-processing/0.log"
Jul 07 14:49:16.776690 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:16.776618    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7jbfb_6ea2d898-32c2-453f-831f-76e907c8228e/payload-processing/0.log"
Jul 07 14:49:16.804955 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:16.804923    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76bd7978f-vbn26_9870b139-e587-4211-a0f3-210bf678bb37/router/0.log"
Jul 07 14:49:17.523313 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:17.523273    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kj7vc_7fb99be6-6d69-4ba6-a51e-f7d3daf9f6c0/serve-healthcheck-canary/0.log"
Jul 07 14:49:18.055767 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:18.055722    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nrr6_7922daa5-1590-4224-9217-c970c576e48d/kube-rbac-proxy/0.log"
Jul 07 14:49:18.076890 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:18.076858    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nrr6_7922daa5-1590-4224-9217-c970c576e48d/exporter/0.log"
Jul 07 14:49:18.099144 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:18.099109    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nrr6_7922daa5-1590-4224-9217-c970c576e48d/extractor/0.log"
Jul 07 14:49:19.097449 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:19.097424    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-g9z6g"
Jul 07 14:49:20.533732 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:20.533702    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723910-h7b4f_650b084a-9db0-4b2b-8d19-a5e500fa358e/cleanup/0.log"
Jul 07 14:49:20.713076 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:20.712278    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65757b9647-6nxtv_20c4048e-5c78-49c3-a853-14d9fe31410e/manager/0.log"
Jul 07 14:49:20.969916 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:20.969885    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55dcd65d78-fx4c7_e069afb2-10dc-4136-bdbe-5041472e3efa/manager/0.log"
Jul 07 14:49:20.990428 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:20.990402    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55dcd65d78-fx4c7_e069afb2-10dc-4136-bdbe-5041472e3efa/copy-manifests/0.log"
Jul 07 14:49:21.024173 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:21.024135    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-pxkw5_74997465-981a-4f63-a28b-b0d4ea97668a/postgres/0.log"
Jul 07 14:49:22.567469 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:22.567431    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6489488d88-286j5_1e2f8e11-4514-46a8-9a0a-6e9b68eac2ef/manager/0.log"
Jul 07 14:49:22.613525 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:22.613479    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769bbd759d-9fc2p_4f1bc8d8-eab3-47f8-9f92-586887c18815/kube-auth-proxy/0.log"
Jul 07 14:49:22.615589 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:22.615563    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-l49pd_bb2d73eb-74e4-4204-bc66-91f0fabe1325/openshift-lws-operator/0.log"
Jul 07 14:49:22.684314 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:22.684277    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-gt8ff_130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7/payload-pre-processing/0.log"
Jul 07 14:49:22.740327 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:22.740242    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7jbfb_6ea2d898-32c2-453f-831f-76e907c8228e/payload-processing/0.log"
Jul 07 14:49:22.754331 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:22.754294    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76bd7978f-vbn26_9870b139-e587-4211-a0f3-210bf678bb37/router/0.log"
Jul 07 14:49:24.122764 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:24.122703    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769bbd759d-9fc2p_4f1bc8d8-eab3-47f8-9f92-586887c18815/kube-auth-proxy/0.log"
Jul 07 14:49:24.204465 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:24.204427    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-gt8ff_130310bc-e3ee-46c3-a7c8-e3baf7b7cbd7/payload-pre-processing/0.log"
Jul 07 14:49:24.266768 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:24.266680    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-7jbfb_6ea2d898-32c2-453f-831f-76e907c8228e/payload-processing/0.log"
Jul 07 14:49:24.280992 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:24.280958    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76bd7978f-vbn26_9870b139-e587-4211-a0f3-210bf678bb37/router/0.log"
Jul 07 14:49:27.802334 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:27.802293    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-fjbv4_e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d/kube-storage-version-migrator-operator/1.log"
Jul 07 14:49:27.804262 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:27.804234    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-fjbv4_e5c3f9f3-d7bb-47c2-90a7-3bf7e2680a0d/kube-storage-version-migrator-operator/0.log"
Jul 07 14:49:28.834736 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:28.834689    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9zx27_13a7cdea-0bcf-475c-8ae6-f105edf86bc9/kube-multus/0.log"
Jul 07 14:49:28.993973 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:28.993946    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cl87_0e18eb63-f577-4035-af15-9ece40255edb/kube-multus-additional-cni-plugins/0.log"
Jul 07 14:49:29.015352 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:29.015265    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cl87_0e18eb63-f577-4035-af15-9ece40255edb/egress-router-binary-copy/0.log"
Jul 07 14:49:29.037122 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:29.037094    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cl87_0e18eb63-f577-4035-af15-9ece40255edb/cni-plugins/0.log"
Jul 07 14:49:29.054767 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:29.054743    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cl87_0e18eb63-f577-4035-af15-9ece40255edb/bond-cni-plugin/0.log"
Jul 07 14:49:29.073139 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:29.073115    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cl87_0e18eb63-f577-4035-af15-9ece40255edb/routeoverride-cni/0.log"
Jul 07 14:49:29.092403 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:29.092373    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cl87_0e18eb63-f577-4035-af15-9ece40255edb/whereabouts-cni-bincopy/0.log"
Jul 07 14:49:29.110860 ip-10-0-132-63 kubenswrapper[2564]: I0707 14:49:29.110832    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cl87_0e18eb63-f577-4035-af15-9ece40255edb/whereabouts-cni/0.log"