Jul 07 17:51:31.674448 ip-10-0-133-54 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 17:51:31.674481 ip-10-0-133-54 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 17:51:31.674488 ip-10-0-133-54 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 17:51:31.674714 ip-10-0-133-54 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 17:51:41.738920 ip-10-0-133-54 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 17:51:41.738939 ip-10-0-133-54 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bbe24ec83e2c4a0886b04b3b673ce6d8 --
Jul 07 17:53:17.178104 ip-10-0-133-54 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 17:53:17.641775 ip-10-0-133-54 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:53:17.641775 ip-10-0-133-54 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 17:53:17.641775 ip-10-0-133-54 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:53:17.641775 ip-10-0-133-54 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 17:53:17.641775 ip-10-0-133-54 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:53:17.642979 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.642851    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 17:53:17.647912 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647894    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:17.647912 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647910    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:17.647912 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647914    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647917    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647921    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647924    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647927    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647936    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647939    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647942    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647945    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647947    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647950    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647953    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647956    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647958    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647961    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647963    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647966    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647969    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647972    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647974    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:17.648019 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647977    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647979    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647982    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647985    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647988    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647990    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647992    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647995    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.647997    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648001    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648006    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648008    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648011    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648014    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648017    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648020    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648024    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648026    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648030    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:17.648505 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648033    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648035    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648037    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648040    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648043    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648045    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648048    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648050    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648053    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648057    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648060    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648063    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648067    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648069    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648072    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648075    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648078    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648080    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648083    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648085    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:17.648994 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648088    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648090    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648093    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648095    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648097    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648101    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648103    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648107    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648110    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648112    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648116    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648118    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648121    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648123    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648126    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648128    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648131    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648133    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648136    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:17.649472 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648138    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648140    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648143    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648145    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648148    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648150    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648152    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648155    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648157    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648160    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648162    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648164    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648167    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648169    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648173    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648176    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648179    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648181    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648184    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:17.649959 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648899    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648907    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648910    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648913    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648916    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648919    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648922    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648924    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648927    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648930    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648933    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648935    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648938    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648941    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648944    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648946    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648949    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648952    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648954    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648957    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:17.650414 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648959    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648962    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648965    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648968    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648972    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648975    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648977    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648980    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648982    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648985    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648987    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648990    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648993    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648996    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.648999    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649002    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649004    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649008    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649011    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:17.650925 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649014    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649017    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649019    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649022    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649024    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649027    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649030    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649032    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649035    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649038    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649041    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649043    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649046    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649048    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649051    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649054    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649057    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649059    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649063    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649065    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:17.651398 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649068    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649071    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649073    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649076    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649079    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649082    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649085    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649087    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649090    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649092    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649095    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649098    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649111    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649115    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649118    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649121    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649125    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649128    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649130    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:17.651911 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649133    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649135    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649138    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649141    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649143    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649146    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649150    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649153    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649156    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649159    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649161    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649165    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649167    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649170    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649172    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649175    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649177    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649180    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649182    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:17.652383 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649185    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649187    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649653    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649659    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649663    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649665    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649675    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649678    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649680    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649683    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649686    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649689    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649691    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649694    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649696    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649700    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649704    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649706    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649709    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:17.652879 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649713    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649716    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649719    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649722    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649725    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649728    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649730    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649733    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649735    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649738    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649741    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649743    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649746    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649749    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649751    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649754    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649756    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649759    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649761    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649764    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:17.653346 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649768    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649770    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649773    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649775    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649778    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649780    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649782    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649785    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649788    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649790    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649792    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649795    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649797    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649800    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649802    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649804    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649807    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649823    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649827    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649829    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:17.653843 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649832    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649834    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649837    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649839    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649842    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649847    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649849    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649852    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649854    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649857    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649860    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649862    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649865    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649868    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649870    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649873    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649875    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649877    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649880    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649884    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:17.654371 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649887    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649890    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649893    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649895    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649898    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649900    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649904    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649906    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649909    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649912    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649914    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649917    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649919    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649922    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649924    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649927    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649930    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649933    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649936    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:17.654864 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649939    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649941    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.649944    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650020    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650035    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650042    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650046    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650051    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650055    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650059    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650063    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650067    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650070    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650073    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650076    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650080    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650082    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650085    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650088    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650091    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650095    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650098    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650101    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650105    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 17:53:17.655353 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650108    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650111    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650114    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650117    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650120    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650124    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650127    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650130    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650133    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650136    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650139    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650143    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650146    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650149    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650151    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650154    2576 flags.go:64] FLAG: --enable-server="true"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650158    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650162    2576 flags.go:64] FLAG: --event-burst="100"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650165    2576 flags.go:64] FLAG: --event-qps="50"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650168    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650171    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650174    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650177    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650180    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650183    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 17:53:17.655952 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650186    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650189    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650192    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650195    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650198    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650202    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650205    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650208    2576 flags.go:64] FLAG: --feature-gates=""
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650211    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650214    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650217    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650220    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650223    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650227    2576 flags.go:64] FLAG: --help="false"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650230    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650233    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650236    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650239    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650242    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650246    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650248    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650251    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650254    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 17:53:17.656567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650257    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650260    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650264    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650267    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650270    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650273    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650276    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650279    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650281    2576 flags.go:64] FLAG: --lock-file=""
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650284    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650287    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650290    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650295    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650298    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650302    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650305    2576 flags.go:64] FLAG: --logging-format="text"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650308    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650311    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650314    2576 flags.go:64] FLAG: --manifest-url=""
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650317    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650321    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650324    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650328    2576 flags.go:64] FLAG: --max-pods="110"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650331    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650334    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 17:53:17.657232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650337    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650340    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650343    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650346    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650349    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650356    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650359    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650362    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650365    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650368    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650375    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650378    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650381    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650383    2576 flags.go:64] FLAG: --port="10250"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650386    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650389    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-039e8bcda6f6e2aec"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650392    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650395    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650398    2576 flags.go:64] FLAG: --register-node="true"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650401    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650405    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650408    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650411    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650414    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650418    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 17:53:17.657896 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650421    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650424    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650427    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650430    2576 flags.go:64] FLAG: --runonce="false"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650433    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650436    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650439    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650442    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650444    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650447    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650450    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650453    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650455    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650458    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650461    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650464    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650466    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650470    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650473    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650477    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650480    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650484    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650487    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650490    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650493    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 17:53:17.658503 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650495    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650498    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650501    2576 flags.go:64] FLAG: --v="2"
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650506    2576 flags.go:64] FLAG: --version="false"
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650510    2576 flags.go:64] FLAG: --vmodule=""
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650514    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650517    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650645    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650648    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650651    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650654    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650657    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650661    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650663    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650666    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650669    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650672    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650676    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650679    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650682    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:17.659169 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650685    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650688    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650691    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650694    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650698    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650701    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650704    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650707    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650710    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650713    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650715    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650718    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650721    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650725    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650728    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650731    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650734    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650736    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650739    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650741    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:17.659774 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650744    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650746    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650749    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650751    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650754    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650757    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650760    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650762    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650765    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650767    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650770    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650772    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650774    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650777    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650779    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650782    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650784    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650787    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650790    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650792    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:17.660290 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650795    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650797    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650800    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650802    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650804    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650807    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650822    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650829    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650832    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650834    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650837    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650839    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650842    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650845    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650847    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650849    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650853    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650856    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650858    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650861    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:17.660795 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650863    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650866    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650868    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650871    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650874    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650876    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650879    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650881    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650885    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650889    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650892    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650895    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650898    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650901    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650904    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650907    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650910    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650912    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650915    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650919    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:17.661307 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650922    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650925    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650927    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650930    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650933    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.650936    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.650941    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.658567    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.658584    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.658604    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.658613    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658672    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658677    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658682    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:17.661863 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658686    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658689    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658692    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658695    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658698    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658701    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658704    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658707    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658710    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658713    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658715    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658718    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658721    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658723    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658726    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658728    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658731    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658733    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658736    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:17.662239 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658738    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658742    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658746    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658748    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658752    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658754    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658757    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658760    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658763    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658766    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658769    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658771    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658774    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658777    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658779    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658782    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658784    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658787    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658789    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658793    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:17.662697 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658795    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658797    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658800    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658803    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658805    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658808    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658829    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658832    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658835    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658837    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658840    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658843    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658846    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658848    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658851    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658853    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658856    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658859    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658861    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658864    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:17.663364 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658866    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658869    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658873    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658876    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658879    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658881    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658884    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658886    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658889    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658891    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658894    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658896    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658899    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658901    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658904    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658906    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658910    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658913    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658916    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:17.664101 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658918    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658921    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658923    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658926    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658929    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658932    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658934    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658937    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658939    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658942    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658944    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658948    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658950    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658953    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658955    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658958    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658961    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:17.664576 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.658963    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.658969    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659071    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659076    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659079    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659082    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659085    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659088    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659090    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659093    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659096    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659098    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659101    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659111    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659114    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:53:17.665014 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659116    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659119    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659121    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659125    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659129    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659132    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659135    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659137    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659140    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659143    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659145    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659148    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659151    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659153    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659156    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659158    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659161    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659163    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659166    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659168    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:53:17.665384 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659171    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659173    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659176    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659178    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659181    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659183    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659186    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659189    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659191    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659194    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659196    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659199    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659201    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659204    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659206    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659209    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659212    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659214    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659217    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659219    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:53:17.666036 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659222    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659224    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659227    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659229    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659232    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659234    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659236    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659239    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659241    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659243    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659246    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659248    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659250    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659253    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659255    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659258    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659260    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659263    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659266    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:53:17.666520 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659268    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659271    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659273    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659275    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659278    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659280    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659283    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659285    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659288    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659291    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659293    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659297    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659301    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659303    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659306    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659309    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659312    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659314    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659317    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:53:17.667000 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659320    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659322    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659326    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659329    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659332    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659334    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659337    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:17.659339    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.659344    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.659476    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.665173    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.666999    2576 server.go:1019] "Starting client certificate rotation"
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.667098    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:53:17.667457 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.667132    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:53:17.669931 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.669916    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:53:17.671261 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.671240    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:53:17.682413 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.682391    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 07 17:53:17.685211 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.685197    2576 log.go:25] "Validated CRI v1 image API"
Jul 07 17:53:17.686046 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.686021    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 17:53:17.690992 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.690966    2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c0373e3a-86ee-4830-9129-0a32f8bc1ab3:/dev/nvme0n1p4 f6934fde-2c11-4140-9fc5-ab9ecb80ffb3:/dev/nvme0n1p3]
Jul 07 17:53:17.691064 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.690992    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 17:53:17.696354 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.696240    2576 manager.go:216] Machine: {Timestamp:2026-07-07 17:53:17.694778796 +0000 UTC m=+0.385869202 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099748 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2270c076e4fbc7ab662e07d29e154b SystemUUID:ec2270c0-76e4-fbc7-ab66-2e07d29e154b BootID:bbe24ec8-3e2c-4a08-86b0-4b3b673ce6d8 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:0f:db:1c:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:0f:db:1c:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:34:b1:f8:cf:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 17:53:17.696354 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.696343    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 17:53:17.696483 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.696433    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 17:53:17.699823 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.699777    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 17:53:17.699975 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.699834    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 17:53:17.700472 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.700456    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:53:17.700715 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.700701    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 17:53:17.700752 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.700720    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 17:53:17.700752 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.700728    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:53:17.700752 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.700742    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:53:17.702691 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.702679    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 17:53:17.707256 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707241    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:53:17.707398 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707383    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 17:53:17.707434 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707427    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 17:53:17.707466 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707440    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 17:53:17.707466 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707462    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 17:53:17.707520 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707477    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 07 17:53:17.707520 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707492    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 17:53:17.707973 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707961    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:53:17.708041 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.707981    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:53:17.712344 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.712322    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 17:53:17.714805 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.714789    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 17:53:17.714905 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.714837    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 17:53:17.716294 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716282    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716298    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716304    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716309    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716317    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716322    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716330    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716335    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716341    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 17:53:17.716343 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716347    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 17:53:17.716587 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716355    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 17:53:17.716587 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.716361    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 17:53:17.717216 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.717206    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 17:53:17.717216 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.717215    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 17:53:17.719956 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.719930    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 17:53:17.719956 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.719945    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 17:53:17.720099 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.719959    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 17:53:17.720420 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.720410    2576 server.go:1268] "Started kubelet"
Jul 07 17:53:17.720523 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.720493    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 17:53:17.720688 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.720493    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 17:53:17.720752 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.720715    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 17:53:17.721363 ip-10-0-133-54 systemd[1]: Started Kubernetes Kubelet.
Jul 07 17:53:17.722374 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.722283    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 17:53:17.723377 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.723354    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 17:53:17.727210 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.727180    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 17:53:17.730195 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.729064    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-54.ec2.internal.18c01369d5ee6ea5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-54.ec2.internal,UID:ip-10-0-133-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-54.ec2.internal,},FirstTimestamp:2026-07-07 17:53:17.720383141 +0000 UTC m=+0.411473524,LastTimestamp:2026-07-07 17:53:17.720383141 +0000 UTC m=+0.411473524,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-54.ec2.internal,}"
Jul 07 17:53:17.730490 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.730470    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 17:53:17.730582 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.730491    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 17:53:17.730642 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.730594    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:17.731555 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731311    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731556    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731570    2576 factory.go:55] Registering systemd factory
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731579    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731649    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731664    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731880    2576 factory.go:153] Registering CRI-O factory
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731893    2576 factory.go:223] Registration of the crio container factory successfully
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731894    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731908    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731918    2576 factory.go:103] Registering Raw factory
Jul 07 17:53:17.731993 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.731935    2576 manager.go:1196] Started watching for new ooms in manager
Jul 07 17:53:17.732486 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.732398    2576 manager.go:349] Starting recovery of all containers
Jul 07 17:53:17.735400 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.735367    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 17:53:17.735561 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.735534    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 17:53:17.745377 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.745358    2576 manager.go:354] Recovery completed
Jul 07 17:53:17.749752 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.749737    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:17.751602 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.751577    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:17.751664 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.751620    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:17.751664 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.751635    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:17.752229 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.752214    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 17:53:17.752229 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.752226    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 17:53:17.752229 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.752228    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:17.752382 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.752241    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:53:17.752915 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.752902    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:17.752958 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.752927    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:17.752958 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.752937    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:17.753960 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.753940    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-62rwn"
Jul 07 17:53:17.754516 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.754504    2576 policy_none.go:49] "None policy: Start"
Jul 07 17:53:17.754598 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.754520    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 17:53:17.754598 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.754533    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 17:53:17.755005 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.753839    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-54.ec2.internal.18c01369d7cacadd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-54.ec2.internal,UID:ip-10-0-133-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-54.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-54.ec2.internal,},FirstTimestamp:2026-07-07 17:53:17.751601885 +0000 UTC m=+0.442692276,LastTimestamp:2026-07-07 17:53:17.751601885 +0000 UTC m=+0.442692276,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-54.ec2.internal,}"
Jul 07 17:53:17.756550 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.756538    2576 policy_none.go:47] "Start"
Jul 07 17:53:17.759980 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.759964    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-62rwn"
Jul 07 17:53:17.765054 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.764987    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-54.ec2.internal.18c01369d7cb314d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-54.ec2.internal,UID:ip-10-0-133-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-54.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-54.ec2.internal,},FirstTimestamp:2026-07-07 17:53:17.751628109 +0000 UTC m=+0.442718494,LastTimestamp:2026-07-07 17:53:17.751628109 +0000 UTC m=+0.442718494,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-54.ec2.internal,}"
Jul 07 17:53:17.792499 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.792477    2576 manager.go:337] "Starting Device Plugin manager"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.792632    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.792645    2576 server.go:87] "Starting device plugin registration server"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.792933    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.792944    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.793031    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.793144    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.793152    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.793726    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.793773    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.799517    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.800788    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.800851    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.800879    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.800915    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 17:53:17.810779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.803365    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:17.893653 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.893552    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:17.894601 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.894584    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:17.894677 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.894617    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:17.894677 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.894630    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:17.894677 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.894660    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.901934 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.901917    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.901996 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.901929    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal"]
Jul 07 17:53:17.901996 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.901946    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-54.ec2.internal\": node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:17.901996 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.901995    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:17.903508 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.903491    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:17.903571 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.903520    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:17.903571 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.903530    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:17.905961 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.905939    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:17.906056 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.906003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.906056 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.906037    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:17.906922 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.906888    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:17.907039 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.906927    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:17.907039 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.906926    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:17.907039 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.906961    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:17.907039 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.906975    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:17.907039 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.906942    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:17.909335 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.909319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.909412 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.909372    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:53:17.910026 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.910010    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:53:17.910093 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.910036    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:53:17.910093 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.910055    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:53:17.931794 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.931769    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-54.ec2.internal\" not found" node="ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.932567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.932541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3e387bde16a8e7cbd0c4901e28f5556-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal\" (UID: \"b3e387bde16a8e7cbd0c4901e28f5556\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.932656 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.932576    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8dc84e52c4b49cddad14a3e8e44364d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-54.ec2.internal\" (UID: \"8dc84e52c4b49cddad14a3e8e44364d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.932656 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:17.932601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3e387bde16a8e7cbd0c4901e28f5556-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal\" (UID: \"b3e387bde16a8e7cbd0c4901e28f5556\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:17.933712 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.933692    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:17.936697 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:17.936680    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-54.ec2.internal\" not found" node="ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.033290 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.033248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3e387bde16a8e7cbd0c4901e28f5556-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal\" (UID: \"b3e387bde16a8e7cbd0c4901e28f5556\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.033290 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.033281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3e387bde16a8e7cbd0c4901e28f5556-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal\" (UID: \"b3e387bde16a8e7cbd0c4901e28f5556\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.033290 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.033298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8dc84e52c4b49cddad14a3e8e44364d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-54.ec2.internal\" (UID: \"8dc84e52c4b49cddad14a3e8e44364d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.033550 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.033337    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3e387bde16a8e7cbd0c4901e28f5556-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal\" (UID: \"b3e387bde16a8e7cbd0c4901e28f5556\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.033550 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.033346    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b3e387bde16a8e7cbd0c4901e28f5556-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal\" (UID: \"b3e387bde16a8e7cbd0c4901e28f5556\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.033550 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.033373    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8dc84e52c4b49cddad14a3e8e44364d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-54.ec2.internal\" (UID: \"8dc84e52c4b49cddad14a3e8e44364d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.034292 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:18.034274    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:18.134405 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:18.134362    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:18.235118 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:18.235052    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:18.236169 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.236147    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.240358 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.240338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.335661 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:18.335624    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:18.436118 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:18.436082    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:18.536653 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:18.536562    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:18.636998 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:18.636965    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:18.646923 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.646898    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:18.666094 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.666064    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 17:53:18.666224 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.666205    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:53:18.666275 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.666250    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:53:18.737045 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:18.737016    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-54.ec2.internal\" not found"
Jul 07 17:53:18.742585 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.742559    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:18.767158 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.766935    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:48:18 +0000 UTC" deadline="2028-01-11 08:33:16.309812506 +0000 UTC"
Jul 07 17:53:18.767158 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.767157    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13262h39m57.542668438s"
Jul 07 17:53:18.830803 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.830738    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.841622 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.841597    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:53:18.843534 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.843519    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal"
Jul 07 17:53:18.858138 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.858119    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:53:18.885912 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:18.885871    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc84e52c4b49cddad14a3e8e44364d9.slice/crio-50bc03f1bad95b488bb87d627c5fdce0c17b70ea9971093c93de9ee618d36f48 WatchSource:0}: Error finding container 50bc03f1bad95b488bb87d627c5fdce0c17b70ea9971093c93de9ee618d36f48: Status 404 returned error can't find the container with id 50bc03f1bad95b488bb87d627c5fdce0c17b70ea9971093c93de9ee618d36f48
Jul 07 17:53:18.886436 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:18.886418    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e387bde16a8e7cbd0c4901e28f5556.slice/crio-32b0114ba0082da74465df802b73e01e4b3a1a4e493519b3c743b2efe0d39916 WatchSource:0}: Error finding container 32b0114ba0082da74465df802b73e01e4b3a1a4e493519b3c743b2efe0d39916: Status 404 returned error can't find the container with id 32b0114ba0082da74465df802b73e01e4b3a1a4e493519b3c743b2efe0d39916
Jul 07 17:53:18.890508 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:18.890490    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:53:20.356746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.356708    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:20.786205 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.786175    2576 apiserver.go:52] "Watching apiserver"
Jul 07 17:53:20.796504 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.796474    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 17:53:20.797338 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.796936    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd","openshift-cluster-node-tuning-operator/tuned-2vgx7","openshift-dns/node-resolver-xkjn4","openshift-network-operator/iptables-alerter-c8586","kube-system/konnectivity-agent-v9vgv","openshift-image-registry/node-ca-fr5qf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal","openshift-multus/multus-additional-cni-plugins-tttdx","openshift-multus/multus-kp2sz","openshift-multus/network-metrics-daemon-rlj2h","openshift-network-diagnostics/network-check-target-whsl6","openshift-ovn-kubernetes/ovnkube-node-pjgzp","kube-system/global-pull-secret-syncer-nr6d5"]
Jul 07 17:53:20.799762 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.799536    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:20.801928 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.801904    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.802875 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.802544    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fc7vc\""
Jul 07 17:53:20.802875 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.802629    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 17:53:20.802875 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.802734    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 17:53:20.804066 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.804048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.806950 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.806930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.808245 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.807848    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 17:53:20.808245 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.807901    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s4nws\""
Jul 07 17:53:20.808245 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.807849    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 17:53:20.808245 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.808063    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 17:53:20.808245 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.808052    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 17:53:20.808245 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.808086    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 17:53:20.808245 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.808250    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 17:53:20.808591 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.808274    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 17:53:20.808591 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.808312    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 17:53:20.809433 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.809142    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 17:53:20.809433 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.809189    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 17:53:20.809566 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.809535    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mqnbb\""
Jul 07 17:53:20.811867 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.809684    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 17:53:20.811867 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.809704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.811867 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.810043    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w9xtm\""
Jul 07 17:53:20.811867 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.810740    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 17:53:20.813593 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.813049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.813593 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.813451    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:53:20.813593 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.813506    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2h5cl\""
Jul 07 17:53:20.813593 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.813571    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 17:53:20.813852 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.813840    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 17:53:20.815450 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.815434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.816001 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.815980    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:53:20.816078 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.816021    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 17:53:20.816133 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.816085    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6n48n\""
Jul 07 17:53:20.817789 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.817773    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.818969 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.818950    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 17:53:20.819105 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819060    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 17:53:20.819201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819176    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 17:53:20.819482 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g5gd2\""
Jul 07 17:53:20.819744 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bm77\" (UniqueName: \"kubernetes.io/projected/10e91e04-35db-47b7-af63-57ecc01537c3-kube-api-access-7bm77\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.819792 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5732089-a012-4d96-91fc-90053a40cf53-host-slash\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.819792 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-host\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.819863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41fc40ad-0e0a-4c64-acf7-b8367e3d9db7-konnectivity-ca\") pod \"konnectivity-agent-v9vgv\" (UID: \"41fc40ad-0e0a-4c64-acf7-b8367e3d9db7\") " pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:20.819863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-log-socket\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.819863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovnkube-config\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.819961 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5dc7ae3-702f-4a3c-b906-0793fba272ec-serviceca\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.819961 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqsvz\" (UniqueName: \"kubernetes.io/projected/d5dc7ae3-702f-4a3c-b906-0793fba272ec-kube-api-access-vqsvz\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.819961 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-tuned\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.819961 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8cq2\" (UniqueName: \"kubernetes.io/projected/b617b886-d788-4271-b3dd-8ce0b0d673ff-kube-api-access-h8cq2\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820099 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.819969    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-var-lib-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820099 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-etc-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820099 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e91e04-35db-47b7-af63-57ecc01537c3-tmp-dir\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.820099 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-lib-modules\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820099 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-systemd-units\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-cni-bin\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10e91e04-35db-47b7-af63-57ecc01537c3-hosts-file\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.820328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-modprobe-d\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysconfig\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-node-log\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-cni-netd\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-kubernetes\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysctl-d\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-sys\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-ovn\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41fc40ad-0e0a-4c64-acf7-b8367e3d9db7-agent-certs\") pod \"konnectivity-agent-v9vgv\" (UID: \"41fc40ad-0e0a-4c64-acf7-b8367e3d9db7\") " pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-run-netns\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysctl-conf\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-run\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-var-lib-kubelet\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovn-node-metrics-cert\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovnkube-script-lib\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2swp\" (UniqueName: \"kubernetes.io/projected/b42d2886-78d4-4c45-b6b1-f997e600ba31-kube-api-access-n2swp\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5732089-a012-4d96-91fc-90053a40cf53-iptables-alerter-script\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-systemd\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-kubelet\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzpcv\" (UniqueName: \"kubernetes.io/projected/a5732089-a012-4d96-91fc-90053a40cf53-kube-api-access-xzpcv\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b617b886-d788-4271-b3dd-8ce0b0d673ff-tmp\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-slash\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-systemd\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-env-overrides\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.821172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.820943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5dc7ae3-702f-4a3c-b906-0793fba272ec-host\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.821498 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.821430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:20.821545 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:20.821503    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:20.821976 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.821954    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 17:53:20.822105 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.822087    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 17:53:20.822223 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.822203    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xzw7f\""
Jul 07 17:53:20.822326 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.822307    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 17:53:20.823417 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.823267    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:20.823417 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:20.823374    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:20.825484 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.825465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:20.828164 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.828145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:20.828242 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:20.828219    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:20.829054 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.829020    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 17:53:20.829881 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.829330    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wr82l\""
Jul 07 17:53:20.829881 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.829673    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 17:53:20.829881 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.829708    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 17:53:20.832362 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.832326    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:53:20.851431 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.851408    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fchqx"
Jul 07 17:53:20.859838 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.859810    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fchqx"
Jul 07 17:53:20.885603 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.885514    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal" event={"ID":"b3e387bde16a8e7cbd0c4901e28f5556","Type":"ContainerStarted","Data":"32b0114ba0082da74465df802b73e01e4b3a1a4e493519b3c743b2efe0d39916"}
Jul 07 17:53:20.887661 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.887631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal" event={"ID":"8dc84e52c4b49cddad14a3e8e44364d9","Type":"ContainerStarted","Data":"50bc03f1bad95b488bb87d627c5fdce0c17b70ea9971093c93de9ee618d36f48"}
Jul 07 17:53:20.911279 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.911238    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 17:53:20.921125 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-systemd\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.921125 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-device-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b617b886-d788-4271-b3dd-8ce0b0d673ff-tmp\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-conf-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921230    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-systemd\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzgr9\" (UniqueName: \"kubernetes.io/projected/d6d62277-b8c9-404c-9cb5-c1063369def4-kube-api-access-gzgr9\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921288    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-sys-fs\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-slash\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.921376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-host\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-system-cni-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/451479c6-8617-4573-8043-00f8e2ea11e1-dbus\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-slash\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-log-socket\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovnkube-config\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921491    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5dc7ae3-702f-4a3c-b906-0793fba272ec-serviceca\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921497    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-host\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-var-lib-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-etc-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921543    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-log-socket\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e91e04-35db-47b7-af63-57ecc01537c3-tmp-dir\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921592    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-etc-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921607    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-cni-bin\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-modprobe-d\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysctl-d\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-netns\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.922065 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-socket-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-node-log\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-kubernetes\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921816    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-sys\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-os-release\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/451479c6-8617-4573-8043-00f8e2ea11e1-kubelet-config\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-ovn\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.921971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41fc40ad-0e0a-4c64-acf7-b8367e3d9db7-agent-certs\") pod \"konnectivity-agent-v9vgv\" (UID: \"41fc40ad-0e0a-4c64-acf7-b8367e3d9db7\") " pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysctl-conf\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-cni-bin\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovn-node-metrics-cert\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovnkube-script-lib\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922116    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-socket-dir-parent\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922174    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovnkube-config\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.922938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922195    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-sys\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-var-lib-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-os-release\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922279    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-openvswitch\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922285    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysctl-conf\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922295    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-modprobe-d\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922319    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-kubelet\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922414    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysctl-d\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-kubelet\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922520    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-node-log\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-kubernetes\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzpcv\" (UniqueName: \"kubernetes.io/projected/a5732089-a012-4d96-91fc-90053a40cf53-kube-api-access-xzpcv\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922607    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5dc7ae3-702f-4a3c-b906-0793fba272ec-serviceca\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-cni-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-hostroot\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922649    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10e91e04-35db-47b7-af63-57ecc01537c3-tmp-dir\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922691    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-cni-bin\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.923726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922652    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-ovn\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-system-cni-dir\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-systemd\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-env-overrides\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5dc7ae3-702f-4a3c-b906-0793fba272ec-host\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bm77\" (UniqueName: \"kubernetes.io/projected/10e91e04-35db-47b7-af63-57ecc01537c3-kube-api-access-7bm77\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5732089-a012-4d96-91fc-90053a40cf53-host-slash\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922883    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovnkube-script-lib\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-tuned\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-run-systemd\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8cq2\" (UniqueName: \"kubernetes.io/projected/b617b886-d788-4271-b3dd-8ce0b0d673ff-kube-api-access-h8cq2\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922972    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5732089-a012-4d96-91fc-90053a40cf53-host-slash\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.922977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41fc40ad-0e0a-4c64-acf7-b8367e3d9db7-konnectivity-ca\") pod \"konnectivity-agent-v9vgv\" (UID: \"41fc40ad-0e0a-4c64-acf7-b8367e3d9db7\") " pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923004    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqsvz\" (UniqueName: \"kubernetes.io/projected/d5dc7ae3-702f-4a3c-b906-0793fba272ec-kube-api-access-vqsvz\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-cnibin\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.924543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-k8s-cni-cncf-io\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz2qv\" (UniqueName: \"kubernetes.io/projected/846d5a7d-2747-4366-9a12-e6ddd997edb5-kube-api-access-wz2qv\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pjtx\" (UniqueName: \"kubernetes.io/projected/3b76b241-db14-44e7-8071-04a8ec370c74-kube-api-access-9pjtx\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-cnibin\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923326    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5dc7ae3-702f-4a3c-b906-0793fba272ec-host\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-lib-modules\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-kubelet\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923588    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-lib-modules\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923591    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b42d2886-78d4-4c45-b6b1-f997e600ba31-env-overrides\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-systemd-units\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10e91e04-35db-47b7-af63-57ecc01537c3-hosts-file\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923750    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-systemd-units\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysconfig\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-daemon-config\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10e91e04-35db-47b7-af63-57ecc01537c3-hosts-file\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.925175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923880    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-sysconfig\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-multus-certs\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-registration-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.923979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-cni-netd\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924022    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-cni-netd\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41fc40ad-0e0a-4c64-acf7-b8367e3d9db7-konnectivity-ca\") pod \"konnectivity-agent-v9vgv\" (UID: \"41fc40ad-0e0a-4c64-acf7-b8367e3d9db7\") " pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-cni-multus\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924091    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck2qw\" (UniqueName: \"kubernetes.io/projected/665d98cc-dc33-4c35-a712-665933ffd9f7-kube-api-access-ck2qw\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-run-netns\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-run\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-var-lib-kubelet\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6d62277-b8c9-404c-9cb5-c1063369def4-cni-binary-copy\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924286    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b42d2886-78d4-4c45-b6b1-f997e600ba31-host-run-netns\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924291    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-run\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.925967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-etc-kubernetes\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:20.926755 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b617b886-d788-4271-b3dd-8ce0b0d673ff-var-lib-kubelet\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.926755 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2swp\" (UniqueName: \"kubernetes.io/projected/b42d2886-78d4-4c45-b6b1-f997e600ba31-kube-api-access-n2swp\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.926755 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.924459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5732089-a012-4d96-91fc-90053a40cf53-iptables-alerter-script\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.926755 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.925015    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a5732089-a012-4d96-91fc-90053a40cf53-iptables-alerter-script\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.926755 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.926008    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b42d2886-78d4-4c45-b6b1-f997e600ba31-ovn-node-metrics-cert\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.927658 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.927638    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b617b886-d788-4271-b3dd-8ce0b0d673ff-etc-tuned\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.927795 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.927662    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41fc40ad-0e0a-4c64-acf7-b8367e3d9db7-agent-certs\") pod \"konnectivity-agent-v9vgv\" (UID: \"41fc40ad-0e0a-4c64-acf7-b8367e3d9db7\") " pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:20.928459 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.928434    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b617b886-d788-4271-b3dd-8ce0b0d673ff-tmp\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:20.936493 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.936464    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bm77\" (UniqueName: \"kubernetes.io/projected/10e91e04-35db-47b7-af63-57ecc01537c3-kube-api-access-7bm77\") pod \"node-resolver-xkjn4\" (UID: \"10e91e04-35db-47b7-af63-57ecc01537c3\") " pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:20.937254 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.937227    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqsvz\" (UniqueName: \"kubernetes.io/projected/d5dc7ae3-702f-4a3c-b906-0793fba272ec-kube-api-access-vqsvz\") pod \"node-ca-fr5qf\" (UID: \"d5dc7ae3-702f-4a3c-b906-0793fba272ec\") " pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:20.938098 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.938078    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2swp\" (UniqueName: \"kubernetes.io/projected/b42d2886-78d4-4c45-b6b1-f997e600ba31-kube-api-access-n2swp\") pod \"ovnkube-node-pjgzp\" (UID: \"b42d2886-78d4-4c45-b6b1-f997e600ba31\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:20.940100 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.940072    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzpcv\" (UniqueName: \"kubernetes.io/projected/a5732089-a012-4d96-91fc-90053a40cf53-kube-api-access-xzpcv\") pod \"iptables-alerter-c8586\" (UID: \"a5732089-a012-4d96-91fc-90053a40cf53\") " pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:20.941284 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:20.941252    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8cq2\" (UniqueName: \"kubernetes.io/projected/b617b886-d788-4271-b3dd-8ce0b0d673ff-kube-api-access-h8cq2\") pod \"tuned-2vgx7\" (UID: \"b617b886-d788-4271-b3dd-8ce0b0d673ff\") " pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-netns\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-socket-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-os-release\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/451479c6-8617-4573-8043-00f8e2ea11e1-kubelet-config\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-cni-bin\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025809    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-netns\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-socket-dir-parent\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-os-release\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025916    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-os-release\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-cni-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-hostroot\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.025986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-system-cni-dir\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-cnibin\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027061 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-k8s-cni-cncf-io\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz2qv\" (UniqueName: \"kubernetes.io/projected/846d5a7d-2747-4366-9a12-e6ddd997edb5-kube-api-access-wz2qv\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pjtx\" (UniqueName: \"kubernetes.io/projected/3b76b241-db14-44e7-8071-04a8ec370c74-kube-api-access-9pjtx\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026143    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/451479c6-8617-4573-8043-00f8e2ea11e1-kubelet-config\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-cnibin\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026149    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026204    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-socket-dir-parent\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026209    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-cni-bin\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-kubelet\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026258    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-system-cni-dir\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026228    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-k8s-cni-cncf-io\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-daemon-config\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-multus-certs\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-registration-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.026447    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026471    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-cni-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.027913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026479    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-cni-multus\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026502    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-cnibin\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026505    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-hostroot\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.026530    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret podName:451479c6-8617-4573-8043-00f8e2ea11e1 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:21.526509527 +0000 UTC m=+3.140068232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret") pod "global-pull-secret-syncer-nr6d5" (UID: "451479c6-8617-4573-8043-00f8e2ea11e1") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-cni-multus\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026558    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-cnibin\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026561    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-os-release\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026530    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-run-multus-certs\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-host-var-lib-kubelet\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026626    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026694    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-registration-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026734    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026749    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-socket-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck2qw\" (UniqueName: \"kubernetes.io/projected/665d98cc-dc33-4c35-a712-665933ffd9f7-kube-api-access-ck2qw\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6d62277-b8c9-404c-9cb5-c1063369def4-cni-binary-copy\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.028746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.026889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-etc-kubernetes\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027032    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027035    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-etc-kubernetes\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027088    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-daemon-config\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027106    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-device-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027080    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/665d98cc-dc33-4c35-a712-665933ffd9f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-device-dir\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-conf-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzgr9\" (UniqueName: \"kubernetes.io/projected/d6d62277-b8c9-404c-9cb5-c1063369def4-kube-api-access-gzgr9\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027240    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-sys-fs\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027239    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-multus-conf-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-system-cni-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/451479c6-8617-4573-8043-00f8e2ea11e1-dbus\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027306    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b76b241-db14-44e7-8071-04a8ec370c74-sys-fs\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.029305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027325    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/665d98cc-dc33-4c35-a712-665933ffd9f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.030005 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027377    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6d62277-b8c9-404c-9cb5-c1063369def4-cni-binary-copy\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.030005 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027383    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d62277-b8c9-404c-9cb5-c1063369def4-system-cni-dir\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.030005 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.027402    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:21.030005 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.027418    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/451479c6-8617-4573-8043-00f8e2ea11e1-dbus\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:21.030005 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.027458    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs podName:846d5a7d-2747-4366-9a12-e6ddd997edb5 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:21.527443563 +0000 UTC m=+3.141002245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs") pod "network-metrics-daemon-rlj2h" (UID: "846d5a7d-2747-4366-9a12-e6ddd997edb5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:21.036918 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.036849    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:21.036918 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.036876    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:21.036918 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.036890    2576 projected.go:196] Error preparing data for projected volume kube-api-access-x7xzf for pod openshift-network-diagnostics/network-check-target-whsl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:21.037133 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.036962    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf podName:674f7627-419e-4a1c-b219-a0f11798a498 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:21.536945508 +0000 UTC m=+3.150504194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x7xzf" (UniqueName: "kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf") pod "network-check-target-whsl6" (UID: "674f7627-419e-4a1c-b219-a0f11798a498") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:21.039117 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.039089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pjtx\" (UniqueName: \"kubernetes.io/projected/3b76b241-db14-44e7-8071-04a8ec370c74-kube-api-access-9pjtx\") pod \"aws-ebs-csi-driver-node-tbfsd\" (UID: \"3b76b241-db14-44e7-8071-04a8ec370c74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.039937 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.039659    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck2qw\" (UniqueName: \"kubernetes.io/projected/665d98cc-dc33-4c35-a712-665933ffd9f7-kube-api-access-ck2qw\") pod \"multus-additional-cni-plugins-tttdx\" (UID: \"665d98cc-dc33-4c35-a712-665933ffd9f7\") " pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.040221 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.040201    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzgr9\" (UniqueName: \"kubernetes.io/projected/d6d62277-b8c9-404c-9cb5-c1063369def4-kube-api-access-gzgr9\") pod \"multus-kp2sz\" (UID: \"d6d62277-b8c9-404c-9cb5-c1063369def4\") " pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.041250 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.041230    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz2qv\" (UniqueName: \"kubernetes.io/projected/846d5a7d-2747-4366-9a12-e6ddd997edb5-kube-api-access-wz2qv\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:21.113059 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.113021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:21.119704 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.119676    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:21.124498 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.124465    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fc40ad_0e0a_4c64_acf7_b8367e3d9db7.slice/crio-cea8b436f449f7bd67eb91a5806d9ea6c3a6cd1dcaf6176f83fa9c2e2f947842 WatchSource:0}: Error finding container cea8b436f449f7bd67eb91a5806d9ea6c3a6cd1dcaf6176f83fa9c2e2f947842: Status 404 returned error can't find the container with id cea8b436f449f7bd67eb91a5806d9ea6c3a6cd1dcaf6176f83fa9c2e2f947842
Jul 07 17:53:21.129705 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.129677    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42d2886_78d4_4c45_b6b1_f997e600ba31.slice/crio-b911e93436e83deb2a39b2dc9d6e59450806bbd8d91e00d9705ff223dd0776b0 WatchSource:0}: Error finding container b911e93436e83deb2a39b2dc9d6e59450806bbd8d91e00d9705ff223dd0776b0: Status 404 returned error can't find the container with id b911e93436e83deb2a39b2dc9d6e59450806bbd8d91e00d9705ff223dd0776b0
Jul 07 17:53:21.131393 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.131364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2vgx7"
Jul 07 17:53:21.137066 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.137042    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fr5qf"
Jul 07 17:53:21.141890 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.141862    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb617b886_d788_4271_b3dd_8ce0b0d673ff.slice/crio-2fdf0fbc7df7e097ec606e1fcbcb9c33dd7d57d9eb0029cf39e82ed6a1ed060b WatchSource:0}: Error finding container 2fdf0fbc7df7e097ec606e1fcbcb9c33dd7d57d9eb0029cf39e82ed6a1ed060b: Status 404 returned error can't find the container with id 2fdf0fbc7df7e097ec606e1fcbcb9c33dd7d57d9eb0029cf39e82ed6a1ed060b
Jul 07 17:53:21.142522 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.142502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xkjn4"
Jul 07 17:53:21.147809 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.147779    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5dc7ae3_702f_4a3c_b906_0793fba272ec.slice/crio-c9ca8b57467fc44d8c23bfbd1fcad33b1e5db9ba8f0edfc2917a81a9de453cf3 WatchSource:0}: Error finding container c9ca8b57467fc44d8c23bfbd1fcad33b1e5db9ba8f0edfc2917a81a9de453cf3: Status 404 returned error can't find the container with id c9ca8b57467fc44d8c23bfbd1fcad33b1e5db9ba8f0edfc2917a81a9de453cf3
Jul 07 17:53:21.151510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.151490    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8586"
Jul 07 17:53:21.152669 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.152625    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e91e04_35db_47b7_af63_57ecc01537c3.slice/crio-3e86587072ecf9750baa7e41b3ba243b8ad67bb0f8d9d3e3b71953ee10661b71 WatchSource:0}: Error finding container 3e86587072ecf9750baa7e41b3ba243b8ad67bb0f8d9d3e3b71953ee10661b71: Status 404 returned error can't find the container with id 3e86587072ecf9750baa7e41b3ba243b8ad67bb0f8d9d3e3b71953ee10661b71
Jul 07 17:53:21.158494 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.158475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tttdx"
Jul 07 17:53:21.160519 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.160498    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5732089_a012_4d96_91fc_90053a40cf53.slice/crio-0bbdbfbdfa871224c8ecdb8c3034dbffe24e81dc9ec912347f554344e649338e WatchSource:0}: Error finding container 0bbdbfbdfa871224c8ecdb8c3034dbffe24e81dc9ec912347f554344e649338e: Status 404 returned error can't find the container with id 0bbdbfbdfa871224c8ecdb8c3034dbffe24e81dc9ec912347f554344e649338e
Jul 07 17:53:21.166175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.166154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kp2sz"
Jul 07 17:53:21.166740 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.166718    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665d98cc_dc33_4c35_a712_665933ffd9f7.slice/crio-cd00b31b9b3d26f680ec5f50158fe293215cd4698a62ea4daa60c14183104f1b WatchSource:0}: Error finding container cd00b31b9b3d26f680ec5f50158fe293215cd4698a62ea4daa60c14183104f1b: Status 404 returned error can't find the container with id cd00b31b9b3d26f680ec5f50158fe293215cd4698a62ea4daa60c14183104f1b
Jul 07 17:53:21.170849 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.170831    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd"
Jul 07 17:53:21.176207 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.176187    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d62277_b8c9_404c_9cb5_c1063369def4.slice/crio-54a8dece0517f5c15d76e919fc453b96fb73b70ee393ee67da1d02c5a38a1d3f WatchSource:0}: Error finding container 54a8dece0517f5c15d76e919fc453b96fb73b70ee393ee67da1d02c5a38a1d3f: Status 404 returned error can't find the container with id 54a8dece0517f5c15d76e919fc453b96fb73b70ee393ee67da1d02c5a38a1d3f
Jul 07 17:53:21.181010 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:21.180945    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b76b241_db14_44e7_8071_04a8ec370c74.slice/crio-0999b5a9795e6d3b1ce859053c49ad13857a5491941a559a6b6e49a4d9057071 WatchSource:0}: Error finding container 0999b5a9795e6d3b1ce859053c49ad13857a5491941a559a6b6e49a4d9057071: Status 404 returned error can't find the container with id 0999b5a9795e6d3b1ce859053c49ad13857a5491941a559a6b6e49a4d9057071
Jul 07 17:53:21.253526 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.253492    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:21.531893 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.531767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:21.531893 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.531878    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:21.532115 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.531936    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:21.532115 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.531998    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:21.532115 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.532006    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret podName:451479c6-8617-4573-8043-00f8e2ea11e1 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:22.531990051 +0000 UTC m=+4.145548736 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret") pod "global-pull-secret-syncer-nr6d5" (UID: "451479c6-8617-4573-8043-00f8e2ea11e1") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:21.532115 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.532049    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs podName:846d5a7d-2747-4366-9a12-e6ddd997edb5 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:22.532033688 +0000 UTC m=+4.145592370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs") pod "network-metrics-daemon-rlj2h" (UID: "846d5a7d-2747-4366-9a12-e6ddd997edb5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:21.632954 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.632919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:21.633163 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.633135    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:21.633248 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.633165    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:21.633248 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.633179    2576 projected.go:196] Error preparing data for projected volume kube-api-access-x7xzf for pod openshift-network-diagnostics/network-check-target-whsl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:21.633248 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:21.633240    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf podName:674f7627-419e-4a1c-b219-a0f11798a498 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:22.633225949 +0000 UTC m=+4.246784631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x7xzf" (UniqueName: "kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf") pod "network-check-target-whsl6" (UID: "674f7627-419e-4a1c-b219-a0f11798a498") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:21.863411 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.863262    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:48:20 +0000 UTC" deadline="2028-01-27 20:10:59.364674529 +0000 UTC"
Jul 07 17:53:21.863411 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.863327    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13658h17m37.501352481s"
Jul 07 17:53:21.890714 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.890672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kp2sz" event={"ID":"d6d62277-b8c9-404c-9cb5-c1063369def4","Type":"ContainerStarted","Data":"54a8dece0517f5c15d76e919fc453b96fb73b70ee393ee67da1d02c5a38a1d3f"}
Jul 07 17:53:21.892132 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.892096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8586" event={"ID":"a5732089-a012-4d96-91fc-90053a40cf53","Type":"ContainerStarted","Data":"0bbdbfbdfa871224c8ecdb8c3034dbffe24e81dc9ec912347f554344e649338e"}
Jul 07 17:53:21.893327 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.893298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xkjn4" event={"ID":"10e91e04-35db-47b7-af63-57ecc01537c3","Type":"ContainerStarted","Data":"3e86587072ecf9750baa7e41b3ba243b8ad67bb0f8d9d3e3b71953ee10661b71"}
Jul 07 17:53:21.894841 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.894811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"b911e93436e83deb2a39b2dc9d6e59450806bbd8d91e00d9705ff223dd0776b0"}
Jul 07 17:53:21.895974 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.895951    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v9vgv" event={"ID":"41fc40ad-0e0a-4c64-acf7-b8367e3d9db7","Type":"ContainerStarted","Data":"cea8b436f449f7bd67eb91a5806d9ea6c3a6cd1dcaf6176f83fa9c2e2f947842"}
Jul 07 17:53:21.897823 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.897794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd" event={"ID":"3b76b241-db14-44e7-8071-04a8ec370c74","Type":"ContainerStarted","Data":"0999b5a9795e6d3b1ce859053c49ad13857a5491941a559a6b6e49a4d9057071"}
Jul 07 17:53:21.899043 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.899019    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tttdx" event={"ID":"665d98cc-dc33-4c35-a712-665933ffd9f7","Type":"ContainerStarted","Data":"cd00b31b9b3d26f680ec5f50158fe293215cd4698a62ea4daa60c14183104f1b"}
Jul 07 17:53:21.900319 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.900293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fr5qf" event={"ID":"d5dc7ae3-702f-4a3c-b906-0793fba272ec","Type":"ContainerStarted","Data":"c9ca8b57467fc44d8c23bfbd1fcad33b1e5db9ba8f0edfc2917a81a9de453cf3"}
Jul 07 17:53:21.901551 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:21.901530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2vgx7" event={"ID":"b617b886-d788-4271-b3dd-8ce0b0d673ff","Type":"ContainerStarted","Data":"2fdf0fbc7df7e097ec606e1fcbcb9c33dd7d57d9eb0029cf39e82ed6a1ed060b"}
Jul 07 17:53:22.220608 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.220530    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:53:22.540802 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.540778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:22.540908 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.540826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:22.540974 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.540945    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:22.541021 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.540988    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs podName:846d5a7d-2747-4366-9a12-e6ddd997edb5 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:24.540975969 +0000 UTC m=+6.154534650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs") pod "network-metrics-daemon-rlj2h" (UID: "846d5a7d-2747-4366-9a12-e6ddd997edb5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:22.541075 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.541036    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:22.541075 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.541062    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret podName:451479c6-8617-4573-8043-00f8e2ea11e1 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:24.541054436 +0000 UTC m=+6.154613118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret") pod "global-pull-secret-syncer-nr6d5" (UID: "451479c6-8617-4573-8043-00f8e2ea11e1") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:22.641519 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.641373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:22.642113 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.641912    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:22.642113 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.641940    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:22.642113 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.641954    2576 projected.go:196] Error preparing data for projected volume kube-api-access-x7xzf for pod openshift-network-diagnostics/network-check-target-whsl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:22.642113 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.642012    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf podName:674f7627-419e-4a1c-b219-a0f11798a498 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:24.641994698 +0000 UTC m=+6.255553383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x7xzf" (UniqueName: "kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf") pod "network-check-target-whsl6" (UID: "674f7627-419e-4a1c-b219-a0f11798a498") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:22.864655 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.864509    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:48:20 +0000 UTC" deadline="2028-04-02 04:12:33.529750606 +0000 UTC"
Jul 07 17:53:22.864655 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.864548    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15226h19m10.665207647s"
Jul 07 17:53:22.882134 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.879531    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:22.882134 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.879668    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:22.882134 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.880478    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:22.882134 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.880584    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:22.882134 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.880663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:22.882134 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:22.880741    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:22.912189 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:22.912140    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal" event={"ID":"8dc84e52c4b49cddad14a3e8e44364d9","Type":"ContainerStarted","Data":"29a18d80037cbc748920eae459dbb6c1446f8de974e3f2441bb18d3e33d6d344"}
Jul 07 17:53:23.929923 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:23.929880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal" event={"ID":"b3e387bde16a8e7cbd0c4901e28f5556","Type":"ContainerStarted","Data":"4b1708a34fceb7e50647c5e72e3dadc5edb29f3fad4a1c45d2e419da172755ab"}
Jul 07 17:53:23.954696 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:23.954196    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-54.ec2.internal" podStartSLOduration=4.954175231 podStartE2EDuration="4.954175231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:22.932777243 +0000 UTC m=+4.546335925" watchObservedRunningTime="2026-07-07 17:53:23.954175231 +0000 UTC m=+5.567733936"
Jul 07 17:53:24.560607 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:24.560567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:24.560800 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:24.560656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:24.560866 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.560825    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:24.560957 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.560937    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret podName:451479c6-8617-4573-8043-00f8e2ea11e1 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:28.560869195 +0000 UTC m=+10.174427877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret") pod "global-pull-secret-syncer-nr6d5" (UID: "451479c6-8617-4573-8043-00f8e2ea11e1") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:24.561550 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.561530    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:24.561656 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.561594    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs podName:846d5a7d-2747-4366-9a12-e6ddd997edb5 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:28.561578569 +0000 UTC m=+10.175137254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs") pod "network-metrics-daemon-rlj2h" (UID: "846d5a7d-2747-4366-9a12-e6ddd997edb5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:24.662432 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:24.661770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:24.662432 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.661982    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:24.662432 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.662002    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:24.662432 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.662016    2576 projected.go:196] Error preparing data for projected volume kube-api-access-x7xzf for pod openshift-network-diagnostics/network-check-target-whsl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:24.662432 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.662076    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf podName:674f7627-419e-4a1c-b219-a0f11798a498 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:28.662058202 +0000 UTC m=+10.275616907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x7xzf" (UniqueName: "kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf") pod "network-check-target-whsl6" (UID: "674f7627-419e-4a1c-b219-a0f11798a498") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:24.880276 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:24.879482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:24.880276 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.879636    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:24.880276 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:24.879988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:24.880276 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.880071    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:24.880276 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:24.880134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:24.880276 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:24.880201    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:26.880561 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:26.880526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:26.881013 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:26.880635    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:26.881142 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:26.881116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:26.881267 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:26.881212    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:26.881267 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:26.881261    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:26.881414 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:26.881325    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:28.595581 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:28.595265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:28.595581 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:28.595367    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:28.595581 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.595461    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:28.595581 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.595479    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:28.595581 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.595537    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret podName:451479c6-8617-4573-8043-00f8e2ea11e1 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:36.595518872 +0000 UTC m=+18.209077556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret") pod "global-pull-secret-syncer-nr6d5" (UID: "451479c6-8617-4573-8043-00f8e2ea11e1") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:28.595581 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.595557    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs podName:846d5a7d-2747-4366-9a12-e6ddd997edb5 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:36.595547211 +0000 UTC m=+18.209105900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs") pod "network-metrics-daemon-rlj2h" (UID: "846d5a7d-2747-4366-9a12-e6ddd997edb5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:28.696036 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:28.695945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:28.696185 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.696146    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:28.696185 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.696173    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:28.696249 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.696186    2576 projected.go:196] Error preparing data for projected volume kube-api-access-x7xzf for pod openshift-network-diagnostics/network-check-target-whsl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:28.696249 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.696235    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf podName:674f7627-419e-4a1c-b219-a0f11798a498 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:36.696222038 +0000 UTC m=+18.309780720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x7xzf" (UniqueName: "kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf") pod "network-check-target-whsl6" (UID: "674f7627-419e-4a1c-b219-a0f11798a498") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:28.882502 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:28.882477    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:28.882669 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.882575    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:28.883069 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:28.882794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:28.883069 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.882904    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:28.883069 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:28.882971    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:28.883069 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:28.883046    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:28.943361 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:28.943314    2576 generic.go:356] "Generic (PLEG): container finished" podID="b3e387bde16a8e7cbd0c4901e28f5556" containerID="4b1708a34fceb7e50647c5e72e3dadc5edb29f3fad4a1c45d2e419da172755ab" exitCode=0
Jul 07 17:53:28.943523 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:28.943365    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal" event={"ID":"b3e387bde16a8e7cbd0c4901e28f5556","Type":"ContainerDied","Data":"4b1708a34fceb7e50647c5e72e3dadc5edb29f3fad4a1c45d2e419da172755ab"}
Jul 07 17:53:30.883001 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:30.882960    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:30.883465 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:30.883086    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:30.883465 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:30.883099    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:30.883465 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:30.883124    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:30.883465 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:30.883214    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:30.883465 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:30.883285    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:32.879042 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.879015    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:32.879420 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.879065    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:32.879420 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.879016    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:32.879420 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:32.879168    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:32.879420 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:32.879285    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:32.879420 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:32.879398    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:32.954676 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.954372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xkjn4" event={"ID":"10e91e04-35db-47b7-af63-57ecc01537c3","Type":"ContainerStarted","Data":"b7517012b7455ca23596b7cf11b2b54b5207d8705c9db451de9b69896bff8056"}
Jul 07 17:53:32.956783 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.956392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v9vgv" event={"ID":"41fc40ad-0e0a-4c64-acf7-b8367e3d9db7","Type":"ContainerStarted","Data":"0e4a84ce67ab689019cf0c242523199fe5f4e5e14a00b4d1e96fa4c25cd41e4e"}
Jul 07 17:53:32.958151 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.958126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd" event={"ID":"3b76b241-db14-44e7-8071-04a8ec370c74","Type":"ContainerStarted","Data":"b510cb1616ed53733757696c8f5f0df7ea29d765a6b504ac3e3b6ae2f813bd07"}
Jul 07 17:53:32.959975 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.959948    2576 generic.go:356] "Generic (PLEG): container finished" podID="665d98cc-dc33-4c35-a712-665933ffd9f7" containerID="68715215aa99332171bd9bdf1d544b5f94f573ccc9763be0bd996833856a44f8" exitCode=0
Jul 07 17:53:32.960094 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.960036    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tttdx" event={"ID":"665d98cc-dc33-4c35-a712-665933ffd9f7","Type":"ContainerDied","Data":"68715215aa99332171bd9bdf1d544b5f94f573ccc9763be0bd996833856a44f8"}
Jul 07 17:53:32.963936 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.961880    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fr5qf" event={"ID":"d5dc7ae3-702f-4a3c-b906-0793fba272ec","Type":"ContainerStarted","Data":"570b25b309273fae05d13680905491dbd73d4cd9c5a627eb4c9ebefb1dfefd80"}
Jul 07 17:53:32.963936 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.963682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2vgx7" event={"ID":"b617b886-d788-4271-b3dd-8ce0b0d673ff","Type":"ContainerStarted","Data":"caaee152eec83279394d83c34c690ee3598c044266fedbd9e2211c66467e9905"}
Jul 07 17:53:32.966222 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.966196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal" event={"ID":"b3e387bde16a8e7cbd0c4901e28f5556","Type":"ContainerStarted","Data":"775995911b7a6591671992a227a0a9494587b176a2d41f981c37d3e4c1647bab"}
Jul 07 17:53:32.979028 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:32.977335    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xkjn4" podStartSLOduration=2.90505457 podStartE2EDuration="13.977316131s" totalImagesPullingTime="11.072261561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:32.976513094 +0000 UTC m=+14.590071820" watchObservedRunningTime="2026-07-07 17:53:32.977316131 +0000 UTC m=+14.590874837"
Jul 07 17:53:33.018446 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:33.018392    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fr5qf" podStartSLOduration=2.961736432 podStartE2EDuration="14.018373334s" totalImagesPullingTime="11.056636902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:32.995640291 +0000 UTC m=+14.609199015" watchObservedRunningTime="2026-07-07 17:53:33.018373334 +0000 UTC m=+14.631932031"
Jul 07 17:53:33.019389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:33.019327    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v9vgv" podStartSLOduration=3.9161697650000002 podStartE2EDuration="15.019311861s" totalImagesPullingTime="11.103142096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:33.01888571 +0000 UTC m=+14.632444435" watchObservedRunningTime="2026-07-07 17:53:33.019311861 +0000 UTC m=+14.632870565"
Jul 07 17:53:33.039540 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:33.039065    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2vgx7" podStartSLOduration=2.590284071 podStartE2EDuration="14.039044098s" totalImagesPullingTime="11.448760027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:33.038747575 +0000 UTC m=+14.652306296" watchObservedRunningTime="2026-07-07 17:53:33.039044098 +0000 UTC m=+14.652602803"
Jul 07 17:53:33.970542 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:33.970437    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8586" event={"ID":"a5732089-a012-4d96-91fc-90053a40cf53","Type":"ContainerStarted","Data":"c605746637e855edb319555ebb71788d55d8823f2df73c5a26fc7bbf3c55917f"}
Jul 07 17:53:33.988675 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:33.988606    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c8586" podStartSLOduration=3.923476028 podStartE2EDuration="14.988583s" totalImagesPullingTime="11.065106972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:33.987962024 +0000 UTC m=+15.601520729" watchObservedRunningTime="2026-07-07 17:53:33.988583 +0000 UTC m=+15.602141707"
Jul 07 17:53:33.988860 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:33.988816    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-54.ec2.internal" podStartSLOduration=14.988805093 podStartE2EDuration="14.988805093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:33.092667423 +0000 UTC m=+14.706226127" watchObservedRunningTime="2026-07-07 17:53:33.988805093 +0000 UTC m=+15.602363800"
Jul 07 17:53:34.352994 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:34.352897    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:34.353604 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:34.353573    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:34.878825 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:34.878790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:34.879000 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:34.878792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:34.879000 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:34.878910    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:34.879000 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:34.878948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:34.879175 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:34.879056    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:34.879175 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:34.879135    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:34.972803 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:34.972769    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:34.973261 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:34.973242    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v9vgv"
Jul 07 17:53:36.658097 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:36.658055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:36.658809 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:36.658115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:36.658809 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.658228    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:36.658809 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.658230    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:36.658809 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.658294    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs podName:846d5a7d-2747-4366-9a12-e6ddd997edb5 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:52.658277788 +0000 UTC m=+34.271836476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs") pod "network-metrics-daemon-rlj2h" (UID: "846d5a7d-2747-4366-9a12-e6ddd997edb5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:36.658809 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.658310    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret podName:451479c6-8617-4573-8043-00f8e2ea11e1 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:52.658303517 +0000 UTC m=+34.271862199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret") pod "global-pull-secret-syncer-nr6d5" (UID: "451479c6-8617-4573-8043-00f8e2ea11e1") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:36.758857 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:36.758820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:36.759034 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.759012    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:36.759113 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.759039    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:36.759113 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.759051    2576 projected.go:196] Error preparing data for projected volume kube-api-access-x7xzf for pod openshift-network-diagnostics/network-check-target-whsl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:36.759212 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.759120    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf podName:674f7627-419e-4a1c-b219-a0f11798a498 nodeName:}" failed. No retries permitted until 2026-07-07 17:53:52.759101536 +0000 UTC m=+34.372660239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x7xzf" (UniqueName: "kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf") pod "network-check-target-whsl6" (UID: "674f7627-419e-4a1c-b219-a0f11798a498") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:36.878935 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:36.878901    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:36.879108 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:36.878911    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:36.879108 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.879038    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:36.879108 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:36.878915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:36.879108 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.879097    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:36.879241 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:36.879183    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:38.880036 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:38.879993    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:38.880715 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:38.880114    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:38.880715 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:38.880510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:38.880715 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:38.880607    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:38.880715 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:38.880651    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:38.880715 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:38.880704    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:40.879243 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:40.879215    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:40.879243 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:40.879236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:40.879789 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:40.879234    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:40.879789 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:40.879360    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:40.879789 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:40.879428    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:40.879789 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:40.879505    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:41.294588 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.290474    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 17:53:41.887793 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.887520    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:53:41.290674727Z","UUID":"e35dd744-5f15-4e2d-b97a-68bc1cb0e978","Handler":null,"Name":"","Endpoint":""}
Jul 07 17:53:41.889686 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.889665    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 17:53:41.889820 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.889702    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 17:53:41.990731 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.990688    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"850d10df2c442e163b888d473c61d45c89ac45240162c2773709e6e5f8ea6662"}
Jul 07 17:53:41.990908 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.990785    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"0a15cbe44bbcf9b203f360e1ee7fce3143b33bc13e1670f7bd6a74a0a4644e0d"}
Jul 07 17:53:41.990908 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.990829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"512f642e57c8c146be1284453c32d0f9db45548486e35ed7e9abe921e6c67f41"}
Jul 07 17:53:41.990908 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.990870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"67109e2cfdfc460c7b33c9d088c4e6044a733ef1ff922259c29748011119f8fb"}
Jul 07 17:53:41.991073 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.990911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"f17ebe1663b7e362a3f616d8bbb01464a87fbe1e0f6b4167b3e4aade8a33ba00"}
Jul 07 17:53:41.991073 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.990955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"d7958869f27234491699795aeedb9a7d0affc9cce1382e67f2ac330d80e6b11b"}
Jul 07 17:53:41.993118 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.993086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd" event={"ID":"3b76b241-db14-44e7-8071-04a8ec370c74","Type":"ContainerStarted","Data":"9d4eb905f877ecccff59db69c1adb995fdbaaa9606a6cdc5e13fda4f258bc910"}
Jul 07 17:53:41.994685 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:41.994659    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kp2sz" event={"ID":"d6d62277-b8c9-404c-9cb5-c1063369def4","Type":"ContainerStarted","Data":"be25084358f8eb888aceaa26dec7c5dd620868c6eda6b94c84935284bd09c5f0"}
Jul 07 17:53:42.019251 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:42.019189    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kp2sz" podStartSLOduration=3.040297945 podStartE2EDuration="23.019168659s" totalImagesPullingTime="19.978870714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:42.01805951 +0000 UTC m=+23.631618240" watchObservedRunningTime="2026-07-07 17:53:42.019168659 +0000 UTC m=+23.632727365"
Jul 07 17:53:42.878989 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:42.878943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:42.879159 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:42.878943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:42.879159 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:42.879072    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:42.879245 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:42.879170    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:42.879245 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:42.878943    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:42.879324 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:42.879255    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:42.998877 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:42.998784    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd" event={"ID":"3b76b241-db14-44e7-8071-04a8ec370c74","Type":"ContainerStarted","Data":"a4ab62abea0de8c6169fcb5f784f2e81bb4f74ba1887a0005c4841d76ae26de5"}
Jul 07 17:53:43.021628 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:43.021573    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbfsd" podStartSLOduration=3.138026101 podStartE2EDuration="24.021557874s" totalImagesPullingTime="20.883531773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:43.021412354 +0000 UTC m=+24.634971058" watchObservedRunningTime="2026-07-07 17:53:43.021557874 +0000 UTC m=+24.635116567"
Jul 07 17:53:44.004663 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:44.004585    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"683d51b7725466e1489e92fe058dcba0c53487be67c7744673bc5422bf73ad78"}
Jul 07 17:53:44.878854 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:44.878825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:44.879042 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:44.878859    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:44.879042 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:44.878932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:44.879042 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:44.878970    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:44.879212 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:44.879080    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:44.879212 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:44.879170    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:46.013665 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.013624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" event={"ID":"b42d2886-78d4-4c45-b6b1-f997e600ba31","Type":"ContainerStarted","Data":"eff2a5ba1b1d5eb8a581783e22b1df5cf9b24e0ae25f000541cf0ed6e5213aa2"}
Jul 07 17:53:46.014309 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.013945    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:46.014309 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.014165    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:46.014309 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.014302    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:46.031679 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.031652    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:46.032357 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.032316    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:53:46.049761 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.049369    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp" podStartSLOduration=8.062971028 podStartE2EDuration="28.049327146s" totalImagesPullingTime="19.986356118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:53:46.04923653 +0000 UTC m=+27.662795238" watchObservedRunningTime="2026-07-07 17:53:46.049327146 +0000 UTC m=+27.662885850"
Jul 07 17:53:46.879631 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.879596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:46.879631 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.879610    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:46.879874 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:46.879723    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:46.879874 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:46.879801    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:46.879874 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:46.879853    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:46.880014 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:46.879906    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:47.951550 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:47.951305    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr6d5"]
Jul 07 17:53:47.952037 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:47.951657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:47.952037 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:47.951765    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:47.954162 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:47.954137    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlj2h"]
Jul 07 17:53:47.954281 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:47.954233    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:47.954358 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:47.954325    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:47.957032 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:47.957008    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-whsl6"]
Jul 07 17:53:47.957150 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:47.957103    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:47.957235 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:47.957207    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:49.022734 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:49.022680    2576 generic.go:356] "Generic (PLEG): container finished" podID="665d98cc-dc33-4c35-a712-665933ffd9f7" containerID="b835a97b3034bd9a40b7e0959c44c6422dc2b1f74a0e10b0eed0a60e4775ff4b" exitCode=0
Jul 07 17:53:49.023108 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:49.022764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tttdx" event={"ID":"665d98cc-dc33-4c35-a712-665933ffd9f7","Type":"ContainerDied","Data":"b835a97b3034bd9a40b7e0959c44c6422dc2b1f74a0e10b0eed0a60e4775ff4b"}
Jul 07 17:53:49.879629 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:49.879594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:49.879804 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:49.879608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:49.879804 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:49.879762    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:49.879804 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:49.879796    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:49.879965 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:49.879922    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:49.880026 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:49.880008    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:50.027124 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:50.027085    2576 generic.go:356] "Generic (PLEG): container finished" podID="665d98cc-dc33-4c35-a712-665933ffd9f7" containerID="bcd11414846172f279d9d474496d8a626746903d3275678a04a510a397b13dda" exitCode=0
Jul 07 17:53:50.027552 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:50.027132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tttdx" event={"ID":"665d98cc-dc33-4c35-a712-665933ffd9f7","Type":"ContainerDied","Data":"bcd11414846172f279d9d474496d8a626746903d3275678a04a510a397b13dda"}
Jul 07 17:53:51.878967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:51.878776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:51.879489 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:51.878792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:51.879489 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:51.879086    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rlj2h" podUID="846d5a7d-2747-4366-9a12-e6ddd997edb5"
Jul 07 17:53:51.879489 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:51.878835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:51.879489 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:51.879132    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr6d5" podUID="451479c6-8617-4573-8043-00f8e2ea11e1"
Jul 07 17:53:51.879489 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:51.879265    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-whsl6" podUID="674f7627-419e-4a1c-b219-a0f11798a498"
Jul 07 17:53:52.034329 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:52.034297    2576 generic.go:356] "Generic (PLEG): container finished" podID="665d98cc-dc33-4c35-a712-665933ffd9f7" containerID="0e2dda0fc50b1a8059c4f6fe41e129417243d1b08045c8cda209190948b83c18" exitCode=0
Jul 07 17:53:52.034515 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:52.034369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tttdx" event={"ID":"665d98cc-dc33-4c35-a712-665933ffd9f7","Type":"ContainerDied","Data":"0e2dda0fc50b1a8059c4f6fe41e129417243d1b08045c8cda209190948b83c18"}
Jul 07 17:53:52.674154 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:52.674098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:52.674376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:52.674191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:52.674376 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:52.674270    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:52.674376 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:52.674296    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:52.674376 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:52.674365    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret podName:451479c6-8617-4573-8043-00f8e2ea11e1 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:24.674329209 +0000 UTC m=+66.287887904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret") pod "global-pull-secret-syncer-nr6d5" (UID: "451479c6-8617-4573-8043-00f8e2ea11e1") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:53:52.674596 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:52.674386    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs podName:846d5a7d-2747-4366-9a12-e6ddd997edb5 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:24.674376295 +0000 UTC m=+66.287934981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs") pod "network-metrics-daemon-rlj2h" (UID: "846d5a7d-2747-4366-9a12-e6ddd997edb5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:53:52.775469 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:52.775434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:52.775635 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:52.775593    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:53:52.775635 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:52.775611    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:53:52.775635 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:52.775620    2576 projected.go:196] Error preparing data for projected volume kube-api-access-x7xzf for pod openshift-network-diagnostics/network-check-target-whsl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:52.775732 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:52.775673    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf podName:674f7627-419e-4a1c-b219-a0f11798a498 nodeName:}" failed. No retries permitted until 2026-07-07 17:54:24.775656949 +0000 UTC m=+66.389215651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x7xzf" (UniqueName: "kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf") pod "network-check-target-whsl6" (UID: "674f7627-419e-4a1c-b219-a0f11798a498") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:53:53.670465 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.670434    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-54.ec2.internal" event="NodeReady"
Jul 07 17:53:53.671015 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.670608    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 17:53:53.706744 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.706703    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84f65f4d98-77gnh"]
Jul 07 17:53:53.710404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.710382    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.714959 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.714937    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 17:53:53.726412 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.726391    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 17:53:53.730118 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.729185    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 17:53:53.730118 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.729285    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qz45\""
Jul 07 17:53:53.749731 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.749700    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rp9kx"]
Jul 07 17:53:53.754356 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.754321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84f65f4d98-77gnh"]
Jul 07 17:53:53.754500 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.754479    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.756241 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.756216    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h4jl9"]
Jul 07 17:53:53.757171 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.757148    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 17:53:53.759717 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.759696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h4jl9"
Jul 07 17:53:53.762903 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.762875    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 17:53:53.764749 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.764728    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kjzch\""
Jul 07 17:53:53.765530 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.765514    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 17:53:53.765793 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.765777    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4bnp\""
Jul 07 17:53:53.765839 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.765816    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 17:53:53.766095 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.766078    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 17:53:53.766290 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.766277    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 17:53:53.783175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.783147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee5407fa-d7e6-45f2-ba09-95ee55262caf-ca-trust-extracted\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.783324 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.783206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.783324 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.783227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-certificates\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.783324 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.783274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-image-registry-private-configuration\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.783462 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.783328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-trusted-ca\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.783462 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.783385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-bound-sa-token\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.783462 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.783442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm6td\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-kube-api-access-nm6td\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.783562 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.783476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-installation-pull-secrets\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.784204 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.784186    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rp9kx"]
Jul 07 17:53:53.790903 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.790879    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h4jl9"]
Jul 07 17:53:53.879462 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.879385    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:53:53.879462 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.879421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:53:53.879462 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.879427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:53:53.882786 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.882765    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2d4ht\""
Jul 07 17:53:53.882786 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.882783    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:53:53.882994 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.882913    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lgh52\""
Jul 07 17:53:53.882994 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.882968    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:53:53.883124 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.883081    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:53:53.883124 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.883083    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:53:53.883756 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.883736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-tmp-dir\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.883862 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.883777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee5407fa-d7e6-45f2-ba09-95ee55262caf-ca-trust-extracted\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.883862 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.883844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.883975 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.883909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.883975 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.883934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-certificates\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.883975 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.883958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-config-volume\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.884125 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-image-registry-private-configuration\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.884125 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:53.884052    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:53:53.884125 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:53.884068    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f65f4d98-77gnh: secret "image-registry-tls" not found
Jul 07 17:53:53.884125 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b99cp\" (UniqueName: \"kubernetes.io/projected/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-kube-api-access-b99cp\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.884125 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:53.884120    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls podName:ee5407fa-d7e6-45f2-ba09-95ee55262caf nodeName:}" failed. No retries permitted until 2026-07-07 17:53:54.384105035 +0000 UTC m=+35.997663716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls") pod "image-registry-84f65f4d98-77gnh" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf") : secret "image-registry-tls" not found
Jul 07 17:53:53.884388 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884157    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee5407fa-d7e6-45f2-ba09-95ee55262caf-ca-trust-extracted\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.884388 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-trusted-ca\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.884388 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-bound-sa-token\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.884388 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm6td\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-kube-api-access-nm6td\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.884575 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884507    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-certificates\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.884575 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzj6t\" (UniqueName: \"kubernetes.io/projected/d268491c-994c-4b1e-91aa-dca256c3c78c-kube-api-access-gzj6t\") pod \"ingress-canary-h4jl9\" (UID: \"d268491c-994c-4b1e-91aa-dca256c3c78c\") " pod="openshift-ingress-canary/ingress-canary-h4jl9"
Jul 07 17:53:53.884662 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d268491c-994c-4b1e-91aa-dca256c3c78c-cert\") pod \"ingress-canary-h4jl9\" (UID: \"d268491c-994c-4b1e-91aa-dca256c3c78c\") " pod="openshift-ingress-canary/ingress-canary-h4jl9"
Jul 07 17:53:53.884662 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.884619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-installation-pull-secrets\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.885060 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.885031    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-trusted-ca\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.888836 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.888814    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-image-registry-private-configuration\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.888836 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.888824    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-installation-pull-secrets\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.893438 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.893338    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-bound-sa-token\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.893438 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.893401    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm6td\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-kube-api-access-nm6td\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:53.985100 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.985063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-config-volume\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.985100 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.985105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b99cp\" (UniqueName: \"kubernetes.io/projected/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-kube-api-access-b99cp\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.985333 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.985145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzj6t\" (UniqueName: \"kubernetes.io/projected/d268491c-994c-4b1e-91aa-dca256c3c78c-kube-api-access-gzj6t\") pod \"ingress-canary-h4jl9\" (UID: \"d268491c-994c-4b1e-91aa-dca256c3c78c\") " pod="openshift-ingress-canary/ingress-canary-h4jl9"
Jul 07 17:53:53.985333 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.985162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d268491c-994c-4b1e-91aa-dca256c3c78c-cert\") pod \"ingress-canary-h4jl9\" (UID: \"d268491c-994c-4b1e-91aa-dca256c3c78c\") " pod="openshift-ingress-canary/ingress-canary-h4jl9"
Jul 07 17:53:53.985333 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.985183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-tmp-dir\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.985333 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.985205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.985575 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:53.985338    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:53:53.985575 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:53.985430    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls podName:36d1dd46-e3ef-4ca4-894c-3f81da69b65f nodeName:}" failed. No retries permitted until 2026-07-07 17:53:54.485408245 +0000 UTC m=+36.098966927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls") pod "dns-default-rp9kx" (UID: "36d1dd46-e3ef-4ca4-894c-3f81da69b65f") : secret "dns-default-metrics-tls" not found
Jul 07 17:53:53.985689 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.985623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-tmp-dir\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.985744 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.985724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-config-volume\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:53.987989 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:53.987956    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d268491c-994c-4b1e-91aa-dca256c3c78c-cert\") pod \"ingress-canary-h4jl9\" (UID: \"d268491c-994c-4b1e-91aa-dca256c3c78c\") " pod="openshift-ingress-canary/ingress-canary-h4jl9"
Jul 07 17:53:54.000659 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:54.000628    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzj6t\" (UniqueName: \"kubernetes.io/projected/d268491c-994c-4b1e-91aa-dca256c3c78c-kube-api-access-gzj6t\") pod \"ingress-canary-h4jl9\" (UID: \"d268491c-994c-4b1e-91aa-dca256c3c78c\") " pod="openshift-ingress-canary/ingress-canary-h4jl9"
Jul 07 17:53:54.000780 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:54.000742    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b99cp\" (UniqueName: \"kubernetes.io/projected/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-kube-api-access-b99cp\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:54.070889 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:54.070856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h4jl9"
Jul 07 17:53:54.254743 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:54.254712    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h4jl9"]
Jul 07 17:53:54.259726 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:53:54.259695    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd268491c_994c_4b1e_91aa_dca256c3c78c.slice/crio-05d9dc94b4fafaeaa63a2f25cb1f4caa04fc7d961334f59346a649fb7e59a10b WatchSource:0}: Error finding container 05d9dc94b4fafaeaa63a2f25cb1f4caa04fc7d961334f59346a649fb7e59a10b: Status 404 returned error can't find the container with id 05d9dc94b4fafaeaa63a2f25cb1f4caa04fc7d961334f59346a649fb7e59a10b
Jul 07 17:53:54.389509 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:54.389459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:54.389692 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:54.389618    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:53:54.389692 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:54.389637    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f65f4d98-77gnh: secret "image-registry-tls" not found
Jul 07 17:53:54.389792 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:54.389703    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls podName:ee5407fa-d7e6-45f2-ba09-95ee55262caf nodeName:}" failed. No retries permitted until 2026-07-07 17:53:55.389681264 +0000 UTC m=+37.003239946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls") pod "image-registry-84f65f4d98-77gnh" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf") : secret "image-registry-tls" not found
Jul 07 17:53:54.490437 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:54.490326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:54.490589 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:54.490494    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:53:54.490589 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:54.490576    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls podName:36d1dd46-e3ef-4ca4-894c-3f81da69b65f nodeName:}" failed. No retries permitted until 2026-07-07 17:53:55.490558933 +0000 UTC m=+37.104117619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls") pod "dns-default-rp9kx" (UID: "36d1dd46-e3ef-4ca4-894c-3f81da69b65f") : secret "dns-default-metrics-tls" not found
Jul 07 17:53:55.042407 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:55.042363    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h4jl9" event={"ID":"d268491c-994c-4b1e-91aa-dca256c3c78c","Type":"ContainerStarted","Data":"05d9dc94b4fafaeaa63a2f25cb1f4caa04fc7d961334f59346a649fb7e59a10b"}
Jul 07 17:53:55.397045 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:55.396997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:55.397245 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:55.397161    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:53:55.397245 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:55.397182    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f65f4d98-77gnh: secret "image-registry-tls" not found
Jul 07 17:53:55.397365 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:55.397250    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls podName:ee5407fa-d7e6-45f2-ba09-95ee55262caf nodeName:}" failed. No retries permitted until 2026-07-07 17:53:57.397228654 +0000 UTC m=+39.010787339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls") pod "image-registry-84f65f4d98-77gnh" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf") : secret "image-registry-tls" not found
Jul 07 17:53:55.497695 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:55.497659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:55.497867 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:55.497849    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:53:55.497956 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:55.497941    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls podName:36d1dd46-e3ef-4ca4-894c-3f81da69b65f nodeName:}" failed. No retries permitted until 2026-07-07 17:53:57.497915968 +0000 UTC m=+39.111474657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls") pod "dns-default-rp9kx" (UID: "36d1dd46-e3ef-4ca4-894c-3f81da69b65f") : secret "dns-default-metrics-tls" not found
Jul 07 17:53:57.412057 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:57.411794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:53:57.412556 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:57.411970    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:53:57.412556 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:57.412150    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f65f4d98-77gnh: secret "image-registry-tls" not found
Jul 07 17:53:57.412556 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:57.412233    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls podName:ee5407fa-d7e6-45f2-ba09-95ee55262caf nodeName:}" failed. No retries permitted until 2026-07-07 17:54:01.412210709 +0000 UTC m=+43.025769394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls") pod "image-registry-84f65f4d98-77gnh" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf") : secret "image-registry-tls" not found
Jul 07 17:53:57.513095 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:53:57.513061    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:53:57.513255 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:57.513233    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:53:57.513333 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:53:57.513321    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls podName:36d1dd46-e3ef-4ca4-894c-3f81da69b65f nodeName:}" failed. No retries permitted until 2026-07-07 17:54:01.513299265 +0000 UTC m=+43.126857950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls") pod "dns-default-rp9kx" (UID: "36d1dd46-e3ef-4ca4-894c-3f81da69b65f") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:00.056384 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:00.056322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h4jl9" event={"ID":"d268491c-994c-4b1e-91aa-dca256c3c78c","Type":"ContainerStarted","Data":"45cd7e5b98ba729539299250ae98412460d9d0a92d5eb237c5813cc23a4095eb"}
Jul 07 17:54:00.059189 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:00.059160    2576 generic.go:356] "Generic (PLEG): container finished" podID="665d98cc-dc33-4c35-a712-665933ffd9f7" containerID="e590f51cd2e646ee480acfb95257f2d5e7185b28963fa2751f2d01d53568e3b1" exitCode=0
Jul 07 17:54:00.059328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:00.059197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tttdx" event={"ID":"665d98cc-dc33-4c35-a712-665933ffd9f7","Type":"ContainerDied","Data":"e590f51cd2e646ee480acfb95257f2d5e7185b28963fa2751f2d01d53568e3b1"}
Jul 07 17:54:00.079115 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:00.079060    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h4jl9" podStartSLOduration=2.381362717 podStartE2EDuration="7.079044511s" totalImagesPullingTime="4.697681794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:00.078213297 +0000 UTC m=+41.691772021" watchObservedRunningTime="2026-07-07 17:54:00.079044511 +0000 UTC m=+41.692603192"
Jul 07 17:54:01.064093 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:01.064058    2576 generic.go:356] "Generic (PLEG): container finished" podID="665d98cc-dc33-4c35-a712-665933ffd9f7" containerID="6b326c20b871c5af0ded497b7ce0b0cfdf0be5fba32975107e490a807533830d" exitCode=0
Jul 07 17:54:01.064543 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:01.064094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tttdx" event={"ID":"665d98cc-dc33-4c35-a712-665933ffd9f7","Type":"ContainerDied","Data":"6b326c20b871c5af0ded497b7ce0b0cfdf0be5fba32975107e490a807533830d"}
Jul 07 17:54:01.443747 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:01.443502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:54:01.443747 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:01.443666    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:54:01.443747 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:01.443719    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f65f4d98-77gnh: secret "image-registry-tls" not found
Jul 07 17:54:01.443961 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:01.443784    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls podName:ee5407fa-d7e6-45f2-ba09-95ee55262caf nodeName:}" failed. No retries permitted until 2026-07-07 17:54:09.443767882 +0000 UTC m=+51.057326564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls") pod "image-registry-84f65f4d98-77gnh" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf") : secret "image-registry-tls" not found
Jul 07 17:54:01.543985 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:01.543938    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:54:01.544148 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:01.544094    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:01.544224 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:01.544157    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls podName:36d1dd46-e3ef-4ca4-894c-3f81da69b65f nodeName:}" failed. No retries permitted until 2026-07-07 17:54:09.544140851 +0000 UTC m=+51.157699533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls") pod "dns-default-rp9kx" (UID: "36d1dd46-e3ef-4ca4-894c-3f81da69b65f") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:02.070391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:02.070358    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tttdx" event={"ID":"665d98cc-dc33-4c35-a712-665933ffd9f7","Type":"ContainerStarted","Data":"a3560e075bc097de06b5b4bd6880de5ee4ffbdd4ce07bb3f6d465bd7b80d86d8"}
Jul 07 17:54:02.100885 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:02.100832    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tttdx" podStartSLOduration=8.136418112 podStartE2EDuration="43.100815494s" totalImagesPullingTime="34.964397382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:02.100766345 +0000 UTC m=+43.714325049" watchObservedRunningTime="2026-07-07 17:54:02.100815494 +0000 UTC m=+43.714374198"
Jul 07 17:54:09.507389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:09.507329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:54:09.507945 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:09.507511    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:54:09.507945 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:09.507532    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f65f4d98-77gnh: secret "image-registry-tls" not found
Jul 07 17:54:09.507945 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:09.507593    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls podName:ee5407fa-d7e6-45f2-ba09-95ee55262caf nodeName:}" failed. No retries permitted until 2026-07-07 17:54:25.507576652 +0000 UTC m=+67.121135333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls") pod "image-registry-84f65f4d98-77gnh" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf") : secret "image-registry-tls" not found
Jul 07 17:54:09.608244 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:09.608206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:54:09.608403 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:09.608383    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:09.608448 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:09.608441    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls podName:36d1dd46-e3ef-4ca4-894c-3f81da69b65f nodeName:}" failed. No retries permitted until 2026-07-07 17:54:25.608424276 +0000 UTC m=+67.221982977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls") pod "dns-default-rp9kx" (UID: "36d1dd46-e3ef-4ca4-894c-3f81da69b65f") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:18.038732 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:18.038705    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjgzp"
Jul 07 17:54:24.719623 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.719575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:54:24.720025 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.719645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:54:24.722671 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.722649    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:54:24.722720 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.722698    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:54:24.730004 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:24.729982    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 17:54:24.730062 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:24.730052    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs podName:846d5a7d-2747-4366-9a12-e6ddd997edb5 nodeName:}" failed. No retries permitted until 2026-07-07 17:55:28.730036352 +0000 UTC m=+130.343595037 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs") pod "network-metrics-daemon-rlj2h" (UID: "846d5a7d-2747-4366-9a12-e6ddd997edb5") : secret "metrics-daemon-secret" not found
Jul 07 17:54:24.733783 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.733766    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/451479c6-8617-4573-8043-00f8e2ea11e1-original-pull-secret\") pod \"global-pull-secret-syncer-nr6d5\" (UID: \"451479c6-8617-4573-8043-00f8e2ea11e1\") " pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:54:24.790229 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.790187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr6d5"
Jul 07 17:54:24.820555 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.820511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:54:24.824022 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.823993    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:54:24.834677 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.834654    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:54:24.846540 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.846510    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7xzf\" (UniqueName: \"kubernetes.io/projected/674f7627-419e-4a1c-b219-a0f11798a498-kube-api-access-x7xzf\") pod \"network-check-target-whsl6\" (UID: \"674f7627-419e-4a1c-b219-a0f11798a498\") " pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:54:24.923048 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:24.923006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr6d5"]
Jul 07 17:54:24.925993 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:54:24.925951    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod451479c6_8617_4573_8043_00f8e2ea11e1.slice/crio-02466cde269d48f53a29455bad743e023cd0c435fdeb18205b839f85746fda6f WatchSource:0}: Error finding container 02466cde269d48f53a29455bad743e023cd0c435fdeb18205b839f85746fda6f: Status 404 returned error can't find the container with id 02466cde269d48f53a29455bad743e023cd0c435fdeb18205b839f85746fda6f
Jul 07 17:54:25.116837 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:25.116805    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2d4ht\""
Jul 07 17:54:25.124253 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:25.124224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:54:25.128589 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:25.128549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr6d5" event={"ID":"451479c6-8617-4573-8043-00f8e2ea11e1","Type":"ContainerStarted","Data":"02466cde269d48f53a29455bad743e023cd0c435fdeb18205b839f85746fda6f"}
Jul 07 17:54:25.250558 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:25.250525    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-whsl6"]
Jul 07 17:54:25.253699 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:54:25.253665    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674f7627_419e_4a1c_b219_a0f11798a498.slice/crio-2826619121e1cb0c8ec6d4ebeb4a4581d1f76d6246ca1b89a7a4ae9269ed3b5a WatchSource:0}: Error finding container 2826619121e1cb0c8ec6d4ebeb4a4581d1f76d6246ca1b89a7a4ae9269ed3b5a: Status 404 returned error can't find the container with id 2826619121e1cb0c8ec6d4ebeb4a4581d1f76d6246ca1b89a7a4ae9269ed3b5a
Jul 07 17:54:25.525673 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:25.525581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:54:25.525820 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:25.525702    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:54:25.525820 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:25.525714    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84f65f4d98-77gnh: secret "image-registry-tls" not found
Jul 07 17:54:25.525820 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:25.525769    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls podName:ee5407fa-d7e6-45f2-ba09-95ee55262caf nodeName:}" failed. No retries permitted until 2026-07-07 17:54:57.525754913 +0000 UTC m=+99.139313596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls") pod "image-registry-84f65f4d98-77gnh" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf") : secret "image-registry-tls" not found
Jul 07 17:54:25.626172 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:25.626126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:54:25.626314 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:25.626280    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:54:25.626390 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:25.626360    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls podName:36d1dd46-e3ef-4ca4-894c-3f81da69b65f nodeName:}" failed. No retries permitted until 2026-07-07 17:54:57.626326297 +0000 UTC m=+99.239884979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls") pod "dns-default-rp9kx" (UID: "36d1dd46-e3ef-4ca4-894c-3f81da69b65f") : secret "dns-default-metrics-tls" not found
Jul 07 17:54:26.132572 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:26.132532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-whsl6" event={"ID":"674f7627-419e-4a1c-b219-a0f11798a498","Type":"ContainerStarted","Data":"2826619121e1cb0c8ec6d4ebeb4a4581d1f76d6246ca1b89a7a4ae9269ed3b5a"}
Jul 07 17:54:31.148011 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:31.147971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr6d5" event={"ID":"451479c6-8617-4573-8043-00f8e2ea11e1","Type":"ContainerStarted","Data":"7e3bc6210aecaa123149f8ad3f7d768b1fe6e7d9341395f037838b63354bfe29"}
Jul 07 17:54:31.149480 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:31.149453    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-whsl6" event={"ID":"674f7627-419e-4a1c-b219-a0f11798a498","Type":"ContainerStarted","Data":"5ad2994bc75e7a6bac5973d6ea2dbb8ea1d6e8cde77956db95942d3fb7e74189"}
Jul 07 17:54:31.149612 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:31.149594    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:54:31.170458 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:31.170372    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nr6d5" podStartSLOduration=66.314026063 podStartE2EDuration="1m12.170334653s" totalImagesPullingTime="5.85630859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:31.170130023 +0000 UTC m=+72.783688728" watchObservedRunningTime="2026-07-07 17:54:31.170334653 +0000 UTC m=+72.783893370"
Jul 07 17:54:31.189463 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:31.189413    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-whsl6" podStartSLOduration=66.672806279 podStartE2EDuration="1m12.189399321s" totalImagesPullingTime="5.516593042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:31.188585347 +0000 UTC m=+72.802144051" watchObservedRunningTime="2026-07-07 17:54:31.189399321 +0000 UTC m=+72.802958003"
Jul 07 17:54:41.521427 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.521291    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"]
Jul 07 17:54:41.524261 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.524242    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.528567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.528540    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 17:54:41.528977 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.528958    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:54:41.529114 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.529100    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 17:54:41.529945 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.529928    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-z6nzg\""
Jul 07 17:54:41.530025 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.529994    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 17:54:41.537541 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.537494    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"]
Jul 07 17:54:41.648485 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.648451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.648669 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.648519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.648669 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.648614    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ftvb\" (UniqueName: \"kubernetes.io/projected/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-kube-api-access-8ftvb\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.749708 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.749676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.749817 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.749735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ftvb\" (UniqueName: \"kubernetes.io/projected/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-kube-api-access-8ftvb\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.749817 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.749800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.750448 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.750391    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.752073 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.752048    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.760156 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.760128    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ftvb\" (UniqueName: \"kubernetes.io/projected/7cf7fd4a-0f27-4613-9114-95bbd5e8a782-kube-api-access-8ftvb\") pod \"kube-storage-version-migrator-operator-846bf668f7-pk7tt\" (UID: \"7cf7fd4a-0f27-4613-9114-95bbd5e8a782\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.833156 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.833123    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"
Jul 07 17:54:41.968334 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:41.968297    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt"]
Jul 07 17:54:41.972060 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:54:41.972029    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf7fd4a_0f27_4613_9114_95bbd5e8a782.slice/crio-89ff57e36e01b977d45702470ec5d77050749205d02f16e61bc81590c5a2aab3 WatchSource:0}: Error finding container 89ff57e36e01b977d45702470ec5d77050749205d02f16e61bc81590c5a2aab3: Status 404 returned error can't find the container with id 89ff57e36e01b977d45702470ec5d77050749205d02f16e61bc81590c5a2aab3
Jul 07 17:54:42.178929 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:42.178824    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt" event={"ID":"7cf7fd4a-0f27-4613-9114-95bbd5e8a782","Type":"ContainerStarted","Data":"89ff57e36e01b977d45702470ec5d77050749205d02f16e61bc81590c5a2aab3"}
Jul 07 17:54:43.542497 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.542460    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"]
Jul 07 17:54:43.545252 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.545236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.548086 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.548063    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 17:54:43.548212 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.548092    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:54:43.548273 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.548210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 17:54:43.548330 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.548264    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kptcb\""
Jul 07 17:54:43.549317 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.549301    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 17:54:43.556497 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.556475    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"]
Jul 07 17:54:43.663408 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.663339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.663590 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.663499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fss2j\" (UniqueName: \"kubernetes.io/projected/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-kube-api-access-fss2j\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.663590 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.663549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-config\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.764841 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.764805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fss2j\" (UniqueName: \"kubernetes.io/projected/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-kube-api-access-fss2j\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.765028 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.764850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-config\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.765028 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.764922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.765463 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.765442    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-config\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.767456 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.767426    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.774870 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.774843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fss2j\" (UniqueName: \"kubernetes.io/projected/fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04-kube-api-access-fss2j\") pod \"service-ca-operator-5d46d9ffd4-jfbtd\" (UID: \"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:43.854452 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:43.854412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"
Jul 07 17:54:44.204101 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.203877    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jpj9k"]
Jul 07 17:54:44.209676 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.209605    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.220157 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.218232    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 17:54:44.220157 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.218542    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wcn5j\""
Jul 07 17:54:44.220157 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.219746    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 17:54:44.220461 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.220177    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 17:54:44.220461 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.220387    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 17:54:44.229834 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.229809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpj9k"]
Jul 07 17:54:44.269076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.269045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/517e1774-b586-4e1d-97ae-81f8d8ae987d-data-volume\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.269233 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.269140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlrf6\" (UniqueName: \"kubernetes.io/projected/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-api-access-wlrf6\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.269233 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.269227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/517e1774-b586-4e1d-97ae-81f8d8ae987d-crio-socket\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.269320 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.269262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.269388 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.269317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.285828 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.285798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd"]
Jul 07 17:54:44.289288 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:54:44.289264    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5f4eb9_675c_4f59_ab5a_1ce763c5bf04.slice/crio-e104f724af4667c1da56959f81083d2c1722897e0585ebec28d60f318fecec60 WatchSource:0}: Error finding container e104f724af4667c1da56959f81083d2c1722897e0585ebec28d60f318fecec60: Status 404 returned error can't find the container with id e104f724af4667c1da56959f81083d2c1722897e0585ebec28d60f318fecec60
Jul 07 17:54:44.370338 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.370297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/517e1774-b586-4e1d-97ae-81f8d8ae987d-crio-socket\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.370538 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.370364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.370538 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.370397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.370538 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.370419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/517e1774-b586-4e1d-97ae-81f8d8ae987d-data-volume\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.370538 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.370474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlrf6\" (UniqueName: \"kubernetes.io/projected/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-api-access-wlrf6\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.370538 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:44.370482    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:44.370752 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:44.370539    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:44.370752 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.370426    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/517e1774-b586-4e1d-97ae-81f8d8ae987d-crio-socket\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.370752 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:44.370560    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:44.870541992 +0000 UTC m=+86.484100691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:44.370752 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:44.370626    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:44.870598408 +0000 UTC m=+86.484157103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:44.370752 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.370744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/517e1774-b586-4e1d-97ae-81f8d8ae987d-data-volume\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.380146 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.380120    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlrf6\" (UniqueName: \"kubernetes.io/projected/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-api-access-wlrf6\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.528442 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.528368    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g"]
Jul 07 17:54:44.532292 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.532275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g"
Jul 07 17:54:44.535321 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.535299    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-f8nw8\""
Jul 07 17:54:44.551554 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.551525    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g"]
Jul 07 17:54:44.573087 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.573053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmkcr\" (UniqueName: \"kubernetes.io/projected/cc020413-dadc-4a68-8b26-f4296ac67490-kube-api-access-kmkcr\") pod \"network-check-source-989f8b8dc-dn66g\" (UID: \"cc020413-dadc-4a68-8b26-f4296ac67490\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g"
Jul 07 17:54:44.673624 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.673587    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmkcr\" (UniqueName: \"kubernetes.io/projected/cc020413-dadc-4a68-8b26-f4296ac67490-kube-api-access-kmkcr\") pod \"network-check-source-989f8b8dc-dn66g\" (UID: \"cc020413-dadc-4a68-8b26-f4296ac67490\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g"
Jul 07 17:54:44.683618 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.683591    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmkcr\" (UniqueName: \"kubernetes.io/projected/cc020413-dadc-4a68-8b26-f4296ac67490-kube-api-access-kmkcr\") pod \"network-check-source-989f8b8dc-dn66g\" (UID: \"cc020413-dadc-4a68-8b26-f4296ac67490\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g"
Jul 07 17:54:44.842089 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.842051    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g"
Jul 07 17:54:44.875411 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.875376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.875411 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.875420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:44.875631 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:44.875520    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:44.875631 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:44.875543    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:44.875631 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:44.875609    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:45.87558511 +0000 UTC m=+87.489143806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:44.875631 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:44.875629    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:45.875620959 +0000 UTC m=+87.489179646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:44.987636 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:44.987604    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g"]
Jul 07 17:54:44.991421 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:54:44.991387    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc020413_dadc_4a68_8b26_f4296ac67490.slice/crio-272bde9d315c7541034fed13146ae55d179fcbe62eeae0ee3c2bed381d2f95f3 WatchSource:0}: Error finding container 272bde9d315c7541034fed13146ae55d179fcbe62eeae0ee3c2bed381d2f95f3: Status 404 returned error can't find the container with id 272bde9d315c7541034fed13146ae55d179fcbe62eeae0ee3c2bed381d2f95f3
Jul 07 17:54:45.190304 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:45.190217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt" event={"ID":"7cf7fd4a-0f27-4613-9114-95bbd5e8a782","Type":"ContainerStarted","Data":"ca07c3c2d2422b9b79c4e241ef5377fc299cbdf2ce8a8b3a7d81035288f31ae1"}
Jul 07 17:54:45.191695 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:45.191665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd" event={"ID":"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04","Type":"ContainerStarted","Data":"e104f724af4667c1da56959f81083d2c1722897e0585ebec28d60f318fecec60"}
Jul 07 17:54:45.193893 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:45.193560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g" event={"ID":"cc020413-dadc-4a68-8b26-f4296ac67490","Type":"ContainerStarted","Data":"cca333178283e8e79facc17602db49a1b803f400d8665276c982e4042537ab24"}
Jul 07 17:54:45.193893 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:45.193607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g" event={"ID":"cc020413-dadc-4a68-8b26-f4296ac67490","Type":"ContainerStarted","Data":"272bde9d315c7541034fed13146ae55d179fcbe62eeae0ee3c2bed381d2f95f3"}
Jul 07 17:54:45.210878 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:45.210808    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt" podStartSLOduration=1.975491589 podStartE2EDuration="4.210786939s" totalImagesPullingTime="2.23529535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:45.210645675 +0000 UTC m=+86.824204380" watchObservedRunningTime="2026-07-07 17:54:45.210786939 +0000 UTC m=+86.824345650"
Jul 07 17:54:45.234005 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:45.233958    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dn66g" podStartSLOduration=1.233942841 podStartE2EDuration="1.233942841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:45.233592388 +0000 UTC m=+86.847151112" watchObservedRunningTime="2026-07-07 17:54:45.233942841 +0000 UTC m=+86.847501535"
Jul 07 17:54:45.884524 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:45.884489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:45.884944 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:45.884535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:45.884944 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:45.884604    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:45.884944 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:45.884669    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:47.884653203 +0000 UTC m=+89.498211885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:45.884944 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:45.884715    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:45.884944 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:45.884792    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:47.884773872 +0000 UTC m=+89.498332558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:46.408690 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:46.408658    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xkjn4_10e91e04-35db-47b7-af63-57ecc01537c3/dns-node-resolver/0.log"
Jul 07 17:54:47.200550 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:47.200522    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fr5qf_d5dc7ae3-702f-4a3c-b906-0793fba272ec/node-ca/0.log"
Jul 07 17:54:47.201143 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:47.201115    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd" event={"ID":"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04","Type":"ContainerStarted","Data":"6e7c3e0484f6ce49df32a8a0febe9d7baa5683ff75993e581cd320b841c6cbe0"}
Jul 07 17:54:47.225801 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:47.225739    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd" podStartSLOduration=1.897172543 podStartE2EDuration="4.225724115s" totalImagesPullingTime="2.328551572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:47.225052096 +0000 UTC m=+88.838610800" watchObservedRunningTime="2026-07-07 17:54:47.225724115 +0000 UTC m=+88.839282850"
Jul 07 17:54:47.903188 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:47.903143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:47.903188 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:47.903189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:47.903458 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:47.903273    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:47.903458 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:47.903337    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:51.903321785 +0000 UTC m=+93.516880466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:47.903458 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:47.903279    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:47.903458 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:47.903397    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:51.903390361 +0000 UTC m=+93.516949043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:48.002110 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:48.002077    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h4jl9_d268491c-994c-4b1e-91aa-dca256c3c78c/serve-healthcheck-canary/0.log"
Jul 07 17:54:50.331335 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.331293    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xrnbj"]
Jul 07 17:54:50.334545 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.334529    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.338540 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.338511    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 17:54:50.338642 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.338609    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tnwxz\""
Jul 07 17:54:50.339755 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.339737    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 17:54:50.339755 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.339748    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 17:54:50.340048 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.340032    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 17:54:50.344661 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.344638    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xrnbj"]
Jul 07 17:54:50.424142 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.424103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-signing-key\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.424322 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.424244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-signing-cabundle\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.424322 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.424292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s62m2\" (UniqueName: \"kubernetes.io/projected/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-kube-api-access-s62m2\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.524754 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.524711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-signing-cabundle\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.524910 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.524778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s62m2\" (UniqueName: \"kubernetes.io/projected/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-kube-api-access-s62m2\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.524910 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.524813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-signing-key\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.525510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.525489    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-signing-cabundle\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.527362 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.527315    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-signing-key\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.535129 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.535106    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s62m2\" (UniqueName: \"kubernetes.io/projected/c68b0fe1-07b7-4959-b7a6-c21ad8e9a232-kube-api-access-s62m2\") pod \"service-ca-758f599c5-xrnbj\" (UID: \"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232\") " pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.643523 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.643432    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-xrnbj"
Jul 07 17:54:50.783007 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:50.782977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-xrnbj"]
Jul 07 17:54:50.786969 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:54:50.786939    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68b0fe1_07b7_4959_b7a6_c21ad8e9a232.slice/crio-60a59326233515775449d3708e66a7a3ed620bbea0ef74a79e84f9d62b288b40 WatchSource:0}: Error finding container 60a59326233515775449d3708e66a7a3ed620bbea0ef74a79e84f9d62b288b40: Status 404 returned error can't find the container with id 60a59326233515775449d3708e66a7a3ed620bbea0ef74a79e84f9d62b288b40
Jul 07 17:54:51.216160 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:51.216129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xrnbj" event={"ID":"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232","Type":"ContainerStarted","Data":"edafba2c0ac9b52f28616ffcf5b1d054202ba7704fa3ac872051dcdb0243a5b7"}
Jul 07 17:54:51.216366 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:51.216177    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-xrnbj" event={"ID":"c68b0fe1-07b7-4959-b7a6-c21ad8e9a232","Type":"ContainerStarted","Data":"60a59326233515775449d3708e66a7a3ed620bbea0ef74a79e84f9d62b288b40"}
Jul 07 17:54:51.242106 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:51.242053    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-xrnbj" podStartSLOduration=1.242036358 podStartE2EDuration="1.242036358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:54:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:51.240320607 +0000 UTC m=+92.853879311" watchObservedRunningTime="2026-07-07 17:54:51.242036358 +0000 UTC m=+92.855595061"
Jul 07 17:54:51.939038 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:51.935768    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:51.939038 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:51.935832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:54:51.939038 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:51.936078    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:51.939038 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:51.936164    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:59.936143117 +0000 UTC m=+101.549701816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:54:51.939038 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:51.936237    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:54:51.939038 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:54:51.936280    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:54:59.936260838 +0000 UTC m=+101.549819531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : configmap "kube-rbac-proxy" not found
Jul 07 17:54:57.584888 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.584850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:54:57.587444 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.587409    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"image-registry-84f65f4d98-77gnh\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") " pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:54:57.622702 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.622677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5qz45\""
Jul 07 17:54:57.629519 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.629488    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:54:57.686300 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.686268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:54:57.689266 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.689206    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/36d1dd46-e3ef-4ca4-894c-3f81da69b65f-metrics-tls\") pod \"dns-default-rp9kx\" (UID: \"36d1dd46-e3ef-4ca4-894c-3f81da69b65f\") " pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:54:57.773721 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.773647    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84f65f4d98-77gnh"]
Jul 07 17:54:57.776393 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:54:57.776367    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5407fa_d7e6_45f2_ba09_95ee55262caf.slice/crio-066be3ca69ffc07133b811e5a766bf53c8f0f1b3b96cf43e08a5ddb3d4e7bdd9 WatchSource:0}: Error finding container 066be3ca69ffc07133b811e5a766bf53c8f0f1b3b96cf43e08a5ddb3d4e7bdd9: Status 404 returned error can't find the container with id 066be3ca69ffc07133b811e5a766bf53c8f0f1b3b96cf43e08a5ddb3d4e7bdd9
Jul 07 17:54:57.969058 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.969022    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q4bnp\""
Jul 07 17:54:57.977189 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:57.977166    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:54:58.115843 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:58.115812    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rp9kx"]
Jul 07 17:54:58.119179 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:54:58.119145    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d1dd46_e3ef_4ca4_894c_3f81da69b65f.slice/crio-f855db2187a42758e37f4e01ce2789155152cbf51e6b8cf12276a8bbd77b2257 WatchSource:0}: Error finding container f855db2187a42758e37f4e01ce2789155152cbf51e6b8cf12276a8bbd77b2257: Status 404 returned error can't find the container with id f855db2187a42758e37f4e01ce2789155152cbf51e6b8cf12276a8bbd77b2257
Jul 07 17:54:58.239120 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:58.239062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh" event={"ID":"ee5407fa-d7e6-45f2-ba09-95ee55262caf","Type":"ContainerStarted","Data":"b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249"}
Jul 07 17:54:58.239312 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:58.239138    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh" event={"ID":"ee5407fa-d7e6-45f2-ba09-95ee55262caf","Type":"ContainerStarted","Data":"066be3ca69ffc07133b811e5a766bf53c8f0f1b3b96cf43e08a5ddb3d4e7bdd9"}
Jul 07 17:54:58.239312 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:58.239164    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:54:58.240174 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:58.240144    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rp9kx" event={"ID":"36d1dd46-e3ef-4ca4-894c-3f81da69b65f","Type":"ContainerStarted","Data":"f855db2187a42758e37f4e01ce2789155152cbf51e6b8cf12276a8bbd77b2257"}
Jul 07 17:54:58.267175 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:54:58.265006    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh" podStartSLOduration=99.264978888 podStartE2EDuration="1m39.264978888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:58.263312012 +0000 UTC m=+99.876870717" watchObservedRunningTime="2026-07-07 17:54:58.264978888 +0000 UTC m=+99.878537592"
Jul 07 17:55:00.007166 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:00.007119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:55:00.007608 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:00.007181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:55:00.007608 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:00.007379    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:55:00.007608 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:00.007465    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls podName:517e1774-b586-4e1d-97ae-81f8d8ae987d nodeName:}" failed. No retries permitted until 2026-07-07 17:55:16.007443306 +0000 UTC m=+117.621002031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jpj9k" (UID: "517e1774-b586-4e1d-97ae-81f8d8ae987d") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:55:00.007821 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:00.007796    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/517e1774-b586-4e1d-97ae-81f8d8ae987d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:55:01.254159 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:01.254120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rp9kx" event={"ID":"36d1dd46-e3ef-4ca4-894c-3f81da69b65f","Type":"ContainerStarted","Data":"03183445f84aeecc496337b982cd6774c9efad570fb6247ddc13c7957d0da93e"}
Jul 07 17:55:01.254575 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:01.254182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rp9kx" event={"ID":"36d1dd46-e3ef-4ca4-894c-3f81da69b65f","Type":"ContainerStarted","Data":"dd51fc3f056fbfae849f624888b776247eaba83ff042a9934f7d88983719bc41"}
Jul 07 17:55:01.254575 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:01.254235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:55:01.277508 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:01.277456    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rp9kx" podStartSLOduration=65.578276361 podStartE2EDuration="1m8.277433203s" totalImagesPullingTime="2.699156842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:01.277052446 +0000 UTC m=+102.890611150" watchObservedRunningTime="2026-07-07 17:55:01.277433203 +0000 UTC m=+102.890991908"
Jul 07 17:55:02.155191 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:02.155160    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-whsl6"
Jul 07 17:55:11.260442 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:11.260411    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rp9kx"
Jul 07 17:55:15.408546 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.408508    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57fbf55f9d-rh7bn"]
Jul 07 17:55:15.411581 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.411562    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.416067 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.416034    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"]
Jul 07 17:55:15.416258 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.416149    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 17:55:15.416258 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.416208    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q9ml4\""
Jul 07 17:55:15.416258 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.416221    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 17:55:15.416258 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.416211    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 17:55:15.416492 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.416265    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 17:55:15.420051 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.420022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"
Jul 07 17:55:15.420308 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.420291    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:55:15.420417 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.420300    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:55:15.420632 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.420618    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 17:55:15.422853 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.422832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 17:55:15.422960 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.422900    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vtvpj\""
Jul 07 17:55:15.423027 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.422999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 17:55:15.423293 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.423277    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 17:55:15.423500 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.423480    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 17:55:15.431219 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.431195    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fbf55f9d-rh7bn"]
Jul 07 17:55:15.432042 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.432015    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"]
Jul 07 17:55:15.529271 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.529235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb2372fc-099f-49fe-8a75-2b8fb06788a2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f654b68fd-78f7z\" (UID: \"bb2372fc-099f-49fe-8a75-2b8fb06788a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"
Jul 07 17:55:15.529271 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.529273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-oauth-config\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.529489 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.529295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknsc\" (UniqueName: \"kubernetes.io/projected/bb2372fc-099f-49fe-8a75-2b8fb06788a2-kube-api-access-vknsc\") pod \"managed-serviceaccount-addon-agent-7f654b68fd-78f7z\" (UID: \"bb2372fc-099f-49fe-8a75-2b8fb06788a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"
Jul 07 17:55:15.529489 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.529373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-oauth-serving-cert\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.529489 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.529418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-console-config\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.529489 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.529435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-service-ca\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.529489 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.529455    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmlvb\" (UniqueName: \"kubernetes.io/projected/f248bf6f-b006-4214-a0c5-627cce7b6554-kube-api-access-nmlvb\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.529638 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.529531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-serving-cert\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.630722 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.630685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb2372fc-099f-49fe-8a75-2b8fb06788a2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f654b68fd-78f7z\" (UID: \"bb2372fc-099f-49fe-8a75-2b8fb06788a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"
Jul 07 17:55:15.630722 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.630723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-oauth-config\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.630932 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.630750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknsc\" (UniqueName: \"kubernetes.io/projected/bb2372fc-099f-49fe-8a75-2b8fb06788a2-kube-api-access-vknsc\") pod \"managed-serviceaccount-addon-agent-7f654b68fd-78f7z\" (UID: \"bb2372fc-099f-49fe-8a75-2b8fb06788a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"
Jul 07 17:55:15.630932 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.630881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-oauth-serving-cert\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.631007 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.630939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-console-config\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.631007 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.630972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-service-ca\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.631108 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.631004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmlvb\" (UniqueName: \"kubernetes.io/projected/f248bf6f-b006-4214-a0c5-627cce7b6554-kube-api-access-nmlvb\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.631108 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.631078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-serving-cert\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.631644 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.631622    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-console-config\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.631887 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.631837    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-oauth-serving-cert\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.631986 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.631898    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-service-ca\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.633567 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.633545    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-oauth-config\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.633650 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.633628    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-serving-cert\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.633692 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.633660    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bb2372fc-099f-49fe-8a75-2b8fb06788a2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f654b68fd-78f7z\" (UID: \"bb2372fc-099f-49fe-8a75-2b8fb06788a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"
Jul 07 17:55:15.644757 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.644732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknsc\" (UniqueName: \"kubernetes.io/projected/bb2372fc-099f-49fe-8a75-2b8fb06788a2-kube-api-access-vknsc\") pod \"managed-serviceaccount-addon-agent-7f654b68fd-78f7z\" (UID: \"bb2372fc-099f-49fe-8a75-2b8fb06788a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"
Jul 07 17:55:15.647199 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.647175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmlvb\" (UniqueName: \"kubernetes.io/projected/f248bf6f-b006-4214-a0c5-627cce7b6554-kube-api-access-nmlvb\") pod \"console-57fbf55f9d-rh7bn\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") " pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.721251 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.721156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:15.738468 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.738440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"
Jul 07 17:55:15.878113 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.878085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57fbf55f9d-rh7bn"]
Jul 07 17:55:15.881008 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:15.880980    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf248bf6f_b006_4214_a0c5_627cce7b6554.slice/crio-976d34cea675448872292326a2fba0c689f3c01b7e91baab9845f14b676d3e70 WatchSource:0}: Error finding container 976d34cea675448872292326a2fba0c689f3c01b7e91baab9845f14b676d3e70: Status 404 returned error can't find the container with id 976d34cea675448872292326a2fba0c689f3c01b7e91baab9845f14b676d3e70
Jul 07 17:55:15.896827 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:15.896795    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z"]
Jul 07 17:55:15.899242 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:15.899212    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb2372fc_099f_49fe_8a75_2b8fb06788a2.slice/crio-48770d3e633e476ccd681bd0ca0f8f408d3f49abc7b2f5c9f806da98445ca948 WatchSource:0}: Error finding container 48770d3e633e476ccd681bd0ca0f8f408d3f49abc7b2f5c9f806da98445ca948: Status 404 returned error can't find the container with id 48770d3e633e476ccd681bd0ca0f8f408d3f49abc7b2f5c9f806da98445ca948
Jul 07 17:55:16.034217 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:16.034137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:55:16.036621 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:16.036600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/517e1774-b586-4e1d-97ae-81f8d8ae987d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jpj9k\" (UID: \"517e1774-b586-4e1d-97ae-81f8d8ae987d\") " pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:55:16.302155 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:16.302066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fbf55f9d-rh7bn" event={"ID":"f248bf6f-b006-4214-a0c5-627cce7b6554","Type":"ContainerStarted","Data":"976d34cea675448872292326a2fba0c689f3c01b7e91baab9845f14b676d3e70"}
Jul 07 17:55:16.303242 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:16.303220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z" event={"ID":"bb2372fc-099f-49fe-8a75-2b8fb06788a2","Type":"ContainerStarted","Data":"48770d3e633e476ccd681bd0ca0f8f408d3f49abc7b2f5c9f806da98445ca948"}
Jul 07 17:55:16.321485 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:16.321462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jpj9k"
Jul 07 17:55:16.469203 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:16.469160    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jpj9k"]
Jul 07 17:55:16.472378 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:16.472334    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517e1774_b586_4e1d_97ae_81f8d8ae987d.slice/crio-beb9dac247c2f19fd27aecc805993d196bf8fe2e13fe148226eb7d981b31fe53 WatchSource:0}: Error finding container beb9dac247c2f19fd27aecc805993d196bf8fe2e13fe148226eb7d981b31fe53: Status 404 returned error can't find the container with id beb9dac247c2f19fd27aecc805993d196bf8fe2e13fe148226eb7d981b31fe53
Jul 07 17:55:17.314442 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:17.314407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpj9k" event={"ID":"517e1774-b586-4e1d-97ae-81f8d8ae987d","Type":"ContainerStarted","Data":"beb9dac247c2f19fd27aecc805993d196bf8fe2e13fe148226eb7d981b31fe53"}
Jul 07 17:55:17.636272 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:17.636184    2576 patch_prober.go:28] interesting pod/image-registry-84f65f4d98-77gnh container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 17:55:17.636723 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:17.636256    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh" podUID="ee5407fa-d7e6-45f2-ba09-95ee55262caf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:55:19.203372 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.203314    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88b8974f6-pp9d4"]
Jul 07 17:55:19.206032 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.206008    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.215726 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.215695    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 17:55:19.220913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.220881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88b8974f6-pp9d4"]
Jul 07 17:55:19.248972 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.248937    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:55:19.364225 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.364166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-trusted-ca-bundle\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.364425 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.364242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-config\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.364499 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.364419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnjtj\" (UniqueName: \"kubernetes.io/projected/7671c93a-9cc2-49fe-b20a-d39ca0035bac-kube-api-access-tnjtj\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.364556 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.364531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-oauth-config\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.364610 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.364580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-oauth-serving-cert\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.364664 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.364613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-serving-cert\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.364664 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.364635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-service-ca\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.465477 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.465383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-config\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.465477 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.465430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnjtj\" (UniqueName: \"kubernetes.io/projected/7671c93a-9cc2-49fe-b20a-d39ca0035bac-kube-api-access-tnjtj\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.465699 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.465486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-oauth-config\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.465699 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.465530    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-oauth-serving-cert\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.465699 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.465565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-serving-cert\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.465699 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.465590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-service-ca\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.465699 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.465637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-trusted-ca-bundle\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.466158 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.466134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-config\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.466535 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.466513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-oauth-serving-cert\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.466595 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.466549    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-trusted-ca-bundle\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.466674 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.466644    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-service-ca\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.468385 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.468366    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-oauth-config\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.468603 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.468580    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-serving-cert\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.476902 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.476867    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnjtj\" (UniqueName: \"kubernetes.io/projected/7671c93a-9cc2-49fe-b20a-d39ca0035bac-kube-api-access-tnjtj\") pod \"console-88b8974f6-pp9d4\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") " pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:19.516748 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:19.516705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:22.465913 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:22.465881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88b8974f6-pp9d4"]
Jul 07 17:55:22.468459 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:22.468424    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7671c93a_9cc2_49fe_b20a_d39ca0035bac.slice/crio-2ec5ace8938d104c08687673f20ee7664469b44a76310ee2d0c8de3fdd0adc9c WatchSource:0}: Error finding container 2ec5ace8938d104c08687673f20ee7664469b44a76310ee2d0c8de3fdd0adc9c: Status 404 returned error can't find the container with id 2ec5ace8938d104c08687673f20ee7664469b44a76310ee2d0c8de3fdd0adc9c
Jul 07 17:55:23.338452 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.338408    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fbf55f9d-rh7bn" event={"ID":"f248bf6f-b006-4214-a0c5-627cce7b6554","Type":"ContainerStarted","Data":"db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8"}
Jul 07 17:55:23.340130 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.340100    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpj9k" event={"ID":"517e1774-b586-4e1d-97ae-81f8d8ae987d","Type":"ContainerStarted","Data":"f08032be3e820125d255ed097a0f116356039eb367311563c04a773c7947bb87"}
Jul 07 17:55:23.340271 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.340158    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpj9k" event={"ID":"517e1774-b586-4e1d-97ae-81f8d8ae987d","Type":"ContainerStarted","Data":"e01f5f990324a9318112c499bbd503ff2269628c8f31b3be3724c0cd01dcb7c2"}
Jul 07 17:55:23.341396 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.341357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z" event={"ID":"bb2372fc-099f-49fe-8a75-2b8fb06788a2","Type":"ContainerStarted","Data":"726fed3297befcac91d0ecc0b39d4f638ef015f6944212afda89e92597c71cf7"}
Jul 07 17:55:23.342711 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.342690    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88b8974f6-pp9d4" event={"ID":"7671c93a-9cc2-49fe-b20a-d39ca0035bac","Type":"ContainerStarted","Data":"3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60"}
Jul 07 17:55:23.342800 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.342723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88b8974f6-pp9d4" event={"ID":"7671c93a-9cc2-49fe-b20a-d39ca0035bac","Type":"ContainerStarted","Data":"2ec5ace8938d104c08687673f20ee7664469b44a76310ee2d0c8de3fdd0adc9c"}
Jul 07 17:55:23.380488 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.380435    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57fbf55f9d-rh7bn" podStartSLOduration=1.955735469 podStartE2EDuration="8.380417966s" totalImagesPullingTime="6.424682497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:23.380093047 +0000 UTC m=+124.993651750" watchObservedRunningTime="2026-07-07 17:55:23.380417966 +0000 UTC m=+124.993976669"
Jul 07 17:55:23.408676 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.408630    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f654b68fd-78f7z" podStartSLOduration=2.002147509 podStartE2EDuration="8.408614381s" totalImagesPullingTime="6.406466872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:23.408450601 +0000 UTC m=+125.022009307" watchObservedRunningTime="2026-07-07 17:55:23.408614381 +0000 UTC m=+125.022173086"
Jul 07 17:55:23.448908 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:23.448854    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88b8974f6-pp9d4" podStartSLOduration=4.448837692 podStartE2EDuration="4.448837692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:23.448419086 +0000 UTC m=+125.061977813" watchObservedRunningTime="2026-07-07 17:55:23.448837692 +0000 UTC m=+125.062396396"
Jul 07 17:55:25.721753 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:25.721712    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:25.722125 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:25.721800    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:25.726542 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:25.726519    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:26.354848 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:26.354807    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jpj9k" event={"ID":"517e1774-b586-4e1d-97ae-81f8d8ae987d","Type":"ContainerStarted","Data":"6b1fa25a43025a65b109abb3561c2761e66b38eff6204bc7f124292800191c5f"}
Jul 07 17:55:26.358807 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:26.358777    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:26.378449 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:26.378398    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jpj9k" podStartSLOduration=33.457186327 podStartE2EDuration="42.378382294s" totalImagesPullingTime="8.921195967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:54:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:26.37710704 +0000 UTC m=+127.990665744" watchObservedRunningTime="2026-07-07 17:55:26.378382294 +0000 UTC m=+127.991940998"
Jul 07 17:55:28.744127 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:28.744085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:55:28.746876 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:28.746844    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/846d5a7d-2747-4366-9a12-e6ddd997edb5-metrics-certs\") pod \"network-metrics-daemon-rlj2h\" (UID: \"846d5a7d-2747-4366-9a12-e6ddd997edb5\") " pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:55:29.011474 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.011384    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lgh52\""
Jul 07 17:55:29.018994 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.018963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rlj2h"
Jul 07 17:55:29.148717 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.148558    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"]
Jul 07 17:55:29.152861 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.152838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.157817 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.157789    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 17:55:29.157817 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.157806    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-462k5\""
Jul 07 17:55:29.158067 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.158050    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 17:55:29.160159 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.159972    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 17:55:29.160159 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.160070    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 17:55:29.163536 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.163513    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 17:55:29.170478 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.170451    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"]
Jul 07 17:55:29.172926 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.172903    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"]
Jul 07 17:55:29.176468 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.176443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.182246 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.181531    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 17:55:29.182246 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.181539    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fmchx\""
Jul 07 17:55:29.182986 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.182377    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 17:55:29.182986 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.182695    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 17:55:29.184307 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.184124    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rlj2h"]
Jul 07 17:55:29.188153 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:29.188133    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846d5a7d_2747_4366_9a12_e6ddd997edb5.slice/crio-498191cf9f5ae392a6e6447ff3b3f9c3002d7e5e4d68a0e8a520bdcbad0e5fc3 WatchSource:0}: Error finding container 498191cf9f5ae392a6e6447ff3b3f9c3002d7e5e4d68a0e8a520bdcbad0e5fc3: Status 404 returned error can't find the container with id 498191cf9f5ae392a6e6447ff3b3f9c3002d7e5e4d68a0e8a520bdcbad0e5fc3
Jul 07 17:55:29.197137 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.197044    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"]
Jul 07 17:55:29.247907 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.247875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ksc\" (UniqueName: \"kubernetes.io/projected/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-api-access-42ksc\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.247907 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.247911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nslp\" (UniqueName: \"kubernetes.io/projected/9f714cf5-eac5-474a-bdee-7b597a98f49e-kube-api-access-8nslp\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.248164 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.247932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.248164 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.247976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.248164 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.248076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/246c2574-44f0-4e72-a3ae-c187f3792de3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.248164 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.248148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.248404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.248173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.248404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.248197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/246c2574-44f0-4e72-a3ae-c187f3792de3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.248404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.248224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.248404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.248267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f714cf5-eac5-474a-bdee-7b597a98f49e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.284911 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.284826    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zdnq7"]
Jul 07 17:55:29.288185 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.288167    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.291621 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.291597    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 17:55:29.291855 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.291840    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 17:55:29.291959 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.291890    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f26r6\""
Jul 07 17:55:29.292579 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.292562    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 17:55:29.348848 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.348808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-root\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349033 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.348873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349033 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.348923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvfxt\" (UniqueName: \"kubernetes.io/projected/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-kube-api-access-xvfxt\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349033 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.348963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.349033 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.348991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/246c2574-44f0-4e72-a3ae-c187f3792de3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.349033 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-sys\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349033 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-wtmp\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349291 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349291 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-tls\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349291 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:29.349081    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 07 17:55:29.349291 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:29.349159    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-tls podName:9f714cf5-eac5-474a-bdee-7b597a98f49e nodeName:}" failed. No retries permitted until 2026-07-07 17:55:29.849137138 +0000 UTC m=+131.462695825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-rj8h8" (UID: "9f714cf5-eac5-474a-bdee-7b597a98f49e") : secret "openshift-state-metrics-tls" not found
Jul 07 17:55:29.349291 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.349291 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/246c2574-44f0-4e72-a3ae-c187f3792de3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:29.349331    2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-textfile\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:29.349428    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls podName:246c2574-44f0-4e72-a3ae-c187f3792de3 nodeName:}" failed. No retries permitted until 2026-07-07 17:55:29.84939559 +0000 UTC m=+131.462954274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-mfn2x" (UID: "246c2574-44f0-4e72-a3ae-c187f3792de3") : secret "kube-state-metrics-tls" not found
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f714cf5-eac5-474a-bdee-7b597a98f49e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ksc\" (UniqueName: \"kubernetes.io/projected/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-api-access-42ksc\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349551    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-metrics-client-ca\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nslp\" (UniqueName: \"kubernetes.io/projected/9f714cf5-eac5-474a-bdee-7b597a98f49e-kube-api-access-8nslp\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.349633 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/246c2574-44f0-4e72-a3ae-c187f3792de3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.350171 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.349901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.350171 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.350124    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/246c2574-44f0-4e72-a3ae-c187f3792de3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.350279 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.350232    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f714cf5-eac5-474a-bdee-7b597a98f49e-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.350804 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.350781    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.352025 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.351994    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.352164 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.352143    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.365305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.365267    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlj2h" event={"ID":"846d5a7d-2747-4366-9a12-e6ddd997edb5","Type":"ContainerStarted","Data":"498191cf9f5ae392a6e6447ff3b3f9c3002d7e5e4d68a0e8a520bdcbad0e5fc3"}
Jul 07 17:55:29.373315 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.373292    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ksc\" (UniqueName: \"kubernetes.io/projected/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-api-access-42ksc\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.373521 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.373503    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nslp\" (UniqueName: \"kubernetes.io/projected/9f714cf5-eac5-474a-bdee-7b597a98f49e-kube-api-access-8nslp\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.450656 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-sys\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.450851 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-wtmp\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.450851 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.450851 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450723    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-tls\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.450851 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450728    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-sys\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.450851 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-textfile\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.450851 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-metrics-client-ca\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.451142 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-root\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.451142 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450910    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-wtmp\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.451142 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450925    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.451142 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvfxt\" (UniqueName: \"kubernetes.io/projected/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-kube-api-access-xvfxt\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.451142 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.450968    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-root\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.451422 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.451315    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-textfile\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.451578 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.451560    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-metrics-client-ca\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.451694 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.451673    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-accelerators-collector-config\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.453627 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.453612    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-tls\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.453737 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.453720    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.467133 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.467101    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvfxt\" (UniqueName: \"kubernetes.io/projected/f5c8f988-ee3a-47cf-b70c-9995ad7f2284-kube-api-access-xvfxt\") pod \"node-exporter-zdnq7\" (UID: \"f5c8f988-ee3a-47cf-b70c-9995ad7f2284\") " pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.516967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.516930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:29.517159 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.517002    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:29.521944 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.521919    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:29.598338 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.598306    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zdnq7"
Jul 07 17:55:29.611689 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:29.611645    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c8f988_ee3a_47cf_b70c_9995ad7f2284.slice/crio-d5d4d55e69fa27e77443b556bacd373fa27adcd5df09123aec4387d0bf39cdd6 WatchSource:0}: Error finding container d5d4d55e69fa27e77443b556bacd373fa27adcd5df09123aec4387d0bf39cdd6: Status 404 returned error can't find the container with id d5d4d55e69fa27e77443b556bacd373fa27adcd5df09123aec4387d0bf39cdd6
Jul 07 17:55:29.855104 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.855014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:29.855104 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.855091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:29.855594 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:29.855232    2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 07 17:55:29.855594 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:29.855326    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls podName:246c2574-44f0-4e72-a3ae-c187f3792de3 nodeName:}" failed. No retries permitted until 2026-07-07 17:55:30.855303276 +0000 UTC m=+132.468861961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-mfn2x" (UID: "246c2574-44f0-4e72-a3ae-c187f3792de3") : secret "kube-state-metrics-tls" not found
Jul 07 17:55:29.858127 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:29.858097    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f714cf5-eac5-474a-bdee-7b597a98f49e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-rj8h8\" (UID: \"9f714cf5-eac5-474a-bdee-7b597a98f49e\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:30.070996 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.070959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"
Jul 07 17:55:30.279526 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.277412    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:55:30.285082 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.282876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.286504 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.286475    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 17:55:30.287122 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.287091    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 17:55:30.287577 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.287542    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 17:55:30.287819 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.287802    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 17:55:30.288773 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.288734    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 17:55:30.288969 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.288950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 17:55:30.289153 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.289135    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 17:55:30.289492 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.289475    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 17:55:30.289642 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.289628    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kb7sn\""
Jul 07 17:55:30.289793 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.289762    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 17:55:30.307018 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.306961    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:55:30.347270 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.347233    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8"]
Jul 07 17:55:30.347463 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:30.347363    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f714cf5_eac5_474a_bdee_7b597a98f49e.slice/crio-1ed95f4a7d1d415e8857eb42937dabedb8e7b3fcd1f1c32ac6ba011cd2775848 WatchSource:0}: Error finding container 1ed95f4a7d1d415e8857eb42937dabedb8e7b3fcd1f1c32ac6ba011cd2775848: Status 404 returned error can't find the container with id 1ed95f4a7d1d415e8857eb42937dabedb8e7b3fcd1f1c32ac6ba011cd2775848
Jul 07 17:55:30.360096 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360209 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360209 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360338 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360338 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360338 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zldrm\" (UniqueName: \"kubernetes.io/projected/e794fea3-0d81-4a78-8946-dede5c142c1e-kube-api-access-zldrm\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e794fea3-0d81-4a78-8946-dede5c142c1e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360652 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360652 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360652 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e794fea3-0d81-4a78-8946-dede5c142c1e-config-out\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.360652 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.360636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-web-config\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.373210 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.373128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8" event={"ID":"9f714cf5-eac5-474a-bdee-7b597a98f49e","Type":"ContainerStarted","Data":"1ed95f4a7d1d415e8857eb42937dabedb8e7b3fcd1f1c32ac6ba011cd2775848"}
Jul 07 17:55:30.374561 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.374502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdnq7" event={"ID":"f5c8f988-ee3a-47cf-b70c-9995ad7f2284","Type":"ContainerStarted","Data":"d5d4d55e69fa27e77443b556bacd373fa27adcd5df09123aec4387d0bf39cdd6"}
Jul 07 17:55:30.378296 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.377752    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlj2h" event={"ID":"846d5a7d-2747-4366-9a12-e6ddd997edb5","Type":"ContainerStarted","Data":"2f3b9ab6672d139ec5eb523b8423daa32ef0d6a97309ad910a5561690c9897d9"}
Jul 07 17:55:30.384166 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.384059    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e794fea3-0d81-4a78-8946-dede5c142c1e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e794fea3-0d81-4a78-8946-dede5c142c1e-config-out\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-web-config\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.462985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.463088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.463145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.463174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.463201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.463205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zldrm\" (UniqueName: \"kubernetes.io/projected/e794fea3-0d81-4a78-8946-dede5c142c1e-kube-api-access-zldrm\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.467282 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.467248    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fbf55f9d-rh7bn"]
Jul 07 17:55:30.468819 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:30.468487    2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 07 17:55:30.468819 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:30.468551    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-main-tls podName:e794fea3-0d81-4a78-8946-dede5c142c1e nodeName:}" failed. No retries permitted until 2026-07-07 17:55:30.968531474 +0000 UTC m=+132.582090162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e794fea3-0d81-4a78-8946-dede5c142c1e") : secret "alertmanager-main-tls" not found
Jul 07 17:55:30.468819 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:30.468761    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-trusted-ca-bundle podName:e794fea3-0d81-4a78-8946-dede5c142c1e nodeName:}" failed. No retries permitted until 2026-07-07 17:55:30.968742676 +0000 UTC m=+132.582301368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e794fea3-0d81-4a78-8946-dede5c142c1e") : configmap references non-existent config key: ca-bundle.crt
Jul 07 17:55:30.469050 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.469022    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.470130 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.469902    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.470130 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.469954    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.474251 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.473717    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-web-config\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.474251 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.473767    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.474251 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.474078    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e794fea3-0d81-4a78-8946-dede5c142c1e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.474251 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.474179    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.475026 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.474958    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.475438 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.475415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.477164 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.477114    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e794fea3-0d81-4a78-8946-dede5c142c1e-config-out\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.501879 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.501852    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zldrm\" (UniqueName: \"kubernetes.io/projected/e794fea3-0d81-4a78-8946-dede5c142c1e-kube-api-access-zldrm\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:30.866789 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.866764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:30.869094 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.869071    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/246c2574-44f0-4e72-a3ae-c187f3792de3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mfn2x\" (UID: \"246c2574-44f0-4e72-a3ae-c187f3792de3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:30.988537 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:30.988498    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"
Jul 07 17:55:31.068821 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.068760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:31.069001 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.068902    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:31.069799 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.069682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e794fea3-0d81-4a78-8946-dede5c142c1e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:31.072058 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.072038    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e794fea3-0d81-4a78-8946-dede5c142c1e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e794fea3-0d81-4a78-8946-dede5c142c1e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:31.172168 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.172128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x"]
Jul 07 17:55:31.176088 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:31.176056    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246c2574_44f0_4e72_a3ae_c187f3792de3.slice/crio-5bc75cd7fdb0a6877f978691595c1635e2c39df73159e3431dbae9d7577ba022 WatchSource:0}: Error finding container 5bc75cd7fdb0a6877f978691595c1635e2c39df73159e3431dbae9d7577ba022: Status 404 returned error can't find the container with id 5bc75cd7fdb0a6877f978691595c1635e2c39df73159e3431dbae9d7577ba022
Jul 07 17:55:31.198819 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.198787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:55:31.384451 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.384320    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8" event={"ID":"9f714cf5-eac5-474a-bdee-7b597a98f49e","Type":"ContainerStarted","Data":"4c2cf3e4618bfb1e6252ad447a60e9b97f9d089fa77377ed92f99be9017482b8"}
Jul 07 17:55:31.384617 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.384495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8" event={"ID":"9f714cf5-eac5-474a-bdee-7b597a98f49e","Type":"ContainerStarted","Data":"05c5d6bcd8a87f7bc9d9f27dce7f9046d779593a3c841ee8e64c05f03d223d6f"}
Jul 07 17:55:31.386218 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.386187    2576 generic.go:356] "Generic (PLEG): container finished" podID="f5c8f988-ee3a-47cf-b70c-9995ad7f2284" containerID="a38f96ed2bf6e988d0710a5a526bbefb4a5ef2e975971147127166562c58cd29" exitCode=0
Jul 07 17:55:31.386437 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.386407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdnq7" event={"ID":"f5c8f988-ee3a-47cf-b70c-9995ad7f2284","Type":"ContainerDied","Data":"a38f96ed2bf6e988d0710a5a526bbefb4a5ef2e975971147127166562c58cd29"}
Jul 07 17:55:31.387760 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.387733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x" event={"ID":"246c2574-44f0-4e72-a3ae-c187f3792de3","Type":"ContainerStarted","Data":"5bc75cd7fdb0a6877f978691595c1635e2c39df73159e3431dbae9d7577ba022"}
Jul 07 17:55:31.390015 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.389984    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rlj2h" event={"ID":"846d5a7d-2747-4366-9a12-e6ddd997edb5","Type":"ContainerStarted","Data":"1e84cbe6e64c066f67813ab23932c12577a175dd0b02c31f3c734a35ad748922"}
Jul 07 17:55:31.393706 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.393632    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:55:31.469844 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:31.469756    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rlj2h" podStartSLOduration=131.443469958 podStartE2EDuration="2m12.469732991s" totalImagesPullingTime="1.026263033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:31.469578541 +0000 UTC m=+133.083137246" watchObservedRunningTime="2026-07-07 17:55:31.469732991 +0000 UTC m=+133.083291698"
Jul 07 17:55:31.480739 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:31.480696    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode794fea3_0d81_4a78_8946_dede5c142c1e.slice/crio-d4972cef659d2e1b1208b1d1eddf1d9e0b27bb23c60688ec53959574c9dd164e WatchSource:0}: Error finding container d4972cef659d2e1b1208b1d1eddf1d9e0b27bb23c60688ec53959574c9dd164e: Status 404 returned error can't find the container with id d4972cef659d2e1b1208b1d1eddf1d9e0b27bb23c60688ec53959574c9dd164e
Jul 07 17:55:32.398287 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:32.398248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8" event={"ID":"9f714cf5-eac5-474a-bdee-7b597a98f49e","Type":"ContainerStarted","Data":"f940abe71ba372a01207920c0c091f16232bcdc4ee913ca1dc26d025d008744b"}
Jul 07 17:55:32.401817 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:32.401779    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdnq7" event={"ID":"f5c8f988-ee3a-47cf-b70c-9995ad7f2284","Type":"ContainerStarted","Data":"abac2e38ff219761c6752556bb1b4a0526f029f650bb516de1788d509dd38fdf"}
Jul 07 17:55:32.401994 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:32.401846    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zdnq7" event={"ID":"f5c8f988-ee3a-47cf-b70c-9995ad7f2284","Type":"ContainerStarted","Data":"39ecf171641de9456dc7a5f3864cb9fe7d670a8511ec219d45eb868d0b1e78ae"}
Jul 07 17:55:32.404131 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:32.404099    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e794fea3-0d81-4a78-8946-dede5c142c1e","Type":"ContainerStarted","Data":"d4972cef659d2e1b1208b1d1eddf1d9e0b27bb23c60688ec53959574c9dd164e"}
Jul 07 17:55:32.437756 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:32.437689    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-rj8h8" podStartSLOduration=2.42412244 podStartE2EDuration="3.437666699s" totalImagesPullingTime="1.013544259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:32.436829356 +0000 UTC m=+134.050388064" watchObservedRunningTime="2026-07-07 17:55:32.437666699 +0000 UTC m=+134.051225577"
Jul 07 17:55:32.482109 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:32.482043    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zdnq7" podStartSLOduration=2.218858287 podStartE2EDuration="3.482019749s" totalImagesPullingTime="1.19083878s" totalInitContainerRuntime="72.322682ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:32.480411437 +0000 UTC m=+134.093970171" watchObservedRunningTime="2026-07-07 17:55:32.482019749 +0000 UTC m=+134.095578455"
Jul 07 17:55:33.409268 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.409229    2576 generic.go:356] "Generic (PLEG): container finished" podID="e794fea3-0d81-4a78-8946-dede5c142c1e" containerID="064131d91ec70cb570bc4c59f8912102668716c4871a994bddb42a722ac55ce1" exitCode=0
Jul 07 17:55:33.409720 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.409319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e794fea3-0d81-4a78-8946-dede5c142c1e","Type":"ContainerDied","Data":"064131d91ec70cb570bc4c59f8912102668716c4871a994bddb42a722ac55ce1"}
Jul 07 17:55:33.411683 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.411649    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x" event={"ID":"246c2574-44f0-4e72-a3ae-c187f3792de3","Type":"ContainerStarted","Data":"b10a38bf9eeb2aea0a0e3b57ee061ade4e135dc890ecfa44abcfccbdc7de3c72"}
Jul 07 17:55:33.411775 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.411699    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x" event={"ID":"246c2574-44f0-4e72-a3ae-c187f3792de3","Type":"ContainerStarted","Data":"b08a93aecf9e4748b6564d9dea884dad1ccd5c97fc2590211a1e41cf1da36cb2"}
Jul 07 17:55:33.411775 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.411720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x" event={"ID":"246c2574-44f0-4e72-a3ae-c187f3792de3","Type":"ContainerStarted","Data":"428e5009dc999df5712643501b16b9fc87cbaf57289322d76f823f74004501ba"}
Jul 07 17:55:33.550888 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.550783    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mfn2x" podStartSLOduration=2.763676679 podStartE2EDuration="4.550765136s" totalImagesPullingTime="1.787088457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:33.549472165 +0000 UTC m=+135.163030916" watchObservedRunningTime="2026-07-07 17:55:33.550765136 +0000 UTC m=+135.164323866"
Jul 07 17:55:33.777802 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.777762    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"]
Jul 07 17:55:33.781064 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.781042    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.784936 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.784911    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 17:55:33.785064 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.784912    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 07 17:55:33.785064 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.784965    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6pjprtrqbamr1\""
Jul 07 17:55:33.785185 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.785080    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-927lr\""
Jul 07 17:55:33.785231 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.785183    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 07 17:55:33.785275 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.785184    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 07 17:55:33.805749 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.805663    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"]
Jul 07 17:55:33.834938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.834903    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-786676845-8fwxp"]
Jul 07 17:55:33.838293 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.838266    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.865496 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.865460    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786676845-8fwxp"]
Jul 07 17:55:33.897853 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.897823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-service-ca\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.898057 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.897863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pwb\" (UniqueName: \"kubernetes.io/projected/1b9250aa-8a6b-47e4-895f-c5180ee2174f-kube-api-access-z9pwb\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.898057 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.897886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-client-ca-bundle\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.898057 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.897914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-serving-cert\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.898057 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.897936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-secret-metrics-server-tls\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.898057 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.897958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b9250aa-8a6b-47e4-895f-c5180ee2174f-audit-log\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.898057 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.898026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvdml\" (UniqueName: \"kubernetes.io/projected/5848ae30-da04-44f6-a895-6bbcccc90aba-kube-api-access-zvdml\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.898391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.898089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-secret-metrics-server-client-certs\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.898391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.898110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-trusted-ca-bundle\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.898391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.898163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9250aa-8a6b-47e4-895f-c5180ee2174f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.898391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.898179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b9250aa-8a6b-47e4-895f-c5180ee2174f-metrics-server-audit-profiles\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.898391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.898197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-console-config\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.898391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.898219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-oauth-config\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.898391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.898236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-oauth-serving-cert\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.998874 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.998832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9250aa-8a6b-47e4-895f-c5180ee2174f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.999076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.998881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b9250aa-8a6b-47e4-895f-c5180ee2174f-metrics-server-audit-profiles\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.999076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.998912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-console-config\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.999076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.998940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-oauth-config\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.999076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.998964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-oauth-serving-cert\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.999076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.998991    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-service-ca\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.999076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pwb\" (UniqueName: \"kubernetes.io/projected/1b9250aa-8a6b-47e4-895f-c5180ee2174f-kube-api-access-z9pwb\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.999076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-client-ca-bundle\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.999475 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999096    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-serving-cert\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.999475 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-secret-metrics-server-tls\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.999475 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b9250aa-8a6b-47e4-895f-c5180ee2174f-audit-log\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.999475 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvdml\" (UniqueName: \"kubernetes.io/projected/5848ae30-da04-44f6-a895-6bbcccc90aba-kube-api-access-zvdml\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.999475 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-secret-metrics-server-client-certs\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.999475 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-trusted-ca-bundle\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.999763 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999747    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-service-ca\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:33.999815 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999756    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9250aa-8a6b-47e4-895f-c5180ee2174f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:33.999815 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:33.999747    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-console-config\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:34.000267 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.000243    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-trusted-ca-bundle\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:34.000638 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.000613    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1b9250aa-8a6b-47e4-895f-c5180ee2174f-metrics-server-audit-profiles\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:34.000811 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.000641    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-oauth-serving-cert\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:34.000999 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.000977    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1b9250aa-8a6b-47e4-895f-c5180ee2174f-audit-log\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:34.002089 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.002058    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-oauth-config\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:34.002612 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.002590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-secret-metrics-server-tls\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:34.002865 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.002845    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-client-ca-bundle\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:34.002970 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.002947    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1b9250aa-8a6b-47e4-895f-c5180ee2174f-secret-metrics-server-client-certs\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:34.003428 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.003407    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-serving-cert\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:34.018282 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.018243    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pwb\" (UniqueName: \"kubernetes.io/projected/1b9250aa-8a6b-47e4-895f-c5180ee2174f-kube-api-access-z9pwb\") pod \"metrics-server-6c6bdf99b9-fgz5z\" (UID: \"1b9250aa-8a6b-47e4-895f-c5180ee2174f\") " pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:34.019855 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.019832    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvdml\" (UniqueName: \"kubernetes.io/projected/5848ae30-da04-44f6-a895-6bbcccc90aba-kube-api-access-zvdml\") pod \"console-786676845-8fwxp\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") " pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:34.090985 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.090948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:34.147518 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.147481    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:34.258967 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.258928    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"]
Jul 07 17:55:34.263860 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:34.263829    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9250aa_8a6b_47e4_895f_c5180ee2174f.slice/crio-7a1fb6de6c0f682481d5f89fbd2da99941aac84c6c3f7de721b9ee82a4ff6223 WatchSource:0}: Error finding container 7a1fb6de6c0f682481d5f89fbd2da99941aac84c6c3f7de721b9ee82a4ff6223: Status 404 returned error can't find the container with id 7a1fb6de6c0f682481d5f89fbd2da99941aac84c6c3f7de721b9ee82a4ff6223
Jul 07 17:55:34.332660 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.332626    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786676845-8fwxp"]
Jul 07 17:55:34.335207 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:34.335181    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5848ae30_da04_44f6_a895_6bbcccc90aba.slice/crio-709269414b0bf5daecd298416cb31625c5f5fc851bd807ac6ef1269e89927cbf WatchSource:0}: Error finding container 709269414b0bf5daecd298416cb31625c5f5fc851bd807ac6ef1269e89927cbf: Status 404 returned error can't find the container with id 709269414b0bf5daecd298416cb31625c5f5fc851bd807ac6ef1269e89927cbf
Jul 07 17:55:34.418448 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.418414    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786676845-8fwxp" event={"ID":"5848ae30-da04-44f6-a895-6bbcccc90aba","Type":"ContainerStarted","Data":"709269414b0bf5daecd298416cb31625c5f5fc851bd807ac6ef1269e89927cbf"}
Jul 07 17:55:34.420220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:34.420188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z" event={"ID":"1b9250aa-8a6b-47e4-895f-c5180ee2174f","Type":"ContainerStarted","Data":"7a1fb6de6c0f682481d5f89fbd2da99941aac84c6c3f7de721b9ee82a4ff6223"}
Jul 07 17:55:35.427591 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.427556    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e794fea3-0d81-4a78-8946-dede5c142c1e","Type":"ContainerStarted","Data":"fe5e17b2d4b38356d226d4e57e7bc7cc34242923925097115bcb7b33bb938e57"}
Jul 07 17:55:35.429183 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.429142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786676845-8fwxp" event={"ID":"5848ae30-da04-44f6-a895-6bbcccc90aba","Type":"ContainerStarted","Data":"71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026"}
Jul 07 17:55:35.451829 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.451756    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-786676845-8fwxp" podStartSLOduration=2.451732044 podStartE2EDuration="2.451732044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:35.450092976 +0000 UTC m=+137.063651698" watchObservedRunningTime="2026-07-07 17:55:35.451732044 +0000 UTC m=+137.065290751"
Jul 07 17:55:35.861965 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.861933    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:55:35.866044 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.866018    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.873718 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.873535    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 17:55:35.875686 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.875637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m7cd5\""
Jul 07 17:55:35.876167 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.875985    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 17:55:35.876659 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.876613    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 17:55:35.877773 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.877745    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 17:55:35.878473 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.877866    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 17:55:35.878473 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.877868    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 17:55:35.878473 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.877906    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 17:55:35.878473 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.877945    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 17:55:35.878473 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.878080    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-oh5m4q55a0a7\""
Jul 07 17:55:35.878473 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.878243    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 17:55:35.878473 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.878263    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 17:55:35.879130 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.879108    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 17:55:35.879538 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.879521    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 17:55:35.883670 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.883646    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 17:55:35.885048 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.884938    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 17:55:35.910592 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.910512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:55:35.917322 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917466 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-config\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917466 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917466 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917466 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917682 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917682 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917682 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917682 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917682 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917682 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.917682 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.918017 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfcjm\" (UniqueName: \"kubernetes.io/projected/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-kube-api-access-kfcjm\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.918017 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.918017 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.918017 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.918017 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.918017 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.918017 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:35.918017 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:35.917938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018629 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfcjm\" (UniqueName: \"kubernetes.io/projected/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-kube-api-access-kfcjm\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018744 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018744 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018744 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.018938 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-config\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.018997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.019037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.019092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.019124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.019155    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.019187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019220 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.019219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.019662 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.019262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.021820 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.019995    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.021820 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.020020    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.021820 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.020572    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.021820 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.021193    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.023010 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.022985    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.024279 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.023745    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.024435 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.024209    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.024889 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.024863    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.025256 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.025231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.025630 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.025460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-web-config\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.026334 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.026314    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.027802 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.027079    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-config-out\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.027802 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.027706    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.028127 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.028084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-config\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.029131 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.029109    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.029131 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.029121    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.029630 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.029590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.030104 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.030024    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.030496 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.030389    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.032206 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.032148    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfcjm\" (UniqueName: \"kubernetes.io/projected/4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57-kube-api-access-kfcjm\") pod \"prometheus-k8s-0\" (UID: \"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.191077 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.191046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:36.349902 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.349864    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 17:55:36.353377 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:55:36.353313    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6cfc6a_8f64_4acb_8ce9_a4ba709d5d57.slice/crio-1857274573ff9a430d053a76f7b6cb5e001d2fe02c78dc909997dbb575bd4dc8 WatchSource:0}: Error finding container 1857274573ff9a430d053a76f7b6cb5e001d2fe02c78dc909997dbb575bd4dc8: Status 404 returned error can't find the container with id 1857274573ff9a430d053a76f7b6cb5e001d2fe02c78dc909997dbb575bd4dc8
Jul 07 17:55:36.444585 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.444549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e794fea3-0d81-4a78-8946-dede5c142c1e","Type":"ContainerStarted","Data":"dc8ca421f54db27de8a4185d6a64e269fb1c3dd03ad44c1ee2863bf724f3e8a4"}
Jul 07 17:55:36.445010 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.444652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e794fea3-0d81-4a78-8946-dede5c142c1e","Type":"ContainerStarted","Data":"e04fd41438385764c2edef068169b1cc5cb58ed886ce74c8f04c21eff9514206"}
Jul 07 17:55:36.445010 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.444685    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e794fea3-0d81-4a78-8946-dede5c142c1e","Type":"ContainerStarted","Data":"70c998790d9f06daf4e747a1f120445813e7a96c38b35fdc453ba1bc98f8d596"}
Jul 07 17:55:36.445010 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.444710    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e794fea3-0d81-4a78-8946-dede5c142c1e","Type":"ContainerStarted","Data":"0d9d77f6f04e0ba9ec278b888b01fb5fb228ff9278ea0716987f35c9d8a1f344"}
Jul 07 17:55:36.446253 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.446224    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerStarted","Data":"45b1732cf8aa6b0bbfe6e0368e2cd9c43b21f9cb9984e88a63f7670eb3ded67c"}
Jul 07 17:55:36.446389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.446292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerStarted","Data":"1857274573ff9a430d053a76f7b6cb5e001d2fe02c78dc909997dbb575bd4dc8"}
Jul 07 17:55:36.448035 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.448014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z" event={"ID":"1b9250aa-8a6b-47e4-895f-c5180ee2174f","Type":"ContainerStarted","Data":"a5224a8dae3df4990beb8cd7c5ce4b1709caebfb6584157ebbaa7d471706af8c"}
Jul 07 17:55:36.500562 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:36.500507    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z" podStartSLOduration=1.970835552 podStartE2EDuration="3.50049083s" totalImagesPullingTime="1.529655278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:36.498793835 +0000 UTC m=+138.112352559" watchObservedRunningTime="2026-07-07 17:55:36.50049083 +0000 UTC m=+138.114049533"
Jul 07 17:55:37.243788 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:37.243750    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84f65f4d98-77gnh"]
Jul 07 17:55:37.455105 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:37.455010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e794fea3-0d81-4a78-8946-dede5c142c1e","Type":"ContainerStarted","Data":"36e35435fbbdff21f7b875ac819cabce1fc147e39b717b2885a7656ce6208a71"}
Jul 07 17:55:37.456587 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:37.456567    2576 generic.go:356] "Generic (PLEG): container finished" podID="4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57" containerID="45b1732cf8aa6b0bbfe6e0368e2cd9c43b21f9cb9984e88a63f7670eb3ded67c" exitCode=0
Jul 07 17:55:37.456671 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:37.456652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerDied","Data":"45b1732cf8aa6b0bbfe6e0368e2cd9c43b21f9cb9984e88a63f7670eb3ded67c"}
Jul 07 17:55:37.491038 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:37.490985    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.980060418 podStartE2EDuration="7.490969248s" totalImagesPullingTime="4.492803915s" totalInitContainerRuntime="18.104915ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:37.490060071 +0000 UTC m=+139.103618799" watchObservedRunningTime="2026-07-07 17:55:37.490969248 +0000 UTC m=+139.104527951"
Jul 07 17:55:41.476788 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:41.476754    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerStarted","Data":"916fdffe981dbfb2f4632dd8e97dc75e72ba5d62047af0e6bf9a07fd61cb8681"}
Jul 07 17:55:41.477155 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:41.476851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerStarted","Data":"068f6560922ed652f1ceab23a441a19ed4726c10432f57ce20ef78dff1eb507c"}
Jul 07 17:55:43.488018 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:43.487982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerStarted","Data":"c8d9b94b8a05742d338d718f5525632cb23b9a76613b2a82e710320477d3fdd2"}
Jul 07 17:55:43.488404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:43.488053    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerStarted","Data":"7afe0cd5895edcfee8f3bc683834e4f1a69c95061a5aaa88ee2bde8a95e2313e"}
Jul 07 17:55:43.488404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:43.488083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerStarted","Data":"6a6e347440112c60090b96ef0ce0b6ce6fddeaf414a8a34b1fc94ffd5ac7f45c"}
Jul 07 17:55:43.488404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:43.488111    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57","Type":"ContainerStarted","Data":"0f91b70f4e3044da0dd1f2065e06b976caaf1f83622edd7fb63fde7ecb055260"}
Jul 07 17:55:44.148732 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:44.148694    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:44.148877 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:44.148772    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:44.153398 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:44.153374    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:44.180741 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:44.180666    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.75626997 podStartE2EDuration="9.18064887s" totalImagesPullingTime="5.407231782s" totalInitContainerRuntime="17.147118ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:55:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:55:43.528640472 +0000 UTC m=+145.142199237" watchObservedRunningTime="2026-07-07 17:55:44.18064887 +0000 UTC m=+145.794207573"
Jul 07 17:55:44.496302 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:44.496220    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:55:44.591264 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:44.591226    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88b8974f6-pp9d4"]
Jul 07 17:55:46.192037 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:46.191978    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:55:54.091712 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:54.091667    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:54.092168 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:54.091773    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:55:55.505393 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:55.505301    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-57fbf55f9d-rh7bn" podUID="f248bf6f-b006-4214-a0c5-627cce7b6554" containerName="console" containerID="cri-o://db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8" gracePeriod=15
Jul 07 17:55:56.286329 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.286295    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:56.417933 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.417847    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmlvb\" (UniqueName: \"kubernetes.io/projected/f248bf6f-b006-4214-a0c5-627cce7b6554-kube-api-access-nmlvb\") pod \"f248bf6f-b006-4214-a0c5-627cce7b6554\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") "
Jul 07 17:55:56.417933 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.417923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-console-config\") pod \"f248bf6f-b006-4214-a0c5-627cce7b6554\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") "
Jul 07 17:55:56.418122 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.417954    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-oauth-serving-cert\") pod \"f248bf6f-b006-4214-a0c5-627cce7b6554\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") "
Jul 07 17:55:56.418122 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.418041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-serving-cert\") pod \"f248bf6f-b006-4214-a0c5-627cce7b6554\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") "
Jul 07 17:55:56.418122 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.418076    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-oauth-config\") pod \"f248bf6f-b006-4214-a0c5-627cce7b6554\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") "
Jul 07 17:55:56.418270 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.418138    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-service-ca\") pod \"f248bf6f-b006-4214-a0c5-627cce7b6554\" (UID: \"f248bf6f-b006-4214-a0c5-627cce7b6554\") "
Jul 07 17:55:56.418404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.418366    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-console-config" (OuterVolumeSpecName: "console-config") pod "f248bf6f-b006-4214-a0c5-627cce7b6554" (UID: "f248bf6f-b006-4214-a0c5-627cce7b6554"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:55:56.418562 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.418440    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f248bf6f-b006-4214-a0c5-627cce7b6554" (UID: "f248bf6f-b006-4214-a0c5-627cce7b6554"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:55:56.419111 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.419077    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-service-ca" (OuterVolumeSpecName: "service-ca") pod "f248bf6f-b006-4214-a0c5-627cce7b6554" (UID: "f248bf6f-b006-4214-a0c5-627cce7b6554"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:55:56.420533 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.420508    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f248bf6f-b006-4214-a0c5-627cce7b6554" (UID: "f248bf6f-b006-4214-a0c5-627cce7b6554"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:55:56.420631 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.420527    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f248bf6f-b006-4214-a0c5-627cce7b6554" (UID: "f248bf6f-b006-4214-a0c5-627cce7b6554"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:55:56.420631 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.420568    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f248bf6f-b006-4214-a0c5-627cce7b6554-kube-api-access-nmlvb" (OuterVolumeSpecName: "kube-api-access-nmlvb") pod "f248bf6f-b006-4214-a0c5-627cce7b6554" (UID: "f248bf6f-b006-4214-a0c5-627cce7b6554"). InnerVolumeSpecName "kube-api-access-nmlvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:55:56.518878 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.518838    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-serving-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:55:56.518878 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.518869    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f248bf6f-b006-4214-a0c5-627cce7b6554-console-oauth-config\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:55:56.518878 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.518878    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:55:56.518878 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.518888    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmlvb\" (UniqueName: \"kubernetes.io/projected/f248bf6f-b006-4214-a0c5-627cce7b6554-kube-api-access-nmlvb\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:55:56.519379 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.518897    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-console-config\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:55:56.519379 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.518905    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f248bf6f-b006-4214-a0c5-627cce7b6554-oauth-serving-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:55:56.549537 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.549495    2576 generic.go:356] "Generic (PLEG): container finished" podID="f248bf6f-b006-4214-a0c5-627cce7b6554" containerID="db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8" exitCode=0
Jul 07 17:55:56.549707 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.549545    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57fbf55f9d-rh7bn"
Jul 07 17:55:56.549707 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.549579    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fbf55f9d-rh7bn" event={"ID":"f248bf6f-b006-4214-a0c5-627cce7b6554","Type":"ContainerDied","Data":"db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8"}
Jul 07 17:55:56.549707 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.549637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57fbf55f9d-rh7bn" event={"ID":"f248bf6f-b006-4214-a0c5-627cce7b6554","Type":"ContainerDied","Data":"976d34cea675448872292326a2fba0c689f3c01b7e91baab9845f14b676d3e70"}
Jul 07 17:55:56.549707 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.549661    2576 scope.go:117] "RemoveContainer" containerID="db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8"
Jul 07 17:55:56.561196 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.561178    2576 scope.go:117] "RemoveContainer" containerID="db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8"
Jul 07 17:55:56.561529 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:55:56.561508    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8\": container with ID starting with db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8 not found: ID does not exist" containerID="db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8"
Jul 07 17:55:56.561586 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.561538    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8"} err="failed to get container status \"db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8\": rpc error: code = NotFound desc = could not find container \"db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8\": container with ID starting with db93fc27974fce704df64ebf5285774ab538d9174af55bd130a26cc7039702d8 not found: ID does not exist"
Jul 07 17:55:56.577581 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.577549    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57fbf55f9d-rh7bn"]
Jul 07 17:55:56.582541 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.582517    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57fbf55f9d-rh7bn"]
Jul 07 17:55:56.885008 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:55:56.884969    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f248bf6f-b006-4214-a0c5-627cce7b6554" path="/var/lib/kubelet/pods/f248bf6f-b006-4214-a0c5-627cce7b6554/volumes"
Jul 07 17:56:00.145897 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:00.145866    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h4jl9_d268491c-994c-4b1e-91aa-dca256c3c78c/serve-healthcheck-canary/0.log"
Jul 07 17:56:02.270576 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.270533    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh" podUID="ee5407fa-d7e6-45f2-ba09-95ee55262caf" containerName="registry" containerID="cri-o://b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249" gracePeriod=30
Jul 07 17:56:02.529128 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.529061    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:56:02.576997 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.576957    2576 generic.go:356] "Generic (PLEG): container finished" podID="ee5407fa-d7e6-45f2-ba09-95ee55262caf" containerID="b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249" exitCode=0
Jul 07 17:56:02.577178 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577010    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh"
Jul 07 17:56:02.577178 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh" event={"ID":"ee5407fa-d7e6-45f2-ba09-95ee55262caf","Type":"ContainerDied","Data":"b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249"}
Jul 07 17:56:02.577178 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84f65f4d98-77gnh" event={"ID":"ee5407fa-d7e6-45f2-ba09-95ee55262caf","Type":"ContainerDied","Data":"066be3ca69ffc07133b811e5a766bf53c8f0f1b3b96cf43e08a5ddb3d4e7bdd9"}
Jul 07 17:56:02.577178 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577114    2576 scope.go:117] "RemoveContainer" containerID="b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249"
Jul 07 17:56:02.577379 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577302    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-trusted-ca\") pod \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") "
Jul 07 17:56:02.577436 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577380    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm6td\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-kube-api-access-nm6td\") pod \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") "
Jul 07 17:56:02.577436 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577403    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") pod \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") "
Jul 07 17:56:02.577436 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-certificates\") pod \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") "
Jul 07 17:56:02.577578 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577449    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-bound-sa-token\") pod \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") "
Jul 07 17:56:02.577578 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-installation-pull-secrets\") pod \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") "
Jul 07 17:56:02.577578 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577544    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee5407fa-d7e6-45f2-ba09-95ee55262caf-ca-trust-extracted\") pod \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") "
Jul 07 17:56:02.577578 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577573    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-image-registry-private-configuration\") pod \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\" (UID: \"ee5407fa-d7e6-45f2-ba09-95ee55262caf\") "
Jul 07 17:56:02.577911 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.577877    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ee5407fa-d7e6-45f2-ba09-95ee55262caf" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:56:02.578637 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.578615    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ee5407fa-d7e6-45f2-ba09-95ee55262caf" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:56:02.580588 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.580546    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ee5407fa-d7e6-45f2-ba09-95ee55262caf" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:56:02.581014 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.580978    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ee5407fa-d7e6-45f2-ba09-95ee55262caf" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:56:02.581141 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.581119    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ee5407fa-d7e6-45f2-ba09-95ee55262caf" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:56:02.581227 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.581165    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-kube-api-access-nm6td" (OuterVolumeSpecName: "kube-api-access-nm6td") pod "ee5407fa-d7e6-45f2-ba09-95ee55262caf" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf"). InnerVolumeSpecName "kube-api-access-nm6td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:56:02.581292 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.581267    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ee5407fa-d7e6-45f2-ba09-95ee55262caf" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:56:02.587275 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.587230    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5407fa-d7e6-45f2-ba09-95ee55262caf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ee5407fa-d7e6-45f2-ba09-95ee55262caf" (UID: "ee5407fa-d7e6-45f2-ba09-95ee55262caf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:56:02.598288 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.598265    2576 scope.go:117] "RemoveContainer" containerID="b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249"
Jul 07 17:56:02.598630 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:56:02.598604    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249\": container with ID starting with b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249 not found: ID does not exist" containerID="b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249"
Jul 07 17:56:02.598696 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.598632    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249"} err="failed to get container status \"b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249\": rpc error: code = NotFound desc = could not find container \"b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249\": container with ID starting with b10840dbbf284c619442fcfb85a2260aa45352cc6a8ca4394a27fc0654676249 not found: ID does not exist"
Jul 07 17:56:02.678832 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.678791    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-certificates\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:02.678832 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.678822    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-bound-sa-token\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:02.678832 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.678831    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-installation-pull-secrets\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:02.678832 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.678840    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee5407fa-d7e6-45f2-ba09-95ee55262caf-ca-trust-extracted\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:02.679104 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.678851    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee5407fa-d7e6-45f2-ba09-95ee55262caf-image-registry-private-configuration\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:02.679104 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.678860    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee5407fa-d7e6-45f2-ba09-95ee55262caf-trusted-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:02.679104 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.678868    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm6td\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-kube-api-access-nm6td\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:02.679104 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.678876    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee5407fa-d7e6-45f2-ba09-95ee55262caf-registry-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:02.910657 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.910619    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84f65f4d98-77gnh"]
Jul 07 17:56:02.911919 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:02.911896    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84f65f4d98-77gnh"]
Jul 07 17:56:04.884476 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:04.884446    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5407fa-d7e6-45f2-ba09-95ee55262caf" path="/var/lib/kubelet/pods/ee5407fa-d7e6-45f2-ba09-95ee55262caf/volumes"
Jul 07 17:56:05.591225 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:05.591195    2576 generic.go:356] "Generic (PLEG): container finished" podID="7cf7fd4a-0f27-4613-9114-95bbd5e8a782" containerID="ca07c3c2d2422b9b79c4e241ef5377fc299cbdf2ce8a8b3a7d81035288f31ae1" exitCode=0
Jul 07 17:56:05.591391 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:05.591245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt" event={"ID":"7cf7fd4a-0f27-4613-9114-95bbd5e8a782","Type":"ContainerDied","Data":"ca07c3c2d2422b9b79c4e241ef5377fc299cbdf2ce8a8b3a7d81035288f31ae1"}
Jul 07 17:56:05.591636 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:05.591620    2576 scope.go:117] "RemoveContainer" containerID="ca07c3c2d2422b9b79c4e241ef5377fc299cbdf2ce8a8b3a7d81035288f31ae1"
Jul 07 17:56:06.599098 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:06.599064    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-pk7tt" event={"ID":"7cf7fd4a-0f27-4613-9114-95bbd5e8a782","Type":"ContainerStarted","Data":"08866c67b95c58efbfd80744917fa0f382e640d22e75263145cbe8b9a5b3f77b"}
Jul 07 17:56:09.613486 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.613451    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-88b8974f6-pp9d4" podUID="7671c93a-9cc2-49fe-b20a-d39ca0035bac" containerName="console" containerID="cri-o://3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60" gracePeriod=15
Jul 07 17:56:09.862715 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.862682    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:56:09.946317 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.946222    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnjtj\" (UniqueName: \"kubernetes.io/projected/7671c93a-9cc2-49fe-b20a-d39ca0035bac-kube-api-access-tnjtj\") pod \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") "
Jul 07 17:56:09.946317 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.946278    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-trusted-ca-bundle\") pod \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") "
Jul 07 17:56:09.946317 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.946304    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-oauth-serving-cert\") pod \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") "
Jul 07 17:56:09.946630 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.946335    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-serving-cert\") pod \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") "
Jul 07 17:56:09.946630 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.946510    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-oauth-config\") pod \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") "
Jul 07 17:56:09.946630 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.946554    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-service-ca\") pod \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") "
Jul 07 17:56:09.946630 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.946579    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-config\") pod \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\" (UID: \"7671c93a-9cc2-49fe-b20a-d39ca0035bac\") "
Jul 07 17:56:09.946940 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.946895    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7671c93a-9cc2-49fe-b20a-d39ca0035bac" (UID: "7671c93a-9cc2-49fe-b20a-d39ca0035bac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:56:09.947050 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.947007    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7671c93a-9cc2-49fe-b20a-d39ca0035bac" (UID: "7671c93a-9cc2-49fe-b20a-d39ca0035bac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:56:09.947050 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.947017    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-config" (OuterVolumeSpecName: "console-config") pod "7671c93a-9cc2-49fe-b20a-d39ca0035bac" (UID: "7671c93a-9cc2-49fe-b20a-d39ca0035bac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:56:09.947050 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.947031    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-service-ca" (OuterVolumeSpecName: "service-ca") pod "7671c93a-9cc2-49fe-b20a-d39ca0035bac" (UID: "7671c93a-9cc2-49fe-b20a-d39ca0035bac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:56:09.948722 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.948690    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7671c93a-9cc2-49fe-b20a-d39ca0035bac-kube-api-access-tnjtj" (OuterVolumeSpecName: "kube-api-access-tnjtj") pod "7671c93a-9cc2-49fe-b20a-d39ca0035bac" (UID: "7671c93a-9cc2-49fe-b20a-d39ca0035bac"). InnerVolumeSpecName "kube-api-access-tnjtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:56:09.948836 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.948725    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7671c93a-9cc2-49fe-b20a-d39ca0035bac" (UID: "7671c93a-9cc2-49fe-b20a-d39ca0035bac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:56:09.948836 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:09.948749    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7671c93a-9cc2-49fe-b20a-d39ca0035bac" (UID: "7671c93a-9cc2-49fe-b20a-d39ca0035bac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:56:10.047619 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.047562    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnjtj\" (UniqueName: \"kubernetes.io/projected/7671c93a-9cc2-49fe-b20a-d39ca0035bac-kube-api-access-tnjtj\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:10.047619 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.047610    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-trusted-ca-bundle\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:10.047619 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.047620    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-oauth-serving-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:10.047619 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.047629    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-serving-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:10.047619 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.047638    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-oauth-config\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:10.047920 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.047647    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:10.047920 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.047655    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7671c93a-9cc2-49fe-b20a-d39ca0035bac-console-config\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:56:10.618073 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.618041    2576 generic.go:356] "Generic (PLEG): container finished" podID="7671c93a-9cc2-49fe-b20a-d39ca0035bac" containerID="3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60" exitCode=0
Jul 07 17:56:10.618494 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.618120    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88b8974f6-pp9d4"
Jul 07 17:56:10.618494 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.618120    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88b8974f6-pp9d4" event={"ID":"7671c93a-9cc2-49fe-b20a-d39ca0035bac","Type":"ContainerDied","Data":"3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60"}
Jul 07 17:56:10.618494 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.618211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88b8974f6-pp9d4" event={"ID":"7671c93a-9cc2-49fe-b20a-d39ca0035bac","Type":"ContainerDied","Data":"2ec5ace8938d104c08687673f20ee7664469b44a76310ee2d0c8de3fdd0adc9c"}
Jul 07 17:56:10.618494 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.618239    2576 scope.go:117] "RemoveContainer" containerID="3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60"
Jul 07 17:56:10.627565 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.627543    2576 scope.go:117] "RemoveContainer" containerID="3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60"
Jul 07 17:56:10.627920 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:56:10.627896    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60\": container with ID starting with 3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60 not found: ID does not exist" containerID="3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60"
Jul 07 17:56:10.627985 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.627933    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60"} err="failed to get container status \"3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60\": rpc error: code = NotFound desc = could not find container \"3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60\": container with ID starting with 3abebd670b6271aa09dfd461c584211254150d76d41591f098125a2866316a60 not found: ID does not exist"
Jul 07 17:56:10.641244 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.641216    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88b8974f6-pp9d4"]
Jul 07 17:56:10.646078 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.646053    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-88b8974f6-pp9d4"]
Jul 07 17:56:10.885404 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:10.885317    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7671c93a-9cc2-49fe-b20a-d39ca0035bac" path="/var/lib/kubelet/pods/7671c93a-9cc2-49fe-b20a-d39ca0035bac/volumes"
Jul 07 17:56:12.630962 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:12.630868    2576 generic.go:356] "Generic (PLEG): container finished" podID="fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04" containerID="6e7c3e0484f6ce49df32a8a0febe9d7baa5683ff75993e581cd320b841c6cbe0" exitCode=0
Jul 07 17:56:12.630962 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:12.630929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd" event={"ID":"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04","Type":"ContainerDied","Data":"6e7c3e0484f6ce49df32a8a0febe9d7baa5683ff75993e581cd320b841c6cbe0"}
Jul 07 17:56:12.631378 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:12.631290    2576 scope.go:117] "RemoveContainer" containerID="6e7c3e0484f6ce49df32a8a0febe9d7baa5683ff75993e581cd320b841c6cbe0"
Jul 07 17:56:13.637769 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:13.637736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jfbtd" event={"ID":"fa5f4eb9-675c-4f59-ab5a-1ce763c5bf04","Type":"ContainerStarted","Data":"5dca331a5df6911c526ce6bd5f738a67ec0b93d347ebd57b5a15dbd724e33429"}
Jul 07 17:56:14.098849 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:14.098823    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:56:14.103770 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:14.103737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c6bdf99b9-fgz5z"
Jul 07 17:56:36.191444 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:36.191409    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:56:36.211836 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:36.211809    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:56:36.746731 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:36.746702    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 17:56:59.542956 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.542924    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc5775fb8-2md2s"]
Jul 07 17:56:59.543331 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543266    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f248bf6f-b006-4214-a0c5-627cce7b6554" containerName="console"
Jul 07 17:56:59.543331 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543277    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f248bf6f-b006-4214-a0c5-627cce7b6554" containerName="console"
Jul 07 17:56:59.543331 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543290    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5407fa-d7e6-45f2-ba09-95ee55262caf" containerName="registry"
Jul 07 17:56:59.543331 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543295    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5407fa-d7e6-45f2-ba09-95ee55262caf" containerName="registry"
Jul 07 17:56:59.543331 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543307    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7671c93a-9cc2-49fe-b20a-d39ca0035bac" containerName="console"
Jul 07 17:56:59.543331 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543312    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7671c93a-9cc2-49fe-b20a-d39ca0035bac" containerName="console"
Jul 07 17:56:59.543539 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543380    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7671c93a-9cc2-49fe-b20a-d39ca0035bac" containerName="console"
Jul 07 17:56:59.543539 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543389    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f248bf6f-b006-4214-a0c5-627cce7b6554" containerName="console"
Jul 07 17:56:59.543539 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.543397    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5407fa-d7e6-45f2-ba09-95ee55262caf" containerName="registry"
Jul 07 17:56:59.546904 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.546886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.562273 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.562245    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc5775fb8-2md2s"]
Jul 07 17:56:59.579123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.579089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-trusted-ca-bundle\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.579296 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.579128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-service-ca\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.579296 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.579152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-oauth-config\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.579296 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.579169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-console-config\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.579296 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.579276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-oauth-serving-cert\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.579479 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.579317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-serving-cert\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.579479 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.579339    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kz5w\" (UniqueName: \"kubernetes.io/projected/89399944-e2ba-4059-878f-7d07fe890488-kube-api-access-9kz5w\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.680385 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.680326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-trusted-ca-bundle\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.680562 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.680405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-service-ca\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.680562 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.680438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-oauth-config\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.680562 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.680461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-console-config\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.680698 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.680559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-oauth-serving-cert\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.680698 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.680603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-serving-cert\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.680698 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.680633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kz5w\" (UniqueName: \"kubernetes.io/projected/89399944-e2ba-4059-878f-7d07fe890488-kube-api-access-9kz5w\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.681236 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.681209    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-service-ca\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.681410 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.681387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-console-config\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.681482 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.681387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-oauth-serving-cert\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.681588 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.681562    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-trusted-ca-bundle\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.683142 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.683117    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-oauth-config\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.683260 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.683236    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-serving-cert\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.690907 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.690881    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kz5w\" (UniqueName: \"kubernetes.io/projected/89399944-e2ba-4059-878f-7d07fe890488-kube-api-access-9kz5w\") pod \"console-7bc5775fb8-2md2s\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") " pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.856010 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.855975    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:56:59.993597 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:56:59.993568    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc5775fb8-2md2s"]
Jul 07 17:56:59.995877 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:56:59.995849    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89399944_e2ba_4059_878f_7d07fe890488.slice/crio-e55113a734b577d44879dd1e2b85bf4b9b7fdfdd8a670a45f2eddf8faa7a70b0 WatchSource:0}: Error finding container e55113a734b577d44879dd1e2b85bf4b9b7fdfdd8a670a45f2eddf8faa7a70b0: Status 404 returned error can't find the container with id e55113a734b577d44879dd1e2b85bf4b9b7fdfdd8a670a45f2eddf8faa7a70b0
Jul 07 17:57:00.825201 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:00.825167    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc5775fb8-2md2s" event={"ID":"89399944-e2ba-4059-878f-7d07fe890488","Type":"ContainerStarted","Data":"ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae"}
Jul 07 17:57:00.825625 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:00.825212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc5775fb8-2md2s" event={"ID":"89399944-e2ba-4059-878f-7d07fe890488","Type":"ContainerStarted","Data":"e55113a734b577d44879dd1e2b85bf4b9b7fdfdd8a670a45f2eddf8faa7a70b0"}
Jul 07 17:57:09.856722 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:09.856680    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:57:09.857227 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:09.856772    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:57:09.861635 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:09.861610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:57:09.885936 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:09.885882    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bc5775fb8-2md2s" podStartSLOduration=10.885867054 podStartE2EDuration="10.885867054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:57:00.851263265 +0000 UTC m=+222.464821989" watchObservedRunningTime="2026-07-07 17:57:09.885867054 +0000 UTC m=+231.499425758"
Jul 07 17:57:10.868076 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:10.868048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:57:10.920901 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:10.920863    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786676845-8fwxp"]
Jul 07 17:57:11.000496 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.000463    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648cd8cd95-mf596"]
Jul 07 17:57:11.003766 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.003747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.025390 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.025355    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648cd8cd95-mf596"]
Jul 07 17:57:11.084800 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.084765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-service-ca\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.084978 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.084813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-serving-cert\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.084978 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.084843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-trusted-ca-bundle\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.084978 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.084878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-oauth-serving-cert\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.084978 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.084953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-oauth-config\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.085111 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.084988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-config\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.085111 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.085050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tpv2\" (UniqueName: \"kubernetes.io/projected/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-kube-api-access-4tpv2\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.186223 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.186123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-config\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.186223 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.186183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tpv2\" (UniqueName: \"kubernetes.io/projected/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-kube-api-access-4tpv2\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.186223 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.186211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-service-ca\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.186527 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.186240    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-serving-cert\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.186527 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.186267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-trusted-ca-bundle\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.186527 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.186282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-oauth-serving-cert\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.186527 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.186308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-oauth-config\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.187059 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.187034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-oauth-serving-cert\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.187149 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.187047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-config\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.187196 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.187089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-service-ca\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.187230 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.187120    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-trusted-ca-bundle\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.188992 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.188961    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-serving-cert\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.188992 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.188972    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-console-oauth-config\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.199877 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.199847    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tpv2\" (UniqueName: \"kubernetes.io/projected/424ae422-1ed8-4460-a93f-1ef8cb6e9fad-kube-api-access-4tpv2\") pod \"console-648cd8cd95-mf596\" (UID: \"424ae422-1ed8-4460-a93f-1ef8cb6e9fad\") " pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.314139 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.314087    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:11.468909 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.468830    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648cd8cd95-mf596"]
Jul 07 17:57:11.472194 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:57:11.472161    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424ae422_1ed8_4460_a93f_1ef8cb6e9fad.slice/crio-000831382f5a0c2a7326281f8ce1ca21d6138173324b36e67f793cbc45e68b96 WatchSource:0}: Error finding container 000831382f5a0c2a7326281f8ce1ca21d6138173324b36e67f793cbc45e68b96: Status 404 returned error can't find the container with id 000831382f5a0c2a7326281f8ce1ca21d6138173324b36e67f793cbc45e68b96
Jul 07 17:57:11.869556 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.869518    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648cd8cd95-mf596" event={"ID":"424ae422-1ed8-4460-a93f-1ef8cb6e9fad","Type":"ContainerStarted","Data":"c878ebc4565de33e341c8cccb8a49005ad0f139ddadc992441faa077859dfdd8"}
Jul 07 17:57:11.869933 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.869571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648cd8cd95-mf596" event={"ID":"424ae422-1ed8-4460-a93f-1ef8cb6e9fad","Type":"ContainerStarted","Data":"000831382f5a0c2a7326281f8ce1ca21d6138173324b36e67f793cbc45e68b96"}
Jul 07 17:57:11.893779 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:11.893730    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648cd8cd95-mf596" podStartSLOduration=1.8937144460000002 podStartE2EDuration="1.893714446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:57:11.892910911 +0000 UTC m=+233.506469676" watchObservedRunningTime="2026-07-07 17:57:11.893714446 +0000 UTC m=+233.507273148"
Jul 07 17:57:21.314619 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:21.314573    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:21.315042 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:21.314639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:21.319462 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:21.319435    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:21.914478 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:21.914450    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-648cd8cd95-mf596"
Jul 07 17:57:21.960497 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:21.960458    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc5775fb8-2md2s"]
Jul 07 17:57:35.943376 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:35.943281    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-786676845-8fwxp" podUID="5848ae30-da04-44f6-a895-6bbcccc90aba" containerName="console" containerID="cri-o://71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026" gracePeriod=15
Jul 07 17:57:36.193730 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.192442    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:57:36.211023 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.210995    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-service-ca\") pod \"5848ae30-da04-44f6-a895-6bbcccc90aba\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") "
Jul 07 17:57:36.211189 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211040    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-oauth-serving-cert\") pod \"5848ae30-da04-44f6-a895-6bbcccc90aba\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") "
Jul 07 17:57:36.211189 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211072    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvdml\" (UniqueName: \"kubernetes.io/projected/5848ae30-da04-44f6-a895-6bbcccc90aba-kube-api-access-zvdml\") pod \"5848ae30-da04-44f6-a895-6bbcccc90aba\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") "
Jul 07 17:57:36.211189 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211121    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-console-config\") pod \"5848ae30-da04-44f6-a895-6bbcccc90aba\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") "
Jul 07 17:57:36.211372 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211273    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-trusted-ca-bundle\") pod \"5848ae30-da04-44f6-a895-6bbcccc90aba\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") "
Jul 07 17:57:36.211372 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211325    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-serving-cert\") pod \"5848ae30-da04-44f6-a895-6bbcccc90aba\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") "
Jul 07 17:57:36.211472 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211386    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-oauth-config\") pod \"5848ae30-da04-44f6-a895-6bbcccc90aba\" (UID: \"5848ae30-da04-44f6-a895-6bbcccc90aba\") "
Jul 07 17:57:36.211530 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211512    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-service-ca" (OuterVolumeSpecName: "service-ca") pod "5848ae30-da04-44f6-a895-6bbcccc90aba" (UID: "5848ae30-da04-44f6-a895-6bbcccc90aba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:36.211590 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211563    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5848ae30-da04-44f6-a895-6bbcccc90aba" (UID: "5848ae30-da04-44f6-a895-6bbcccc90aba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:36.211698 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211571    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-console-config" (OuterVolumeSpecName: "console-config") pod "5848ae30-da04-44f6-a895-6bbcccc90aba" (UID: "5848ae30-da04-44f6-a895-6bbcccc90aba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:36.211698 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211695    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:36.211868 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211714    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-oauth-serving-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:36.211868 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.211818    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5848ae30-da04-44f6-a895-6bbcccc90aba" (UID: "5848ae30-da04-44f6-a895-6bbcccc90aba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:36.213482 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.213454    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5848ae30-da04-44f6-a895-6bbcccc90aba-kube-api-access-zvdml" (OuterVolumeSpecName: "kube-api-access-zvdml") pod "5848ae30-da04-44f6-a895-6bbcccc90aba" (UID: "5848ae30-da04-44f6-a895-6bbcccc90aba"). InnerVolumeSpecName "kube-api-access-zvdml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:57:36.213590 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.213549    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5848ae30-da04-44f6-a895-6bbcccc90aba" (UID: "5848ae30-da04-44f6-a895-6bbcccc90aba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:57:36.213665 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.213639    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5848ae30-da04-44f6-a895-6bbcccc90aba" (UID: "5848ae30-da04-44f6-a895-6bbcccc90aba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:57:36.312872 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.312831    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvdml\" (UniqueName: \"kubernetes.io/projected/5848ae30-da04-44f6-a895-6bbcccc90aba-kube-api-access-zvdml\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:36.312872 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.312866    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-console-config\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:36.312872 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.312875    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5848ae30-da04-44f6-a895-6bbcccc90aba-trusted-ca-bundle\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:36.312872 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.312884    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-serving-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:36.313231 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.312893    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5848ae30-da04-44f6-a895-6bbcccc90aba-console-oauth-config\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:36.969117 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.969081    2576 generic.go:356] "Generic (PLEG): container finished" podID="5848ae30-da04-44f6-a895-6bbcccc90aba" containerID="71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026" exitCode=0
Jul 07 17:57:36.969510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.969139    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786676845-8fwxp"
Jul 07 17:57:36.969510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.969151    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786676845-8fwxp" event={"ID":"5848ae30-da04-44f6-a895-6bbcccc90aba","Type":"ContainerDied","Data":"71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026"}
Jul 07 17:57:36.969510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.969197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786676845-8fwxp" event={"ID":"5848ae30-da04-44f6-a895-6bbcccc90aba","Type":"ContainerDied","Data":"709269414b0bf5daecd298416cb31625c5f5fc851bd807ac6ef1269e89927cbf"}
Jul 07 17:57:36.969510 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.969217    2576 scope.go:117] "RemoveContainer" containerID="71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026"
Jul 07 17:57:36.977492 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.977470    2576 scope.go:117] "RemoveContainer" containerID="71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026"
Jul 07 17:57:36.977757 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:57:36.977736    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026\": container with ID starting with 71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026 not found: ID does not exist" containerID="71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026"
Jul 07 17:57:36.977822 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.977767    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026"} err="failed to get container status \"71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026\": rpc error: code = NotFound desc = could not find container \"71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026\": container with ID starting with 71f6f4ef8bb14683591bc3b42ebc93011c09cdfb671e9bcb56c8ce8b135ba026 not found: ID does not exist"
Jul 07 17:57:36.989600 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.989574    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786676845-8fwxp"]
Jul 07 17:57:36.992108 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:36.992077    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-786676845-8fwxp"]
Jul 07 17:57:38.884556 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:38.884521    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5848ae30-da04-44f6-a895-6bbcccc90aba" path="/var/lib/kubelet/pods/5848ae30-da04-44f6-a895-6bbcccc90aba/volumes"
Jul 07 17:57:46.982033 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:46.981975    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bc5775fb8-2md2s" podUID="89399944-e2ba-4059-878f-7d07fe890488" containerName="console" containerID="cri-o://ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae" gracePeriod=15
Jul 07 17:57:47.226996 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.226969    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:57:47.304665 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.304582    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-trusted-ca-bundle\") pod \"89399944-e2ba-4059-878f-7d07fe890488\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") "
Jul 07 17:57:47.304665 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.304616    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-console-config\") pod \"89399944-e2ba-4059-878f-7d07fe890488\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") "
Jul 07 17:57:47.304665 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.304664    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-oauth-serving-cert\") pod \"89399944-e2ba-4059-878f-7d07fe890488\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") "
Jul 07 17:57:47.304928 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.304717    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kz5w\" (UniqueName: \"kubernetes.io/projected/89399944-e2ba-4059-878f-7d07fe890488-kube-api-access-9kz5w\") pod \"89399944-e2ba-4059-878f-7d07fe890488\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") "
Jul 07 17:57:47.304928 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.304752    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-service-ca\") pod \"89399944-e2ba-4059-878f-7d07fe890488\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") "
Jul 07 17:57:47.304928 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.304821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-oauth-config\") pod \"89399944-e2ba-4059-878f-7d07fe890488\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") "
Jul 07 17:57:47.304928 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.304865    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-serving-cert\") pod \"89399944-e2ba-4059-878f-7d07fe890488\" (UID: \"89399944-e2ba-4059-878f-7d07fe890488\") "
Jul 07 17:57:47.305123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.305021    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-console-config" (OuterVolumeSpecName: "console-config") pod "89399944-e2ba-4059-878f-7d07fe890488" (UID: "89399944-e2ba-4059-878f-7d07fe890488"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:47.305123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.305053    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "89399944-e2ba-4059-878f-7d07fe890488" (UID: "89399944-e2ba-4059-878f-7d07fe890488"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:47.305224 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.305179    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "89399944-e2ba-4059-878f-7d07fe890488" (UID: "89399944-e2ba-4059-878f-7d07fe890488"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:47.305286 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.305260    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-service-ca" (OuterVolumeSpecName: "service-ca") pod "89399944-e2ba-4059-878f-7d07fe890488" (UID: "89399944-e2ba-4059-878f-7d07fe890488"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:57:47.305487 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.305463    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-trusted-ca-bundle\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:47.305710 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.305492    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-console-config\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:47.305710 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.305506    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-oauth-serving-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:47.305710 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.305520    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89399944-e2ba-4059-878f-7d07fe890488-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:47.307194 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.307161    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89399944-e2ba-4059-878f-7d07fe890488-kube-api-access-9kz5w" (OuterVolumeSpecName: "kube-api-access-9kz5w") pod "89399944-e2ba-4059-878f-7d07fe890488" (UID: "89399944-e2ba-4059-878f-7d07fe890488"). InnerVolumeSpecName "kube-api-access-9kz5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:57:47.307194 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.307174    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "89399944-e2ba-4059-878f-7d07fe890488" (UID: "89399944-e2ba-4059-878f-7d07fe890488"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:57:47.307392 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.307234    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "89399944-e2ba-4059-878f-7d07fe890488" (UID: "89399944-e2ba-4059-878f-7d07fe890488"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:57:47.406255 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.406219    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-serving-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:47.406255 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.406248    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kz5w\" (UniqueName: \"kubernetes.io/projected/89399944-e2ba-4059-878f-7d07fe890488-kube-api-access-9kz5w\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:47.406255 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:47.406260    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89399944-e2ba-4059-878f-7d07fe890488-console-oauth-config\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 17:57:48.017400 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.017336    2576 generic.go:356] "Generic (PLEG): container finished" podID="89399944-e2ba-4059-878f-7d07fe890488" containerID="ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae" exitCode=0
Jul 07 17:57:48.017821 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.017402    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc5775fb8-2md2s"
Jul 07 17:57:48.017821 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.017419    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc5775fb8-2md2s" event={"ID":"89399944-e2ba-4059-878f-7d07fe890488","Type":"ContainerDied","Data":"ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae"}
Jul 07 17:57:48.017821 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.017474    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc5775fb8-2md2s" event={"ID":"89399944-e2ba-4059-878f-7d07fe890488","Type":"ContainerDied","Data":"e55113a734b577d44879dd1e2b85bf4b9b7fdfdd8a670a45f2eddf8faa7a70b0"}
Jul 07 17:57:48.017821 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.017496    2576 scope.go:117] "RemoveContainer" containerID="ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae"
Jul 07 17:57:48.029147 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.029126    2576 scope.go:117] "RemoveContainer" containerID="ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae"
Jul 07 17:57:48.029537 ip-10-0-133-54 kubenswrapper[2576]: E0707 17:57:48.029519    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae\": container with ID starting with ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae not found: ID does not exist" containerID="ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae"
Jul 07 17:57:48.029597 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.029548    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae"} err="failed to get container status \"ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae\": rpc error: code = NotFound desc = could not find container \"ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae\": container with ID starting with ba1cd80308dba0e68c28eebff5c99794f082cb0b9984f1e3233d1d73fac463ae not found: ID does not exist"
Jul 07 17:57:48.045239 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.045209    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc5775fb8-2md2s"]
Jul 07 17:57:48.049659 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.049631    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bc5775fb8-2md2s"]
Jul 07 17:57:48.888548 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:57:48.888515    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89399944-e2ba-4059-878f-7d07fe890488" path="/var/lib/kubelet/pods/89399944-e2ba-4059-878f-7d07fe890488/volumes"
Jul 07 17:58:18.832771 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:18.832733    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 17:58:35.312457 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.312413    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"]
Jul 07 17:58:35.315123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.312807    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5848ae30-da04-44f6-a895-6bbcccc90aba" containerName="console"
Jul 07 17:58:35.315123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.312819    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5848ae30-da04-44f6-a895-6bbcccc90aba" containerName="console"
Jul 07 17:58:35.315123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.312840    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89399944-e2ba-4059-878f-7d07fe890488" containerName="console"
Jul 07 17:58:35.315123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.312846    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="89399944-e2ba-4059-878f-7d07fe890488" containerName="console"
Jul 07 17:58:35.315123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.312899    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5848ae30-da04-44f6-a895-6bbcccc90aba" containerName="console"
Jul 07 17:58:35.315123 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.312905    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="89399944-e2ba-4059-878f-7d07fe890488" containerName="console"
Jul 07 17:58:35.315977 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.315957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"
Jul 07 17:58:35.319964 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.319943    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4l27q\""
Jul 07 17:58:35.321576 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.321549    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 17:58:35.321694 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.321607    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 17:58:35.327554 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.327529    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"]
Jul 07 17:58:35.413177 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.413131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d62cc1e-74ab-4880-a290-3ad01925a15c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6zvr2\" (UID: \"4d62cc1e-74ab-4880-a290-3ad01925a15c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"
Jul 07 17:58:35.413397 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.413221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcqk8\" (UniqueName: \"kubernetes.io/projected/4d62cc1e-74ab-4880-a290-3ad01925a15c-kube-api-access-wcqk8\") pod \"cert-manager-cainjector-559cdd8c87-6zvr2\" (UID: \"4d62cc1e-74ab-4880-a290-3ad01925a15c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"
Jul 07 17:58:35.513836 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.513802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcqk8\" (UniqueName: \"kubernetes.io/projected/4d62cc1e-74ab-4880-a290-3ad01925a15c-kube-api-access-wcqk8\") pod \"cert-manager-cainjector-559cdd8c87-6zvr2\" (UID: \"4d62cc1e-74ab-4880-a290-3ad01925a15c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"
Jul 07 17:58:35.514037 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.513862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d62cc1e-74ab-4880-a290-3ad01925a15c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6zvr2\" (UID: \"4d62cc1e-74ab-4880-a290-3ad01925a15c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"
Jul 07 17:58:35.525028 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.525003    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d62cc1e-74ab-4880-a290-3ad01925a15c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-6zvr2\" (UID: \"4d62cc1e-74ab-4880-a290-3ad01925a15c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"
Jul 07 17:58:35.528931 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.528905    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcqk8\" (UniqueName: \"kubernetes.io/projected/4d62cc1e-74ab-4880-a290-3ad01925a15c-kube-api-access-wcqk8\") pod \"cert-manager-cainjector-559cdd8c87-6zvr2\" (UID: \"4d62cc1e-74ab-4880-a290-3ad01925a15c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"
Jul 07 17:58:35.626308 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.626230    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"
Jul 07 17:58:35.762419 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.762375    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2"]
Jul 07 17:58:35.765629 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:58:35.765600    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d62cc1e_74ab_4880_a290_3ad01925a15c.slice/crio-a9f7d33a2b621f2630cb7bb65ebb05ccf506cb54da3f651107eb6eecfd823802 WatchSource:0}: Error finding container a9f7d33a2b621f2630cb7bb65ebb05ccf506cb54da3f651107eb6eecfd823802: Status 404 returned error can't find the container with id a9f7d33a2b621f2630cb7bb65ebb05ccf506cb54da3f651107eb6eecfd823802
Jul 07 17:58:35.767475 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:35.767460    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:58:36.225362 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:36.225302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2" event={"ID":"4d62cc1e-74ab-4880-a290-3ad01925a15c","Type":"ContainerStarted","Data":"a9f7d33a2b621f2630cb7bb65ebb05ccf506cb54da3f651107eb6eecfd823802"}
Jul 07 17:58:39.239998 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:39.239955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2" event={"ID":"4d62cc1e-74ab-4880-a290-3ad01925a15c","Type":"ContainerStarted","Data":"b6df2896c6e2d54003d60198ed4be429f4d4785a322081e0eff8ef567cf734a4"}
Jul 07 17:58:39.257747 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:58:39.257687    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-6zvr2" podStartSLOduration=1.334742812 podStartE2EDuration="4.257666587s" totalImagesPullingTime="2.922923775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:58:39.257147195 +0000 UTC m=+320.870705900" watchObservedRunningTime="2026-07-07 17:58:39.257666587 +0000 UTC m=+320.871225292"
Jul 07 17:59:07.380762 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.380727    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"]
Jul 07 17:59:07.384259 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.384241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.393748 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.393722    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 17:59:07.394658 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.394642    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 17:59:07.394746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.394725    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 17:59:07.394787 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.394725    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 17:59:07.394821 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.394803    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l566k\""
Jul 07 17:59:07.416554 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.416522    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"]
Jul 07 17:59:07.495240 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.495202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/588669b1-2c85-4ca2-92ae-989cb05cdebe-tmp\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.495240 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.495240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/588669b1-2c85-4ca2-92ae-989cb05cdebe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.495481 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.495326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/588669b1-2c85-4ca2-92ae-989cb05cdebe-manifests\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.495531 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.495475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh6mt\" (UniqueName: \"kubernetes.io/projected/588669b1-2c85-4ca2-92ae-989cb05cdebe-kube-api-access-jh6mt\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.495587 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.495571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/588669b1-2c85-4ca2-92ae-989cb05cdebe-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.597027 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.596988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/588669b1-2c85-4ca2-92ae-989cb05cdebe-tmp\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.597027 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.597028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/588669b1-2c85-4ca2-92ae-989cb05cdebe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.597237 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.597180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/588669b1-2c85-4ca2-92ae-989cb05cdebe-manifests\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.597273 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.597241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh6mt\" (UniqueName: \"kubernetes.io/projected/588669b1-2c85-4ca2-92ae-989cb05cdebe-kube-api-access-jh6mt\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.597372 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.597329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/588669b1-2c85-4ca2-92ae-989cb05cdebe-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.597590 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.597570    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/588669b1-2c85-4ca2-92ae-989cb05cdebe-manifests\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.599524 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.599496    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/588669b1-2c85-4ca2-92ae-989cb05cdebe-tmp\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.599724 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.599707    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/588669b1-2c85-4ca2-92ae-989cb05cdebe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.599766 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.599732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/588669b1-2c85-4ca2-92ae-989cb05cdebe-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.607479 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.607460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh6mt\" (UniqueName: \"kubernetes.io/projected/588669b1-2c85-4ca2-92ae-989cb05cdebe-kube-api-access-jh6mt\") pod \"opendatahub-operator-controller-manager-7fcb7f7967-zmhxn\" (UID: \"588669b1-2c85-4ca2-92ae-989cb05cdebe\") " pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.695034 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.694944    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:07.876410 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:07.876382    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"]
Jul 07 17:59:07.878962 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:59:07.878935    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588669b1_2c85_4ca2_92ae_989cb05cdebe.slice/crio-f4b4ad8f2a809769f0f844161fb178edbd687bda0b02410f22da9f6ade92532c WatchSource:0}: Error finding container f4b4ad8f2a809769f0f844161fb178edbd687bda0b02410f22da9f6ade92532c: Status 404 returned error can't find the container with id f4b4ad8f2a809769f0f844161fb178edbd687bda0b02410f22da9f6ade92532c
Jul 07 17:59:08.355679 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:08.355642    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn" event={"ID":"588669b1-2c85-4ca2-92ae-989cb05cdebe","Type":"ContainerStarted","Data":"f4b4ad8f2a809769f0f844161fb178edbd687bda0b02410f22da9f6ade92532c"}
Jul 07 17:59:11.375289 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:11.375245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn" event={"ID":"588669b1-2c85-4ca2-92ae-989cb05cdebe","Type":"ContainerStarted","Data":"0845861b26198e05fd83e8639b3d2122726a2ec31d3bd389d9a485630c177753"}
Jul 07 17:59:12.380501 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:12.380470    2576 generic.go:356] "Generic (PLEG): container finished" podID="588669b1-2c85-4ca2-92ae-989cb05cdebe" containerID="0845861b26198e05fd83e8639b3d2122726a2ec31d3bd389d9a485630c177753" exitCode=0
Jul 07 17:59:12.380901 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:12.380557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn" event={"ID":"588669b1-2c85-4ca2-92ae-989cb05cdebe","Type":"ContainerDied","Data":"0845861b26198e05fd83e8639b3d2122726a2ec31d3bd389d9a485630c177753"}
Jul 07 17:59:13.387830 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:13.387788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn" event={"ID":"588669b1-2c85-4ca2-92ae-989cb05cdebe","Type":"ContainerStarted","Data":"956408a54c33bdbfa287f3175f6766f8c6eaeb95c1e336f80787661d51073cc7"}
Jul 07 17:59:13.388291 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:13.387944    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:13.468266 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:13.468208    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn" podStartSLOduration=1.889117137 podStartE2EDuration="6.468187569s" totalImagesPullingTime="3.568063667s" totalInitContainerRuntime="1.011006765s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:13.46639105 +0000 UTC m=+355.079949779" watchObservedRunningTime="2026-07-07 17:59:13.468187569 +0000 UTC m=+355.081746272"
Jul 07 17:59:24.395151 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:24.395116    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fcb7f7967-zmhxn"
Jul 07 17:59:37.315038 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.315007    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"]
Jul 07 17:59:37.324264 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.324240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.330601 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.330574    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 17:59:37.331118 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.330741    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mqnzn\""
Jul 07 17:59:37.331118 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.330648    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 17:59:37.331524 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.331495    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 17:59:37.341048 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.341024    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"]
Jul 07 17:59:37.376057 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.376328 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3416f1d-50de-4334-865f-c9f8588526e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.376746 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.376810 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3416f1d-50de-4334-865f-c9f8588526e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.376810 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.376899 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwgqf\" (UniqueName: \"kubernetes.io/projected/f3416f1d-50de-4334-865f-c9f8588526e9-kube-api-access-gwgqf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.376899 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3416f1d-50de-4334-865f-c9f8588526e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.376975 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.377023 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.376982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478117 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478117 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3416f1d-50de-4334-865f-c9f8588526e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3416f1d-50de-4334-865f-c9f8588526e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwgqf\" (UniqueName: \"kubernetes.io/projected/f3416f1d-50de-4334-865f-c9f8588526e9-kube-api-access-gwgqf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3416f1d-50de-4334-865f-c9f8588526e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478389 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478675 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478598    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.478946 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478918    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.479052 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.478995    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.479052 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.479031    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3416f1d-50de-4334-865f-c9f8588526e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.479157 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.479077    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.481025 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.481001    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3416f1d-50de-4334-865f-c9f8588526e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.481116 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.481097    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3416f1d-50de-4334-865f-c9f8588526e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.498794 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.498735    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwgqf\" (UniqueName: \"kubernetes.io/projected/f3416f1d-50de-4334-865f-c9f8588526e9-kube-api-access-gwgqf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.499617 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.499211    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3416f1d-50de-4334-865f-c9f8588526e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4npv84\" (UID: \"f3416f1d-50de-4334-865f-c9f8588526e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.635682 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.635598    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:37.639205 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.639177    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"]
Jul 07 17:59:37.642766 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.642742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.645727 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.645702    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 17:59:37.645854 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.645768    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 17:59:37.646022 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.646005    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n68jh\""
Jul 07 17:59:37.646079 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.646025    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:59:37.646176 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.646105    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 17:59:37.646276 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.646253    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 17:59:37.657483 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.657453    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"]
Jul 07 17:59:37.781059 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.781027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-metrics-cert\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.781277 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.781073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp65n\" (UniqueName: \"kubernetes.io/projected/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-kube-api-access-mp65n\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.781277 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.781097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-cert\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.781277 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.781170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-manager-config\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.816268 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.816240    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"]
Jul 07 17:59:37.818077 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:59:37.818054    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3416f1d_50de_4334_865f_c9f8588526e9.slice/crio-174b8063290da9919999271f3ff8f6aeb2515a7b0c5f12895e5a5f9dc1e0e9a0 WatchSource:0}: Error finding container 174b8063290da9919999271f3ff8f6aeb2515a7b0c5f12895e5a5f9dc1e0e9a0: Status 404 returned error can't find the container with id 174b8063290da9919999271f3ff8f6aeb2515a7b0c5f12895e5a5f9dc1e0e9a0
Jul 07 17:59:37.882122 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.882085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-metrics-cert\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.882297 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.882144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp65n\" (UniqueName: \"kubernetes.io/projected/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-kube-api-access-mp65n\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.882297 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.882175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-cert\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.882297 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.882217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-manager-config\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.882992 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.882929    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-manager-config\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.884858 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.884838    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-cert\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.884939 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.884863    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-metrics-cert\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.911277 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.911213    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp65n\" (UniqueName: \"kubernetes.io/projected/5ff1a800-d299-4e3a-acee-a7fc8feb2f3b-kube-api-access-mp65n\") pod \"lws-controller-manager-694995b85-4kjrk\" (UID: \"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b\") " pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:37.963305 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:37.963271    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:38.103879 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:38.103839    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"]
Jul 07 17:59:38.105135 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:59:38.105100    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff1a800_d299_4e3a_acee_a7fc8feb2f3b.slice/crio-2261674db8350dae4003d9a1f93403fbba2839f7b238c9c87a9d801c5448f4dd WatchSource:0}: Error finding container 2261674db8350dae4003d9a1f93403fbba2839f7b238c9c87a9d801c5448f4dd: Status 404 returned error can't find the container with id 2261674db8350dae4003d9a1f93403fbba2839f7b238c9c87a9d801c5448f4dd
Jul 07 17:59:38.501960 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:38.501924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk" event={"ID":"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b","Type":"ContainerStarted","Data":"2261674db8350dae4003d9a1f93403fbba2839f7b238c9c87a9d801c5448f4dd"}
Jul 07 17:59:38.503439 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:38.503415    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84" event={"ID":"f3416f1d-50de-4334-865f-c9f8588526e9","Type":"ContainerStarted","Data":"174b8063290da9919999271f3ff8f6aeb2515a7b0c5f12895e5a5f9dc1e0e9a0"}
Jul 07 17:59:39.631667 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.631631    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"]
Jul 07 17:59:39.638605 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.638574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:39.642765 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.642739    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-n5zgp\""
Jul 07 17:59:39.646296 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.646101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 17:59:39.662480 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.662443    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"]
Jul 07 17:59:39.668437 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.668386    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"]
Jul 07 17:59:39.668606 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.668567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:39.680631 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.680092    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 17:59:39.680631 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.680444    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xcbdd\""
Jul 07 17:59:39.688595 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.688521    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"]
Jul 07 17:59:39.704908 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.704882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89d391e9-7c70-4252-9074-881bf8c184de-cert\") pod \"kserve-controller-manager-d6f4b65b8-9sbzv\" (UID: \"89d391e9-7c70-4252-9074-881bf8c184de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:39.705088 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.704943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p56d9\" (UniqueName: \"kubernetes.io/projected/89d391e9-7c70-4252-9074-881bf8c184de-kube-api-access-p56d9\") pod \"kserve-controller-manager-d6f4b65b8-9sbzv\" (UID: \"89d391e9-7c70-4252-9074-881bf8c184de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:39.805863 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.805825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc9b791-f30c-4a56-b846-6af4a847c048-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c9shq\" (UID: \"bcc9b791-f30c-4a56-b846-6af4a847c048\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:39.806133 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.805904    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89d391e9-7c70-4252-9074-881bf8c184de-cert\") pod \"kserve-controller-manager-d6f4b65b8-9sbzv\" (UID: \"89d391e9-7c70-4252-9074-881bf8c184de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:39.806133 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.805925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d9tw\" (UniqueName: \"kubernetes.io/projected/bcc9b791-f30c-4a56-b846-6af4a847c048-kube-api-access-4d9tw\") pod \"llmisvc-controller-manager-777c6bd7d5-c9shq\" (UID: \"bcc9b791-f30c-4a56-b846-6af4a847c048\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:39.806133 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.805997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p56d9\" (UniqueName: \"kubernetes.io/projected/89d391e9-7c70-4252-9074-881bf8c184de-kube-api-access-p56d9\") pod \"kserve-controller-manager-d6f4b65b8-9sbzv\" (UID: \"89d391e9-7c70-4252-9074-881bf8c184de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:39.811515 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.809419    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89d391e9-7c70-4252-9074-881bf8c184de-cert\") pod \"kserve-controller-manager-d6f4b65b8-9sbzv\" (UID: \"89d391e9-7c70-4252-9074-881bf8c184de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:39.822171 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.822114    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56d9\" (UniqueName: \"kubernetes.io/projected/89d391e9-7c70-4252-9074-881bf8c184de-kube-api-access-p56d9\") pod \"kserve-controller-manager-d6f4b65b8-9sbzv\" (UID: \"89d391e9-7c70-4252-9074-881bf8c184de\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:39.907048 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.906971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc9b791-f30c-4a56-b846-6af4a847c048-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c9shq\" (UID: \"bcc9b791-f30c-4a56-b846-6af4a847c048\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:39.907048 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.907036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d9tw\" (UniqueName: \"kubernetes.io/projected/bcc9b791-f30c-4a56-b846-6af4a847c048-kube-api-access-4d9tw\") pod \"llmisvc-controller-manager-777c6bd7d5-c9shq\" (UID: \"bcc9b791-f30c-4a56-b846-6af4a847c048\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:39.909849 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.909823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc9b791-f30c-4a56-b846-6af4a847c048-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-c9shq\" (UID: \"bcc9b791-f30c-4a56-b846-6af4a847c048\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:39.919392 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.919334    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d9tw\" (UniqueName: \"kubernetes.io/projected/bcc9b791-f30c-4a56-b846-6af4a847c048-kube-api-access-4d9tw\") pod \"llmisvc-controller-manager-777c6bd7d5-c9shq\" (UID: \"bcc9b791-f30c-4a56-b846-6af4a847c048\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:39.956232 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:39.956200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:40.005576 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:40.005535    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:41.761140 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:41.760682    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 17:59:41.761140 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:41.760809    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 17:59:41.761140 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:41.760854    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 17:59:41.939335 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:41.938841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"]
Jul 07 17:59:41.941608 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:59:41.941578    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d391e9_7c70_4252_9074_881bf8c184de.slice/crio-0e7185709205c97b40692b0133ba5fc95474521d284f5d683dd920fb31738491 WatchSource:0}: Error finding container 0e7185709205c97b40692b0133ba5fc95474521d284f5d683dd920fb31738491: Status 404 returned error can't find the container with id 0e7185709205c97b40692b0133ba5fc95474521d284f5d683dd920fb31738491
Jul 07 17:59:41.958546 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:41.958515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"]
Jul 07 17:59:41.962246 ip-10-0-133-54 kubenswrapper[2576]: W0707 17:59:41.962219    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbcc9b791_f30c_4a56_b846_6af4a847c048.slice/crio-cc74627d6205c96fa9f76b5fdb380eb9fe1ccd5fb68b1ea0659bd4d3727d902a WatchSource:0}: Error finding container cc74627d6205c96fa9f76b5fdb380eb9fe1ccd5fb68b1ea0659bd4d3727d902a: Status 404 returned error can't find the container with id cc74627d6205c96fa9f76b5fdb380eb9fe1ccd5fb68b1ea0659bd4d3727d902a
Jul 07 17:59:42.528098 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.528061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv" event={"ID":"89d391e9-7c70-4252-9074-881bf8c184de","Type":"ContainerStarted","Data":"0e7185709205c97b40692b0133ba5fc95474521d284f5d683dd920fb31738491"}
Jul 07 17:59:42.529339 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.529309    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq" event={"ID":"bcc9b791-f30c-4a56-b846-6af4a847c048","Type":"ContainerStarted","Data":"cc74627d6205c96fa9f76b5fdb380eb9fe1ccd5fb68b1ea0659bd4d3727d902a"}
Jul 07 17:59:42.531050 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.531022    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk" event={"ID":"5ff1a800-d299-4e3a-acee-a7fc8feb2f3b","Type":"ContainerStarted","Data":"7c2814864ea2f88cc5ab4114f57a859b9ee38ba7aba86e9fda42407cde21e9cc"}
Jul 07 17:59:42.531161 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.531094    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 17:59:42.532644 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.532623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84" event={"ID":"f3416f1d-50de-4334-865f-c9f8588526e9","Type":"ContainerStarted","Data":"d90555d9819515a77d2c82f648da8846af87658857d42e97448e0e49bb36c125"}
Jul 07 17:59:42.559773 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.559721    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk" podStartSLOduration=1.90348439 podStartE2EDuration="5.559704876s" totalImagesPullingTime="3.656220486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:42.557022762 +0000 UTC m=+384.170581466" watchObservedRunningTime="2026-07-07 17:59:42.559704876 +0000 UTC m=+384.173263581"
Jul 07 17:59:42.636131 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.636096    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:42.641299 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.641273    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:42.681553 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:42.681484    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84" podStartSLOduration=1.741232079 podStartE2EDuration="5.681462291s" totalImagesPullingTime="3.940230212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:42.592006218 +0000 UTC m=+384.205564921" watchObservedRunningTime="2026-07-07 17:59:42.681462291 +0000 UTC m=+384.295020996"
Jul 07 17:59:43.539439 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:43.539382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:43.540451 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:43.540427    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4npv84"
Jul 07 17:59:46.554202 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:46.554169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv" event={"ID":"89d391e9-7c70-4252-9074-881bf8c184de","Type":"ContainerStarted","Data":"12a2cbcbd4e8c520ebba64bd7865f35b0b676c80594a87c7d7a8f52ca1110cb6"}
Jul 07 17:59:46.554701 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:46.554235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 17:59:46.555710 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:46.555685    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq" event={"ID":"bcc9b791-f30c-4a56-b846-6af4a847c048","Type":"ContainerStarted","Data":"c5e49be3cc78198d94f3c87ed91da397a5d9246c567bcc6096a437b0c4513438"}
Jul 07 17:59:46.555820 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:46.555741    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 17:59:46.578660 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:46.578611    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv" podStartSLOduration=4.096402535 podStartE2EDuration="7.578595946s" totalImagesPullingTime="3.482193411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:46.576847372 +0000 UTC m=+388.190406073" watchObservedRunningTime="2026-07-07 17:59:46.578595946 +0000 UTC m=+388.192154650"
Jul 07 17:59:46.597058 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:46.597013    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq" podStartSLOduration=4.089791546 podStartE2EDuration="7.596998108s" totalImagesPullingTime="3.507206562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:59:46.595862215 +0000 UTC m=+388.209420941" watchObservedRunningTime="2026-07-07 17:59:46.596998108 +0000 UTC m=+388.210556811"
Jul 07 17:59:53.541226 ip-10-0-133-54 kubenswrapper[2576]: I0707 17:59:53.541195    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-694995b85-4kjrk"
Jul 07 18:00:17.563244 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:00:17.563212    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-c9shq"
Jul 07 18:00:17.566820 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:00:17.566793    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9sbzv"
Jul 07 18:01:09.104109 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.104071    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"]
Jul 07 18:01:09.107677 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.107655    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"
Jul 07 18:01:09.114514 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.114491    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:01:09.115638 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.115620    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:01:09.117411 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.117393    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-2l6jc\""
Jul 07 18:01:09.140094 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.140057    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"]
Jul 07 18:01:09.243473 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.243431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrcxm\" (UniqueName: \"kubernetes.io/projected/2a3b2fa5-3dae-41ba-8811-746fbf242483-kube-api-access-zrcxm\") pod \"authorino-operator-75cc8d5cb7-ddnq6\" (UID: \"2a3b2fa5-3dae-41ba-8811-746fbf242483\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"
Jul 07 18:01:09.344767 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.344726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrcxm\" (UniqueName: \"kubernetes.io/projected/2a3b2fa5-3dae-41ba-8811-746fbf242483-kube-api-access-zrcxm\") pod \"authorino-operator-75cc8d5cb7-ddnq6\" (UID: \"2a3b2fa5-3dae-41ba-8811-746fbf242483\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"
Jul 07 18:01:09.373141 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.373056    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrcxm\" (UniqueName: \"kubernetes.io/projected/2a3b2fa5-3dae-41ba-8811-746fbf242483-kube-api-access-zrcxm\") pod \"authorino-operator-75cc8d5cb7-ddnq6\" (UID: \"2a3b2fa5-3dae-41ba-8811-746fbf242483\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"
Jul 07 18:01:09.417577 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.417544    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"
Jul 07 18:01:09.579750 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.579727    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"]
Jul 07 18:01:09.582494 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:01:09.582463    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a3b2fa5_3dae_41ba_8811_746fbf242483.slice/crio-0224295f8fe31e64fdd7de5b795b47c64250c6d01a2afe7915c5484fc65021b3 WatchSource:0}: Error finding container 0224295f8fe31e64fdd7de5b795b47c64250c6d01a2afe7915c5484fc65021b3: Status 404 returned error can't find the container with id 0224295f8fe31e64fdd7de5b795b47c64250c6d01a2afe7915c5484fc65021b3
Jul 07 18:01:09.932843 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:09.932812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6" event={"ID":"2a3b2fa5-3dae-41ba-8811-746fbf242483","Type":"ContainerStarted","Data":"0224295f8fe31e64fdd7de5b795b47c64250c6d01a2afe7915c5484fc65021b3"}
Jul 07 18:01:12.949323 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:12.949278    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6" event={"ID":"2a3b2fa5-3dae-41ba-8811-746fbf242483","Type":"ContainerStarted","Data":"180e45c88e36a502b64f26f40d798b6fcdc5180caedee56d9d0384ee06218e46"}
Jul 07 18:01:12.949719 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:12.949410    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"
Jul 07 18:01:13.017955 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:13.017099    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6" podStartSLOduration=1.2105814910000001 podStartE2EDuration="4.017076965s" totalImagesPullingTime="2.806495474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:01:13.016523577 +0000 UTC m=+474.630082297" watchObservedRunningTime="2026-07-07 18:01:13.017076965 +0000 UTC m=+474.630635672"
Jul 07 18:01:16.592723 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.592689    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"]
Jul 07 18:01:16.596727 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.596710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"
Jul 07 18:01:16.599868 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.599842    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 18:01:16.599981 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.599888    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ww8b5\""
Jul 07 18:01:16.618761 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.618735    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"]
Jul 07 18:01:16.713912 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.713859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p72x\" (UniqueName: \"kubernetes.io/projected/fb13081a-d7fe-488a-aa64-5e7dbf82bb27-kube-api-access-9p72x\") pod \"dns-operator-controller-manager-864dd78c4c-rqqkw\" (UID: \"fb13081a-d7fe-488a-aa64-5e7dbf82bb27\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"
Jul 07 18:01:16.815312 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.815278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p72x\" (UniqueName: \"kubernetes.io/projected/fb13081a-d7fe-488a-aa64-5e7dbf82bb27-kube-api-access-9p72x\") pod \"dns-operator-controller-manager-864dd78c4c-rqqkw\" (UID: \"fb13081a-d7fe-488a-aa64-5e7dbf82bb27\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"
Jul 07 18:01:16.832182 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.832156    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p72x\" (UniqueName: \"kubernetes.io/projected/fb13081a-d7fe-488a-aa64-5e7dbf82bb27-kube-api-access-9p72x\") pod \"dns-operator-controller-manager-864dd78c4c-rqqkw\" (UID: \"fb13081a-d7fe-488a-aa64-5e7dbf82bb27\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"
Jul 07 18:01:16.907090 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:16.907017    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"
Jul 07 18:01:17.059437 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:17.059412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"]
Jul 07 18:01:17.061622 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:01:17.061592    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb13081a_d7fe_488a_aa64_5e7dbf82bb27.slice/crio-51c76a673a0c7aa6a4c52290d3692581fc8721fdea9634225927f584f706f3f8 WatchSource:0}: Error finding container 51c76a673a0c7aa6a4c52290d3692581fc8721fdea9634225927f584f706f3f8: Status 404 returned error can't find the container with id 51c76a673a0c7aa6a4c52290d3692581fc8721fdea9634225927f584f706f3f8
Jul 07 18:01:17.975429 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:17.975385    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw" event={"ID":"fb13081a-d7fe-488a-aa64-5e7dbf82bb27","Type":"ContainerStarted","Data":"51c76a673a0c7aa6a4c52290d3692581fc8721fdea9634225927f584f706f3f8"}
Jul 07 18:01:19.610054 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:19.610027    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 18:01:19.985244 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:19.985156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw" event={"ID":"fb13081a-d7fe-488a-aa64-5e7dbf82bb27","Type":"ContainerStarted","Data":"93a54d62b67aac36fd0740bc82284313b168cde56d9d39c3519c66dab9d557f6"}
Jul 07 18:01:19.985413 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:19.985303    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"
Jul 07 18:01:20.005980 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:20.005919    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw" podStartSLOduration=1.46449124 podStartE2EDuration="4.005902034s" totalImagesPullingTime="2.541410794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:01:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:01:20.005178902 +0000 UTC m=+481.618737604" watchObservedRunningTime="2026-07-07 18:01:20.005902034 +0000 UTC m=+481.619460737"
Jul 07 18:01:23.955938 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:23.955903    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ddnq6"
Jul 07 18:01:30.992209 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:01:30.992182    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rqqkw"
Jul 07 18:02:05.834223 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.834188    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"]
Jul 07 18:02:05.837630 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.837609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.841169 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.841146    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8gs2g\""
Jul 07 18:02:05.851080 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.851051    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"]
Jul 07 18:02:05.865473 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.865473 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vt6q\" (UniqueName: \"kubernetes.io/projected/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-kube-api-access-6vt6q\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.865726 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.865726 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.865726 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.865726 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.865726 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.865726 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.865726 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.865725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.966728 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.966728 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vt6q\" (UniqueName: \"kubernetes.io/projected/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-kube-api-access-6vt6q\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967000 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967000 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967000 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967000 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967000 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967000 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967000 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.966934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967375 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.967190    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967375 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.967262    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967375 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.967297    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967587 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.967566    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.967857 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.967836    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.969495 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.969469    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.969602 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.969582    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.977876 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.977846    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vt6q\" (UniqueName: \"kubernetes.io/projected/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-kube-api-access-6vt6q\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:05.978493 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:05.978470    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-889fn\" (UID: \"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:06.149611 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:06.149516    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:06.300731 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:06.300704    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"]
Jul 07 18:02:06.301901 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:02:06.301874    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c6d450_c9d2_4c5a_b7bd_f69a7fe7f897.slice/crio-69350322e1dac6378f7543adb04b0c1e8e830a7be7fe7e65ac95489d4e945e0c WatchSource:0}: Error finding container 69350322e1dac6378f7543adb04b0c1e8e830a7be7fe7e65ac95489d4e945e0c: Status 404 returned error can't find the container with id 69350322e1dac6378f7543adb04b0c1e8e830a7be7fe7e65ac95489d4e945e0c
Jul 07 18:02:06.303890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:06.303858    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:02:06.303994 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:06.303937    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:02:06.303994 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:06.303985    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:02:07.221615 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:07.221577    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" event={"ID":"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897","Type":"ContainerStarted","Data":"6d01629f5bf52e58c58a9d7c17a9bace592920ea66e78085823beee9ab58716a"}
Jul 07 18:02:07.222103 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:07.221630    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" event={"ID":"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897","Type":"ContainerStarted","Data":"69350322e1dac6378f7543adb04b0c1e8e830a7be7fe7e65ac95489d4e945e0c"}
Jul 07 18:02:07.248629 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:07.248579    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" podStartSLOduration=2.248565196 podStartE2EDuration="2.248565196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:07.247061525 +0000 UTC m=+528.860620249" watchObservedRunningTime="2026-07-07 18:02:07.248565196 +0000 UTC m=+528.862123900"
Jul 07 18:02:08.150037 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.149998    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:08.155524 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.155496    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:08.226472 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.226443    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:08.227379 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.227333    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:02:08.448830 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.448746    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"]
Jul 07 18:02:08.452440 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.452421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:08.455440 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.455416    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 18:02:08.455561 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.455480    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bfxpp\""
Jul 07 18:02:08.467619 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.467596    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"]
Jul 07 18:02:08.489093 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.489061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-config-file\") pod \"limitador-limitador-64c94fd64f-hhpbm\" (UID: \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:08.489093 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.489097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvwr\" (UniqueName: \"kubernetes.io/projected/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-kube-api-access-2vvwr\") pod \"limitador-limitador-64c94fd64f-hhpbm\" (UID: \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:08.576049 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.576017    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"]
Jul 07 18:02:08.589691 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.589657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-config-file\") pod \"limitador-limitador-64c94fd64f-hhpbm\" (UID: \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:08.589873 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.589709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvwr\" (UniqueName: \"kubernetes.io/projected/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-kube-api-access-2vvwr\") pod \"limitador-limitador-64c94fd64f-hhpbm\" (UID: \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:08.590230 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.590209    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-config-file\") pod \"limitador-limitador-64c94fd64f-hhpbm\" (UID: \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:08.604783 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.604755    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvwr\" (UniqueName: \"kubernetes.io/projected/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-kube-api-access-2vvwr\") pod \"limitador-limitador-64c94fd64f-hhpbm\" (UID: \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:08.763448 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.763333    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:08.906902 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:08.906867    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"]
Jul 07 18:02:08.909872 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:02:08.909844    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded56d9f8_0acd_4913_bcb5_466e7d0916c4.slice/crio-6f504c59730f8234b95977c3dbd7614dace8dc9e650146ff9718bbdf7d748ce4 WatchSource:0}: Error finding container 6f504c59730f8234b95977c3dbd7614dace8dc9e650146ff9718bbdf7d748ce4: Status 404 returned error can't find the container with id 6f504c59730f8234b95977c3dbd7614dace8dc9e650146ff9718bbdf7d748ce4
Jul 07 18:02:09.232184 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:09.232153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm" event={"ID":"ed56d9f8-0acd-4913-bcb5-466e7d0916c4","Type":"ContainerStarted","Data":"6f504c59730f8234b95977c3dbd7614dace8dc9e650146ff9718bbdf7d748ce4"}
Jul 07 18:02:12.250730 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:12.250697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm" event={"ID":"ed56d9f8-0acd-4913-bcb5-466e7d0916c4","Type":"ContainerStarted","Data":"d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269"}
Jul 07 18:02:12.251128 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:12.250808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:12.272015 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:12.271963    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm" podStartSLOduration=1.107437244 podStartE2EDuration="4.271946131s" totalImagesPullingTime="3.164508887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:12.27074407 +0000 UTC m=+533.884302810" watchObservedRunningTime="2026-07-07 18:02:12.271946131 +0000 UTC m=+533.885504834"
Jul 07 18:02:23.237203 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.237163    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"]
Jul 07 18:02:23.237697 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.237428    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm" podUID="ed56d9f8-0acd-4913-bcb5-466e7d0916c4" containerName="limitador" containerID="cri-o://d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269" gracePeriod=30
Jul 07 18:02:23.238038 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.237964    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:23.793535 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.793510    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:23.837062 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.837027    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vvwr\" (UniqueName: \"kubernetes.io/projected/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-kube-api-access-2vvwr\") pod \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\" (UID: \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\") "
Jul 07 18:02:23.837259 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.837126    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-config-file\") pod \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\" (UID: \"ed56d9f8-0acd-4913-bcb5-466e7d0916c4\") "
Jul 07 18:02:23.837745 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.837719    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-config-file" (OuterVolumeSpecName: "config-file") pod "ed56d9f8-0acd-4913-bcb5-466e7d0916c4" (UID: "ed56d9f8-0acd-4913-bcb5-466e7d0916c4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:02:23.839467 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.839440    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-kube-api-access-2vvwr" (OuterVolumeSpecName: "kube-api-access-2vvwr") pod "ed56d9f8-0acd-4913-bcb5-466e7d0916c4" (UID: "ed56d9f8-0acd-4913-bcb5-466e7d0916c4"). InnerVolumeSpecName "kube-api-access-2vvwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:02:23.938063 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.938026    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vvwr\" (UniqueName: \"kubernetes.io/projected/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-kube-api-access-2vvwr\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:02:23.938063 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:23.938058    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ed56d9f8-0acd-4913-bcb5-466e7d0916c4-config-file\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:02:24.310005 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.309969    2576 generic.go:356] "Generic (PLEG): container finished" podID="ed56d9f8-0acd-4913-bcb5-466e7d0916c4" containerID="d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269" exitCode=0
Jul 07 18:02:24.310472 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.310015    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"
Jul 07 18:02:24.310472 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.310050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm" event={"ID":"ed56d9f8-0acd-4913-bcb5-466e7d0916c4","Type":"ContainerDied","Data":"d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269"}
Jul 07 18:02:24.310472 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.310106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hhpbm" event={"ID":"ed56d9f8-0acd-4913-bcb5-466e7d0916c4","Type":"ContainerDied","Data":"6f504c59730f8234b95977c3dbd7614dace8dc9e650146ff9718bbdf7d748ce4"}
Jul 07 18:02:24.310472 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.310128    2576 scope.go:117] "RemoveContainer" containerID="d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269"
Jul 07 18:02:24.319162 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.319146    2576 scope.go:117] "RemoveContainer" containerID="d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269"
Jul 07 18:02:24.319447 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:02:24.319422    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269\": container with ID starting with d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269 not found: ID does not exist" containerID="d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269"
Jul 07 18:02:24.319501 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.319461    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269"} err="failed to get container status \"d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269\": rpc error: code = NotFound desc = could not find container \"d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269\": container with ID starting with d4b2fd5b74d05943d6f36ba50ba0523ef1fc67362f4e52292c5a8acfba523269 not found: ID does not exist"
Jul 07 18:02:24.333877 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.333853    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"]
Jul 07 18:02:24.341731 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.341707    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hhpbm"]
Jul 07 18:02:24.891385 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:24.891327    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed56d9f8-0acd-4913-bcb5-466e7d0916c4" path="/var/lib/kubelet/pods/ed56d9f8-0acd-4913-bcb5-466e7d0916c4/volumes"
Jul 07 18:02:25.495085 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.495044    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-d7x4s"]
Jul 07 18:02:25.495484 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.495468    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed56d9f8-0acd-4913-bcb5-466e7d0916c4" containerName="limitador"
Jul 07 18:02:25.495533 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.495487    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed56d9f8-0acd-4913-bcb5-466e7d0916c4" containerName="limitador"
Jul 07 18:02:25.495576 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.495567    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed56d9f8-0acd-4913-bcb5-466e7d0916c4" containerName="limitador"
Jul 07 18:02:25.500669 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.500646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:25.504635 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.504610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4p6kz\""
Jul 07 18:02:25.504775 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.504615    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 18:02:25.510335 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.510311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-d7x4s"]
Jul 07 18:02:25.553001 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.552966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d14df388-103d-47cd-b416-8e7a00b4f61e-data\") pod \"postgres-69fb4594cf-d7x4s\" (UID: \"d14df388-103d-47cd-b416-8e7a00b4f61e\") " pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:25.553001 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.553007    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c9rg\" (UniqueName: \"kubernetes.io/projected/d14df388-103d-47cd-b416-8e7a00b4f61e-kube-api-access-6c9rg\") pod \"postgres-69fb4594cf-d7x4s\" (UID: \"d14df388-103d-47cd-b416-8e7a00b4f61e\") " pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:25.654179 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.654142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d14df388-103d-47cd-b416-8e7a00b4f61e-data\") pod \"postgres-69fb4594cf-d7x4s\" (UID: \"d14df388-103d-47cd-b416-8e7a00b4f61e\") " pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:25.654179 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.654183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c9rg\" (UniqueName: \"kubernetes.io/projected/d14df388-103d-47cd-b416-8e7a00b4f61e-kube-api-access-6c9rg\") pod \"postgres-69fb4594cf-d7x4s\" (UID: \"d14df388-103d-47cd-b416-8e7a00b4f61e\") " pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:25.654607 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.654583    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d14df388-103d-47cd-b416-8e7a00b4f61e-data\") pod \"postgres-69fb4594cf-d7x4s\" (UID: \"d14df388-103d-47cd-b416-8e7a00b4f61e\") " pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:25.665609 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.665585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c9rg\" (UniqueName: \"kubernetes.io/projected/d14df388-103d-47cd-b416-8e7a00b4f61e-kube-api-access-6c9rg\") pod \"postgres-69fb4594cf-d7x4s\" (UID: \"d14df388-103d-47cd-b416-8e7a00b4f61e\") " pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:25.813600 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.813569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:25.965713 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:25.965684    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-d7x4s"]
Jul 07 18:02:25.969174 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:02:25.969144    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14df388_103d_47cd_b416_8e7a00b4f61e.slice/crio-9b0f3f898d21e96f2b849ce0f9956ec2b94acbe5d6cc0524f68e0611d10ec2ef WatchSource:0}: Error finding container 9b0f3f898d21e96f2b849ce0f9956ec2b94acbe5d6cc0524f68e0611d10ec2ef: Status 404 returned error can't find the container with id 9b0f3f898d21e96f2b849ce0f9956ec2b94acbe5d6cc0524f68e0611d10ec2ef
Jul 07 18:02:26.321430 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:26.321391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-d7x4s" event={"ID":"d14df388-103d-47cd-b416-8e7a00b4f61e","Type":"ContainerStarted","Data":"9b0f3f898d21e96f2b849ce0f9956ec2b94acbe5d6cc0524f68e0611d10ec2ef"}
Jul 07 18:02:31.350008 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:31.349968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-d7x4s" event={"ID":"d14df388-103d-47cd-b416-8e7a00b4f61e","Type":"ContainerStarted","Data":"8b3ec3e4f138d6a452f6386ae2e90b6ff6676d986862e14475b932ec91a46d0a"}
Jul 07 18:02:31.350414 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:31.350087    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:31.385030 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:31.384976    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-d7x4s" podStartSLOduration=1.332886473 podStartE2EDuration="6.384959949s" totalImagesPullingTime="5.052073476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:31.384649791 +0000 UTC m=+552.998208494" watchObservedRunningTime="2026-07-07 18:02:31.384959949 +0000 UTC m=+552.998518652"
Jul 07 18:02:37.385945 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:37.385914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-d7x4s"
Jul 07 18:02:46.192100 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.192056    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57b5db575b-btnxg"]
Jul 07 18:02:46.216280 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.216249    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:02:46.220306 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.220280    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57b5db575b-btnxg"]
Jul 07 18:02:46.221182 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.221133    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 18:02:46.221816 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.221796    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zc9xp\""
Jul 07 18:02:46.221928 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.221849    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 18:02:46.254923 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.254883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz22d\" (UniqueName: \"kubernetes.io/projected/4d4b128f-28dc-4550-a1aa-0fda79828867-kube-api-access-hz22d\") pod \"maas-controller-57b5db575b-btnxg\" (UID: \"4d4b128f-28dc-4550-a1aa-0fda79828867\") " pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:02:46.255105 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.254936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d4b128f-28dc-4550-a1aa-0fda79828867-webhook-cert\") pod \"maas-controller-57b5db575b-btnxg\" (UID: \"4d4b128f-28dc-4550-a1aa-0fda79828867\") " pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:02:46.355709 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.355676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz22d\" (UniqueName: \"kubernetes.io/projected/4d4b128f-28dc-4550-a1aa-0fda79828867-kube-api-access-hz22d\") pod \"maas-controller-57b5db575b-btnxg\" (UID: \"4d4b128f-28dc-4550-a1aa-0fda79828867\") " pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:02:46.355894 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.355731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d4b128f-28dc-4550-a1aa-0fda79828867-webhook-cert\") pod \"maas-controller-57b5db575b-btnxg\" (UID: \"4d4b128f-28dc-4550-a1aa-0fda79828867\") " pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:02:46.358513 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.358489    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d4b128f-28dc-4550-a1aa-0fda79828867-webhook-cert\") pod \"maas-controller-57b5db575b-btnxg\" (UID: \"4d4b128f-28dc-4550-a1aa-0fda79828867\") " pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:02:46.371494 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.371467    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz22d\" (UniqueName: \"kubernetes.io/projected/4d4b128f-28dc-4550-a1aa-0fda79828867-kube-api-access-hz22d\") pod \"maas-controller-57b5db575b-btnxg\" (UID: \"4d4b128f-28dc-4550-a1aa-0fda79828867\") " pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:02:46.528814 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.528709    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:02:46.696197 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:46.696171    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57b5db575b-btnxg"]
Jul 07 18:02:46.697834 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:02:46.697803    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4b128f_28dc_4550_a1aa_0fda79828867.slice/crio-314a7f674bec5cdba824b4c5bc6141d3d4d6fc320dc4e87042b1c1a0c5cae4cb WatchSource:0}: Error finding container 314a7f674bec5cdba824b4c5bc6141d3d4d6fc320dc4e87042b1c1a0c5cae4cb: Status 404 returned error can't find the container with id 314a7f674bec5cdba824b4c5bc6141d3d4d6fc320dc4e87042b1c1a0c5cae4cb
Jul 07 18:02:47.429279 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:47.429246    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57b5db575b-btnxg" event={"ID":"4d4b128f-28dc-4550-a1aa-0fda79828867","Type":"ContainerStarted","Data":"314a7f674bec5cdba824b4c5bc6141d3d4d6fc320dc4e87042b1c1a0c5cae4cb"}
Jul 07 18:02:49.442300 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:49.442266    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57b5db575b-btnxg" event={"ID":"4d4b128f-28dc-4550-a1aa-0fda79828867","Type":"ContainerStarted","Data":"a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7"}
Jul 07 18:02:49.442681 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:02:49.442400    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:03:00.454702 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:00.454671    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:03:00.484078 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:00.484028    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57b5db575b-btnxg" podStartSLOduration=11.817435286 podStartE2EDuration="14.484010635s" totalImagesPullingTime="2.666575349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:02:49.540736206 +0000 UTC m=+571.154294937" watchObservedRunningTime="2026-07-07 18:03:00.484010635 +0000 UTC m=+582.097569338"
Jul 07 18:03:01.409140 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.406401    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57b5db575b-btnxg"]
Jul 07 18:03:01.409140 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.406730    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-57b5db575b-btnxg" podUID="4d4b128f-28dc-4550-a1aa-0fda79828867" containerName="manager" containerID="cri-o://a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7" gracePeriod=30
Jul 07 18:03:01.665072 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.665008    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:03:01.702319 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.702287    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d4b128f-28dc-4550-a1aa-0fda79828867-webhook-cert\") pod \"4d4b128f-28dc-4550-a1aa-0fda79828867\" (UID: \"4d4b128f-28dc-4550-a1aa-0fda79828867\") "
Jul 07 18:03:01.702504 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.702332    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz22d\" (UniqueName: \"kubernetes.io/projected/4d4b128f-28dc-4550-a1aa-0fda79828867-kube-api-access-hz22d\") pod \"4d4b128f-28dc-4550-a1aa-0fda79828867\" (UID: \"4d4b128f-28dc-4550-a1aa-0fda79828867\") "
Jul 07 18:03:01.704789 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.704754    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d4b128f-28dc-4550-a1aa-0fda79828867-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4d4b128f-28dc-4550-a1aa-0fda79828867" (UID: "4d4b128f-28dc-4550-a1aa-0fda79828867"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:03:01.704789 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.704774    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d4b128f-28dc-4550-a1aa-0fda79828867-kube-api-access-hz22d" (OuterVolumeSpecName: "kube-api-access-hz22d") pod "4d4b128f-28dc-4550-a1aa-0fda79828867" (UID: "4d4b128f-28dc-4550-a1aa-0fda79828867"). InnerVolumeSpecName "kube-api-access-hz22d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:03:01.803206 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.803162    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d4b128f-28dc-4550-a1aa-0fda79828867-webhook-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:03:01.803206 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:01.803199    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz22d\" (UniqueName: \"kubernetes.io/projected/4d4b128f-28dc-4550-a1aa-0fda79828867-kube-api-access-hz22d\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:03:02.511043 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.511007    2576 generic.go:356] "Generic (PLEG): container finished" podID="4d4b128f-28dc-4550-a1aa-0fda79828867" containerID="a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7" exitCode=0
Jul 07 18:03:02.511254 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.511053    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57b5db575b-btnxg"
Jul 07 18:03:02.511254 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.511073    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57b5db575b-btnxg" event={"ID":"4d4b128f-28dc-4550-a1aa-0fda79828867","Type":"ContainerDied","Data":"a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7"}
Jul 07 18:03:02.511254 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.511127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57b5db575b-btnxg" event={"ID":"4d4b128f-28dc-4550-a1aa-0fda79828867","Type":"ContainerDied","Data":"314a7f674bec5cdba824b4c5bc6141d3d4d6fc320dc4e87042b1c1a0c5cae4cb"}
Jul 07 18:03:02.511254 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.511155    2576 scope.go:117] "RemoveContainer" containerID="a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7"
Jul 07 18:03:02.520656 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.520639    2576 scope.go:117] "RemoveContainer" containerID="a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7"
Jul 07 18:03:02.520960 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:03:02.520940    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7\": container with ID starting with a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7 not found: ID does not exist" containerID="a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7"
Jul 07 18:03:02.521012 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.520970    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7"} err="failed to get container status \"a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7\": rpc error: code = NotFound desc = could not find container \"a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7\": container with ID starting with a62daa757a09ae5e659b666301185723991e3dd49cd60f4ab57ccfcde3bfa3e7 not found: ID does not exist"
Jul 07 18:03:02.547985 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.547947    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57b5db575b-btnxg"]
Jul 07 18:03:02.554053 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.554027    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57b5db575b-btnxg"]
Jul 07 18:03:02.885387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:02.885340    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d4b128f-28dc-4550-a1aa-0fda79828867" path="/var/lib/kubelet/pods/4d4b128f-28dc-4550-a1aa-0fda79828867/volumes"
Jul 07 18:03:21.535167 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.535129    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-f7696796f-8tnsw"]
Jul 07 18:03:21.535613 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.535580    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d4b128f-28dc-4550-a1aa-0fda79828867" containerName="manager"
Jul 07 18:03:21.535613 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.535595    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d4b128f-28dc-4550-a1aa-0fda79828867" containerName="manager"
Jul 07 18:03:21.535686 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.535653    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d4b128f-28dc-4550-a1aa-0fda79828867" containerName="manager"
Jul 07 18:03:21.540357 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.540324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.552256 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.552235    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9jzgv\""
Jul 07 18:03:21.553563 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.553547    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 18:03:21.564824 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.564799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-f7696796f-8tnsw"]
Jul 07 18:03:21.685992 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.685958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-maas-api-tls\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.686169 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.686028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b42zd\" (UniqueName: \"kubernetes.io/projected/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-kube-api-access-b42zd\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.686211 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.686171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-openshift-service-ca\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.786912 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.786814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b42zd\" (UniqueName: \"kubernetes.io/projected/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-kube-api-access-b42zd\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.786912 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.786899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-openshift-service-ca\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.787166 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.786918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-maas-api-tls\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.787699 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.787673    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-openshift-service-ca\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.789443 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.789426    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-maas-api-tls\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.797935 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.797911    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b42zd\" (UniqueName: \"kubernetes.io/projected/c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf-kube-api-access-b42zd\") pod \"maas-api-f7696796f-8tnsw\" (UID: \"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf\") " pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.851035 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.850996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:21.993394 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:21.993372    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-f7696796f-8tnsw"]
Jul 07 18:03:21.995670 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:03:21.995642    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ecf57a_bfd6_4e16_8fc8_f9af83a2fdbf.slice/crio-1232c3ba26c67ffed2038ff5801b4a8d137c6f229d729e462e2ee009df10a66e WatchSource:0}: Error finding container 1232c3ba26c67ffed2038ff5801b4a8d137c6f229d729e462e2ee009df10a66e: Status 404 returned error can't find the container with id 1232c3ba26c67ffed2038ff5801b4a8d137c6f229d729e462e2ee009df10a66e
Jul 07 18:03:22.426509 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.426467    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zw7r4"]
Jul 07 18:03:22.431905 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.431877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:22.437192 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.437158    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8tntk\""
Jul 07 18:03:22.437192 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.437173    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 18:03:22.445214 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.445184    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zw7r4"]
Jul 07 18:03:22.594316 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.594283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49387ada-439f-4eb1-8034-18bfe68da0d0-plugins-config-volume\") pod \"payload-processing-58f86c7798-zw7r4\" (UID: \"49387ada-439f-4eb1-8034-18bfe68da0d0\") " pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:22.594316 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.594331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzmpm\" (UniqueName: \"kubernetes.io/projected/49387ada-439f-4eb1-8034-18bfe68da0d0-kube-api-access-dzmpm\") pod \"payload-processing-58f86c7798-zw7r4\" (UID: \"49387ada-439f-4eb1-8034-18bfe68da0d0\") " pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:22.607571 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.607532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-f7696796f-8tnsw" event={"ID":"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf","Type":"ContainerStarted","Data":"1232c3ba26c67ffed2038ff5801b4a8d137c6f229d729e462e2ee009df10a66e"}
Jul 07 18:03:22.695574 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.695463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49387ada-439f-4eb1-8034-18bfe68da0d0-plugins-config-volume\") pod \"payload-processing-58f86c7798-zw7r4\" (UID: \"49387ada-439f-4eb1-8034-18bfe68da0d0\") " pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:22.695574 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.695527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzmpm\" (UniqueName: \"kubernetes.io/projected/49387ada-439f-4eb1-8034-18bfe68da0d0-kube-api-access-dzmpm\") pod \"payload-processing-58f86c7798-zw7r4\" (UID: \"49387ada-439f-4eb1-8034-18bfe68da0d0\") " pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:22.696267 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.696249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49387ada-439f-4eb1-8034-18bfe68da0d0-plugins-config-volume\") pod \"payload-processing-58f86c7798-zw7r4\" (UID: \"49387ada-439f-4eb1-8034-18bfe68da0d0\") " pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:22.705540 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.705514    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzmpm\" (UniqueName: \"kubernetes.io/projected/49387ada-439f-4eb1-8034-18bfe68da0d0-kube-api-access-dzmpm\") pod \"payload-processing-58f86c7798-zw7r4\" (UID: \"49387ada-439f-4eb1-8034-18bfe68da0d0\") " pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:22.747706 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.747666    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:22.934598 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:22.934235    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zw7r4"]
Jul 07 18:03:22.937609 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:03:22.937574    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49387ada_439f_4eb1_8034_18bfe68da0d0.slice/crio-7d81ca8371f2f0540b0a45095d8d3af872663ed5ba10d7753abaa52d55294b08 WatchSource:0}: Error finding container 7d81ca8371f2f0540b0a45095d8d3af872663ed5ba10d7753abaa52d55294b08: Status 404 returned error can't find the container with id 7d81ca8371f2f0540b0a45095d8d3af872663ed5ba10d7753abaa52d55294b08
Jul 07 18:03:23.614949 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:23.614917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zw7r4" event={"ID":"49387ada-439f-4eb1-8034-18bfe68da0d0","Type":"ContainerStarted","Data":"7d81ca8371f2f0540b0a45095d8d3af872663ed5ba10d7753abaa52d55294b08"}
Jul 07 18:03:25.626205 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:25.626169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zw7r4" event={"ID":"49387ada-439f-4eb1-8034-18bfe68da0d0","Type":"ContainerStarted","Data":"e3402bac7433dfde7b13e0ea4cab9854d748fcd09406d6cd20d3d761d4a3d545"}
Jul 07 18:03:25.626737 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:25.626282    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:25.627938 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:25.627905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-f7696796f-8tnsw" event={"ID":"c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf","Type":"ContainerStarted","Data":"54264ab4df5e4aacec1cdc1fd0f0475796b9402f735ed89b64ca9b8106f603a5"}
Jul 07 18:03:25.628040 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:25.627991    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:25.645383 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:25.645315    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zw7r4" podStartSLOduration=1.888945876 podStartE2EDuration="3.64529959s" totalImagesPullingTime="1.756353714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:03:25.644524595 +0000 UTC m=+607.258083328" watchObservedRunningTime="2026-07-07 18:03:25.64529959 +0000 UTC m=+607.258858349"
Jul 07 18:03:25.662576 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:25.662503    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-f7696796f-8tnsw" podStartSLOduration=2.440941934 podStartE2EDuration="4.662487467s" totalImagesPullingTime="2.221545533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:03:25.661635064 +0000 UTC m=+607.275193770" watchObservedRunningTime="2026-07-07 18:03:25.662487467 +0000 UTC m=+607.276046188"
Jul 07 18:03:30.655760 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:30.655727    2576 generic.go:356] "Generic (PLEG): container finished" podID="88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897" containerID="6d01629f5bf52e58c58a9d7c17a9bace592920ea66e78085823beee9ab58716a" exitCode=0
Jul 07 18:03:30.656185 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:30.655805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" event={"ID":"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897","Type":"ContainerDied","Data":"6d01629f5bf52e58c58a9d7c17a9bace592920ea66e78085823beee9ab58716a"}
Jul 07 18:03:30.656229 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:30.656189    2576 scope.go:117] "RemoveContainer" containerID="6d01629f5bf52e58c58a9d7c17a9bace592920ea66e78085823beee9ab58716a"
Jul 07 18:03:30.657219 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:30.657192    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:03:30.657281 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:30.657261    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:03:30.657315 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:30.657293    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:03:31.638705 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:31.638668    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-f7696796f-8tnsw"
Jul 07 18:03:31.665305 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:31.665268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" event={"ID":"88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897","Type":"ContainerStarted","Data":"c9dce9a25bd930ef69d191e5a5860690bf6ad6ad38b70c20214f78a2be4eb79e"}
Jul 07 18:03:32.150545 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:32.150488    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:03:32.150835 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:32.150813    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-889fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 07 18:03:32.150891 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:32.150865    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" podUID="88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 07 18:03:33.150743 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:33.150704    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-889fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 07 18:03:33.151157 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:33.150763    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" podUID="88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 07 18:03:34.150478 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:34.150437    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-889fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 07 18:03:34.150658 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:34.150498    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" podUID="88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 07 18:03:35.150600 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:35.150565    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-889fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 07 18:03:35.151018 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:35.150623    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn" podUID="88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 07 18:03:36.154448 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:36.154417    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:03:36.154821 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:36.154709    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:03:36.155488 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:36.155467    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-889fn"
Jul 07 18:03:36.635859 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:36.635826    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zw7r4"
Jul 07 18:03:45.535160 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.535121    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"]
Jul 07 18:03:45.538875 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.538856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.543199 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.543177    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 18:03:45.543312 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.543177    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 18:03:45.543312 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.543180    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 18:03:45.543312 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.543187    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dbltm\""
Jul 07 18:03:45.551037 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.551013    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"]
Jul 07 18:03:45.618763 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.618726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.618968 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.618778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.618968 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.618809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.618968 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.618858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b71865-1b18-49ec-a252-c59ff8fef952-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.618968 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.618886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wqtn\" (UniqueName: \"kubernetes.io/projected/b2b71865-1b18-49ec-a252-c59ff8fef952-kube-api-access-8wqtn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.618968 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.618939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.720494 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.720456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.720698 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.720527    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.720698 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.720556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.720698 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.720576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.720698 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.720602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b71865-1b18-49ec-a252-c59ff8fef952-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.720911 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.720705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wqtn\" (UniqueName: \"kubernetes.io/projected/b2b71865-1b18-49ec-a252-c59ff8fef952-kube-api-access-8wqtn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.721020 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.720999    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.721080 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.721042    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.721116 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.721087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.722894 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.722862    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2b71865-1b18-49ec-a252-c59ff8fef952-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.723237 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.723216    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2b71865-1b18-49ec-a252-c59ff8fef952-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.730902 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.730877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wqtn\" (UniqueName: \"kubernetes.io/projected/b2b71865-1b18-49ec-a252-c59ff8fef952-kube-api-access-8wqtn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt\" (UID: \"b2b71865-1b18-49ec-a252-c59ff8fef952\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.849924 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.849877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:45.995954 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:45.995918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"]
Jul 07 18:03:45.999045 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:03:45.999019    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b71865_1b18_49ec_a252_c59ff8fef952.slice/crio-29a3f9ba1bd90edf50833dd41f9dfa2d8cc8366d1deb7c59027c5b5c4f2103c3 WatchSource:0}: Error finding container 29a3f9ba1bd90edf50833dd41f9dfa2d8cc8366d1deb7c59027c5b5c4f2103c3: Status 404 returned error can't find the container with id 29a3f9ba1bd90edf50833dd41f9dfa2d8cc8366d1deb7c59027c5b5c4f2103c3
Jul 07 18:03:46.000632 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:46.000614    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:03:46.754241 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:46.754208    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt" event={"ID":"b2b71865-1b18-49ec-a252-c59ff8fef952","Type":"ContainerStarted","Data":"29a3f9ba1bd90edf50833dd41f9dfa2d8cc8366d1deb7c59027c5b5c4f2103c3"}
Jul 07 18:03:47.761140 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:47.761105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt" event={"ID":"b2b71865-1b18-49ec-a252-c59ff8fef952","Type":"ContainerStarted","Data":"66f27e59714c940940c1bd6e76bee53a484256a5dae9274a393ad1326986116e"}
Jul 07 18:03:47.782324 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:47.782266    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt" podStartSLOduration=1.610837176 podStartE2EDuration="2.782249653s" totalImagesPullingTime="1.171412477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:03:47.781261028 +0000 UTC m=+629.394819752" watchObservedRunningTime="2026-07-07 18:03:47.782249653 +0000 UTC m=+629.395808356"
Jul 07 18:03:55.851113 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:55.851070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:55.851719 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:55.851137    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:55.870259 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:55.870228    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:03:56.816918 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:03:56.816888    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt"
Jul 07 18:04:17.265178 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.265142    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"]
Jul 07 18:04:17.268680 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.268664    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.272975 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.272952    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 18:04:17.321789 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.321751    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"]
Jul 07 18:04:17.337594 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.337556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.337812 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.337670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99ssk\" (UniqueName: \"kubernetes.io/projected/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-kube-api-access-99ssk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.337812 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.337770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.337812 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.337798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.337812 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.337822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.338117 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.337849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439173 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439407 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99ssk\" (UniqueName: \"kubernetes.io/projected/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-kube-api-access-99ssk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439407 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439407 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439545 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439545 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439635 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439588    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439671 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439640    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.439821 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.439795    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.441804 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.441781    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.442091 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.442071    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.448682 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.448661    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99ssk\" (UniqueName: \"kubernetes.io/projected/00a3cb3c-b4c4-46b3-ba20-64d59f06f29e-kube-api-access-99ssk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9\" (UID: \"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.580878 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.580835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:17.728980 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.728949    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"]
Jul 07 18:04:17.729730 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:04:17.729700    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a3cb3c_b4c4_46b3_ba20_64d59f06f29e.slice/crio-cfd9315d54b28b2d49ff38ed47d76016769d918f0a3e69511a364b14524ec6b8 WatchSource:0}: Error finding container cfd9315d54b28b2d49ff38ed47d76016769d918f0a3e69511a364b14524ec6b8: Status 404 returned error can't find the container with id cfd9315d54b28b2d49ff38ed47d76016769d918f0a3e69511a364b14524ec6b8
Jul 07 18:04:17.912036 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:17.911948    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9" event={"ID":"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e","Type":"ContainerStarted","Data":"cfd9315d54b28b2d49ff38ed47d76016769d918f0a3e69511a364b14524ec6b8"}
Jul 07 18:04:18.918648 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:18.918612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9" event={"ID":"00a3cb3c-b4c4-46b3-ba20-64d59f06f29e","Type":"ContainerStarted","Data":"826a470f27c493474e3b69a7ad737b35af6bc56f57baff24b25c17ae0c4ddd4f"}
Jul 07 18:04:18.938860 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:18.938810    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9" podStartSLOduration=1.7278681329999999 podStartE2EDuration="1.938790281s" totalImagesPullingTime="210.922148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:04:18.937654681 +0000 UTC m=+660.551213413" watchObservedRunningTime="2026-07-07 18:04:18.938790281 +0000 UTC m=+660.552348988"
Jul 07 18:04:27.581251 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:27.581208    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:27.581763 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:27.581285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:27.593671 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:27.593644    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:04:27.978069 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:04:27.977973    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9"
Jul 07 18:19:36.760704 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.760673    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"]
Jul 07 18:19:36.765117 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.765092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.770547 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.770523    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1a7f1752-openshift-default-dockercfg-wpjm8\""
Jul 07 18:19:36.804762 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.804726    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"]
Jul 07 18:19:36.930267 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skl9r\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-kube-api-access-skl9r\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.930267 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-token\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.930520 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-credential-socket\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.930520 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-envoy\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.930520 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-certs\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.930520 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istiod-ca-cert\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.930651 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-data\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.930651 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-podinfo\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:36.930719 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:36.930648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-socket\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.031705 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.031616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-envoy\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.031705 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.031658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-certs\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.031705 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.031683    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istiod-ca-cert\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.031953 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.031720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-data\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.031953 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.031740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-podinfo\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.031953 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.031764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-socket\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.031953 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.031806    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skl9r\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-kube-api-access-skl9r\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.032138 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.031943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-token\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.032138 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.032006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-credential-socket\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.032138 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.032110    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-certs\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.032296 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.032157    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-data\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.032372 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.032307    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-socket\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.032421 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.032381    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-credential-socket\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.032709 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.032689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istiod-ca-cert\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.034176 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.034157    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-envoy\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.034309 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.034289    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-podinfo\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.042140 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.042114    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-token\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.044297 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.044274    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skl9r\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-kube-api-access-skl9r\") pod \"e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") " pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.077913 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.077877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:37.225967 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.225940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"]
Jul 07 18:19:37.227685 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:19:37.227654    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0d11e3_3f92_404d_913f_f624b9ea68d6.slice/crio-539a11c6a0909927b17e8dcf2a31092a5bbbe9f39007257d289b50812a23749a WatchSource:0}: Error finding container 539a11c6a0909927b17e8dcf2a31092a5bbbe9f39007257d289b50812a23749a: Status 404 returned error can't find the container with id 539a11c6a0909927b17e8dcf2a31092a5bbbe9f39007257d289b50812a23749a
Jul 07 18:19:37.229901 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.229868    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:19:37.230002 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.229984    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:19:37.230066 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.230034    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:19:37.547253 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.547155    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc" event={"ID":"7c0d11e3-3f92-404d-913f-f624b9ea68d6","Type":"ContainerStarted","Data":"e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d"}
Jul 07 18:19:37.547253 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.547236    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc" event={"ID":"7c0d11e3-3f92-404d-913f-f624b9ea68d6","Type":"ContainerStarted","Data":"539a11c6a0909927b17e8dcf2a31092a5bbbe9f39007257d289b50812a23749a"}
Jul 07 18:19:37.571947 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:37.571893    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc" podStartSLOduration=1.571875307 podStartE2EDuration="1.571875307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:19:37.570288187 +0000 UTC m=+1579.183846941" watchObservedRunningTime="2026-07-07 18:19:37.571875307 +0000 UTC m=+1579.185434010"
Jul 07 18:19:38.078605 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.078562    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:38.083931 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.083907    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:38.134115 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.134080    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"]
Jul 07 18:19:38.137371 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.137336    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.140724 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.140704    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-1a7f1752-serving-cert\""
Jul 07 18:19:38.150154 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.150130    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"]
Jul 07 18:19:38.245554 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.245513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.245744 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.245570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x9gf\" (UniqueName: \"kubernetes.io/projected/80ac4656-dfac-4dc7-a8fc-02138d114101-kube-api-access-5x9gf\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.245744 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.245702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ac4656-dfac-4dc7-a8fc-02138d114101-openshift-service-ca\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.346923 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.346832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.346923 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.346876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x9gf\" (UniqueName: \"kubernetes.io/projected/80ac4656-dfac-4dc7-a8fc-02138d114101-kube-api-access-5x9gf\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.347123 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.346956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ac4656-dfac-4dc7-a8fc-02138d114101-openshift-service-ca\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.347123 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:19:38.346998    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-1a7f1752-serving-cert: secret "maas-api-e2e-ait-1a7f1752-serving-cert" not found
Jul 07 18:19:38.347123 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:19:38.347077    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls podName:80ac4656-dfac-4dc7-a8fc-02138d114101 nodeName:}" failed. No retries permitted until 2026-07-07 18:19:38.847055299 +0000 UTC m=+1580.460613984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls") pod "maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l" (UID: "80ac4656-dfac-4dc7-a8fc-02138d114101") : secret "maas-api-e2e-ait-1a7f1752-serving-cert" not found
Jul 07 18:19:38.347718 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.347698    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ac4656-dfac-4dc7-a8fc-02138d114101-openshift-service-ca\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.366933 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.366903    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x9gf\" (UniqueName: \"kubernetes.io/projected/80ac4656-dfac-4dc7-a8fc-02138d114101-kube-api-access-5x9gf\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.552892 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.552847    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:38.553842 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.553820    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:38.851879 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.851842    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:38.854479 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:38.854458    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls\") pod \"maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") " pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:39.049401 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:39.049291    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:39.194380 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:39.194333    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"]
Jul 07 18:19:39.196502 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:19:39.196477    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ac4656_dfac_4dc7_a8fc_02138d114101.slice/crio-07608241b579bb6308bd6f05dea406e64f58592835bd1c00323bd21253a930bd WatchSource:0}: Error finding container 07608241b579bb6308bd6f05dea406e64f58592835bd1c00323bd21253a930bd: Status 404 returned error can't find the container with id 07608241b579bb6308bd6f05dea406e64f58592835bd1c00323bd21253a930bd
Jul 07 18:19:39.197940 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:39.197920    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:19:39.559406 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:39.559368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l" event={"ID":"80ac4656-dfac-4dc7-a8fc-02138d114101","Type":"ContainerStarted","Data":"07608241b579bb6308bd6f05dea406e64f58592835bd1c00323bd21253a930bd"}
Jul 07 18:19:40.566234 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:40.566188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l" event={"ID":"80ac4656-dfac-4dc7-a8fc-02138d114101","Type":"ContainerStarted","Data":"8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975"}
Jul 07 18:19:40.566744 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:40.566458    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:40.605704 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:40.605645    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l" podStartSLOduration=2.028275602 podStartE2EDuration="2.605627984s" totalImagesPullingTime="577.352382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:19:40.6035345 +0000 UTC m=+1582.217093203" watchObservedRunningTime="2026-07-07 18:19:40.605627984 +0000 UTC m=+1582.219186688"
Jul 07 18:19:43.302646 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.302609    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"]
Jul 07 18:19:43.303147 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.302943    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc" podUID="7c0d11e3-3f92-404d-913f-f624b9ea68d6" containerName="istio-proxy" containerID="cri-o://e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d" gracePeriod=30
Jul 07 18:19:43.540808 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.540772    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"]
Jul 07 18:19:43.541029 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.541003    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l" podUID="80ac4656-dfac-4dc7-a8fc-02138d114101" containerName="maas-api" containerID="cri-o://8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975" gracePeriod=30
Jul 07 18:19:43.837097 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.837072    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:43.903896 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.903862    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ac4656-dfac-4dc7-a8fc-02138d114101-openshift-service-ca\") pod \"80ac4656-dfac-4dc7-a8fc-02138d114101\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") "
Jul 07 18:19:43.904071 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.904009    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x9gf\" (UniqueName: \"kubernetes.io/projected/80ac4656-dfac-4dc7-a8fc-02138d114101-kube-api-access-5x9gf\") pod \"80ac4656-dfac-4dc7-a8fc-02138d114101\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") "
Jul 07 18:19:43.904071 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.904034    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls\") pod \"80ac4656-dfac-4dc7-a8fc-02138d114101\" (UID: \"80ac4656-dfac-4dc7-a8fc-02138d114101\") "
Jul 07 18:19:43.904233 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.904206    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80ac4656-dfac-4dc7-a8fc-02138d114101-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80ac4656-dfac-4dc7-a8fc-02138d114101" (UID: "80ac4656-dfac-4dc7-a8fc-02138d114101"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:19:43.906300 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.906271    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80ac4656-dfac-4dc7-a8fc-02138d114101" (UID: "80ac4656-dfac-4dc7-a8fc-02138d114101"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:19:43.906483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:43.906460    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ac4656-dfac-4dc7-a8fc-02138d114101-kube-api-access-5x9gf" (OuterVolumeSpecName: "kube-api-access-5x9gf") pod "80ac4656-dfac-4dc7-a8fc-02138d114101" (UID: "80ac4656-dfac-4dc7-a8fc-02138d114101"). InnerVolumeSpecName "kube-api-access-5x9gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:19:44.004780 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.004740    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x9gf\" (UniqueName: \"kubernetes.io/projected/80ac4656-dfac-4dc7-a8fc-02138d114101-kube-api-access-5x9gf\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:44.004780 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.004774    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80ac4656-dfac-4dc7-a8fc-02138d114101-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:44.004780 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.004784    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80ac4656-dfac-4dc7-a8fc-02138d114101-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:44.599666 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.599632    2576 generic.go:356] "Generic (PLEG): container finished" podID="80ac4656-dfac-4dc7-a8fc-02138d114101" containerID="8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975" exitCode=0
Jul 07 18:19:44.600113 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.599677    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"
Jul 07 18:19:44.600113 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.599691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l" event={"ID":"80ac4656-dfac-4dc7-a8fc-02138d114101","Type":"ContainerDied","Data":"8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975"}
Jul 07 18:19:44.600113 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.599734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l" event={"ID":"80ac4656-dfac-4dc7-a8fc-02138d114101","Type":"ContainerDied","Data":"07608241b579bb6308bd6f05dea406e64f58592835bd1c00323bd21253a930bd"}
Jul 07 18:19:44.600113 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.599755    2576 scope.go:117] "RemoveContainer" containerID="8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975"
Jul 07 18:19:44.608870 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.608852    2576 scope.go:117] "RemoveContainer" containerID="8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975"
Jul 07 18:19:44.609118 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:19:44.609100    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975\": container with ID starting with 8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975 not found: ID does not exist" containerID="8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975"
Jul 07 18:19:44.609167 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.609126    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975"} err="failed to get container status \"8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975\": rpc error: code = NotFound desc = could not find container \"8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975\": container with ID starting with 8b61b63b35f5b86789f3780b9b484dd2da776e87a836d130e0a4a73bf2226975 not found: ID does not exist"
Jul 07 18:19:44.623797 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.623765    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"]
Jul 07 18:19:44.627851 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.627826    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-1a7f1752-6c9bc6f8fb-jlw8l"]
Jul 07 18:19:44.889588 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:44.889486    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ac4656-dfac-4dc7-a8fc-02138d114101" path="/var/lib/kubelet/pods/80ac4656-dfac-4dc7-a8fc-02138d114101/volumes"
Jul 07 18:19:48.471934 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.471909    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:48.553745 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.553648    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-token\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.553745 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.553697    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-socket\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.553745 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.553735    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-certs\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.554030 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.553767    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-envoy\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.554030 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.553851    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-data\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.554030 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.553893    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-credential-socket\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.554030 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.553931    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istiod-ca-cert\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.554030 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.553976    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skl9r\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-kube-api-access-skl9r\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.554271 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.554045    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-podinfo\") pod \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\" (UID: \"7c0d11e3-3f92-404d-913f-f624b9ea68d6\") "
Jul 07 18:19:48.554271 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.554037    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:48.554271 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.554052    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:48.554467 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.554336    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:19:48.554467 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.554394    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.554467 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.554182    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:48.554467 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.554412    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-workload-certs\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.554836 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.554630    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:48.556519 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.556488    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-kube-api-access-skl9r" (OuterVolumeSpecName: "kube-api-access-skl9r") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "kube-api-access-skl9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:19:48.556621 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.556521    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:19:48.556621 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.556581    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:19:48.556621 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.556586    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c0d11e3-3f92-404d-913f-f624b9ea68d6" (UID: "7c0d11e3-3f92-404d-913f-f624b9ea68d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:19:48.625099 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.625063    2576 generic.go:356] "Generic (PLEG): container finished" podID="7c0d11e3-3f92-404d-913f-f624b9ea68d6" containerID="e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d" exitCode=0
Jul 07 18:19:48.625259 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.625111    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"
Jul 07 18:19:48.625259 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.625149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc" event={"ID":"7c0d11e3-3f92-404d-913f-f624b9ea68d6","Type":"ContainerDied","Data":"e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d"}
Jul 07 18:19:48.625259 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.625204    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc" event={"ID":"7c0d11e3-3f92-404d-913f-f624b9ea68d6","Type":"ContainerDied","Data":"539a11c6a0909927b17e8dcf2a31092a5bbbe9f39007257d289b50812a23749a"}
Jul 07 18:19:48.625259 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.625226    2576 scope.go:117] "RemoveContainer" containerID="e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d"
Jul 07 18:19:48.634830 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.634811    2576 scope.go:117] "RemoveContainer" containerID="e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d"
Jul 07 18:19:48.635107 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:19:48.635088    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d\": container with ID starting with e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d not found: ID does not exist" containerID="e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d"
Jul 07 18:19:48.635159 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.635115    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d"} err="failed to get container status \"e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d\": rpc error: code = NotFound desc = could not find container \"e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d\": container with ID starting with e3b5b1db8572a6bc31154617b379d5567f9d73933e03cb7aaafe2120b8645f7d not found: ID does not exist"
Jul 07 18:19:48.653379 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.653332    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"]
Jul 07 18:19:48.661908 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.656689    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1a7f1752-openshift-default-75494b5b79-6pzkc"]
Jul 07 18:19:48.661908 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.656770    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-credential-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.661908 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.656797    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istiod-ca-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.661908 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.656812    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skl9r\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-kube-api-access-skl9r\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.661908 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.656826    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-podinfo\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.661908 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.656844    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-token\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.661908 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.656855    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-envoy\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.661908 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.656867    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c0d11e3-3f92-404d-913f-f624b9ea68d6-istio-data\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:48.885485 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:48.885451    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c0d11e3-3f92-404d-913f-f624b9ea68d6" path="/var/lib/kubelet/pods/7c0d11e3-3f92-404d-913f-f624b9ea68d6/volumes"
Jul 07 18:19:49.981245 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.981201    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"]
Jul 07 18:19:49.981853 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.981832    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c0d11e3-3f92-404d-913f-f624b9ea68d6" containerName="istio-proxy"
Jul 07 18:19:49.981951 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.981855    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c0d11e3-3f92-404d-913f-f624b9ea68d6" containerName="istio-proxy"
Jul 07 18:19:49.981951 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.981867    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ac4656-dfac-4dc7-a8fc-02138d114101" containerName="maas-api"
Jul 07 18:19:49.981951 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.981876    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ac4656-dfac-4dc7-a8fc-02138d114101" containerName="maas-api"
Jul 07 18:19:49.982114 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.982014    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c0d11e3-3f92-404d-913f-f624b9ea68d6" containerName="istio-proxy"
Jul 07 18:19:49.982114 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.982031    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ac4656-dfac-4dc7-a8fc-02138d114101" containerName="maas-api"
Jul 07 18:19:49.987088 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.987063    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:49.990142 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.990114    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2664be57-openshift-default-dockercfg-4dtp6\""
Jul 07 18:19:49.999895 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:49.999855    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"]
Jul 07 18:19:50.069746 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-token\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.069746 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1bf2849-f01e-4da6-99da-966931b57b5d-istiod-ca-cert\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.069989 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-data\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.069989 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-credential-socket\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.069989 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-certs\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.069989 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-podinfo\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.069989 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-socket\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.069989 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-envoy\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.070185 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.069999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz72c\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-kube-api-access-cz72c\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.170877 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.170835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-podinfo\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.170877 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.170877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-socket\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171148 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.170894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-envoy\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171148 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.170920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz72c\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-kube-api-access-cz72c\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171148 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.170946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-token\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171148 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.170963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1bf2849-f01e-4da6-99da-966931b57b5d-istiod-ca-cert\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171148 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.170993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-data\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171148 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.171055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-credential-socket\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171148 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.171083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-certs\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171567 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.171538    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-data\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171567 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.171559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-certs\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171674 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.171587    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-socket\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.171674 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.171655    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-credential-socket\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.172318 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.172286    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1bf2849-f01e-4da6-99da-966931b57b5d-istiod-ca-cert\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.173518 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.173461    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-envoy\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.173807 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.173784    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-podinfo\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.179615 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.179590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-token\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.179724 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.179668    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz72c\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-kube-api-access-cz72c\") pod \"e2e-ait-2664be57-openshift-default-57497d6565-hslmt\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") " pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.300169 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.300082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:50.444830 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.444798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"]
Jul 07 18:19:50.447072 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:19:50.447039    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bf2849_f01e_4da6_99da_966931b57b5d.slice/crio-108e6cb740996f3a24840f8d84c94a76b3e6f5dec988e5ab2c9fb46d5e902042 WatchSource:0}: Error finding container 108e6cb740996f3a24840f8d84c94a76b3e6f5dec988e5ab2c9fb46d5e902042: Status 404 returned error can't find the container with id 108e6cb740996f3a24840f8d84c94a76b3e6f5dec988e5ab2c9fb46d5e902042
Jul 07 18:19:50.449300 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.449268    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:19:50.449416 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.449358    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:19:50.449416 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.449391    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:19:50.640421 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.640380    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt" event={"ID":"f1bf2849-f01e-4da6-99da-966931b57b5d","Type":"ContainerStarted","Data":"75995a25e443daf2545fb5bf912aad7b4b2c56130f4bbf53b95bf342a00e0111"}
Jul 07 18:19:50.640634 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.640442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt" event={"ID":"f1bf2849-f01e-4da6-99da-966931b57b5d","Type":"ContainerStarted","Data":"108e6cb740996f3a24840f8d84c94a76b3e6f5dec988e5ab2c9fb46d5e902042"}
Jul 07 18:19:50.664134 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:50.664063    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt" podStartSLOduration=1.664039856 podStartE2EDuration="1.664039856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:19:50.662659957 +0000 UTC m=+1592.276218662" watchObservedRunningTime="2026-07-07 18:19:50.664039856 +0000 UTC m=+1592.277598561"
Jul 07 18:19:51.204492 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.204456    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"]
Jul 07 18:19:51.208800 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.208774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.212958 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.212884    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-2664be57-serving-cert\""
Jul 07 18:19:51.222146 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.221013    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"]
Jul 07 18:19:51.283828 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.283789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhzdf\" (UniqueName: \"kubernetes.io/projected/d1c88473-15b4-4c0f-a2fa-17249548c1be-kube-api-access-lhzdf\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.284012 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.283902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c88473-15b4-4c0f-a2fa-17249548c1be-openshift-service-ca\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.284012 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.283929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c88473-15b4-4c0f-a2fa-17249548c1be-maas-api-tls\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.301233 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.301201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:51.306693 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.306657    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:51.384778 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.384720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhzdf\" (UniqueName: \"kubernetes.io/projected/d1c88473-15b4-4c0f-a2fa-17249548c1be-kube-api-access-lhzdf\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.384960 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.384833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c88473-15b4-4c0f-a2fa-17249548c1be-openshift-service-ca\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.384960 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.384859    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c88473-15b4-4c0f-a2fa-17249548c1be-maas-api-tls\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.385681 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.385663    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c88473-15b4-4c0f-a2fa-17249548c1be-openshift-service-ca\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.387761 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.387734    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c88473-15b4-4c0f-a2fa-17249548c1be-maas-api-tls\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.395458 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.395431    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhzdf\" (UniqueName: \"kubernetes.io/projected/d1c88473-15b4-4c0f-a2fa-17249548c1be-kube-api-access-lhzdf\") pod \"maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") " pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.527288 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.527195    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:51.646715 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.646681    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:51.648168 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.648143    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:19:51.679134 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:51.679104    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"]
Jul 07 18:19:51.679245 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:19:51.679205    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c88473_15b4_4c0f_a2fa_17249548c1be.slice/crio-f1f0b642a9fd483da00c959dcd8e0ad508bfd2c22d98e32bb1c1eae58e29efe5 WatchSource:0}: Error finding container f1f0b642a9fd483da00c959dcd8e0ad508bfd2c22d98e32bb1c1eae58e29efe5: Status 404 returned error can't find the container with id f1f0b642a9fd483da00c959dcd8e0ad508bfd2c22d98e32bb1c1eae58e29efe5
Jul 07 18:19:52.655877 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:52.655834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7" event={"ID":"d1c88473-15b4-4c0f-a2fa-17249548c1be","Type":"ContainerStarted","Data":"b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168"}
Jul 07 18:19:52.656300 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:52.655922    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7" event={"ID":"d1c88473-15b4-4c0f-a2fa-17249548c1be","Type":"ContainerStarted","Data":"f1f0b642a9fd483da00c959dcd8e0ad508bfd2c22d98e32bb1c1eae58e29efe5"}
Jul 07 18:19:52.675630 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:52.675571    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7" podStartSLOduration=1.276259587 podStartE2EDuration="1.675550952s" totalImagesPullingTime="399.291365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:19:52.674915737 +0000 UTC m=+1594.288474469" watchObservedRunningTime="2026-07-07 18:19:52.675550952 +0000 UTC m=+1594.289109655"
Jul 07 18:19:53.661323 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:53.661285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:56.789782 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:56.789728    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"]
Jul 07 18:19:56.790597 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:56.790556    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7" podUID="d1c88473-15b4-4c0f-a2fa-17249548c1be" containerName="maas-api" containerID="cri-o://b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168" gracePeriod=30
Jul 07 18:19:57.086373 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.085574    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:57.143862 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.143824    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c88473-15b4-4c0f-a2fa-17249548c1be-openshift-service-ca\") pod \"d1c88473-15b4-4c0f-a2fa-17249548c1be\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") "
Jul 07 18:19:57.144056 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.143918    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c88473-15b4-4c0f-a2fa-17249548c1be-maas-api-tls\") pod \"d1c88473-15b4-4c0f-a2fa-17249548c1be\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") "
Jul 07 18:19:57.144056 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.143951    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhzdf\" (UniqueName: \"kubernetes.io/projected/d1c88473-15b4-4c0f-a2fa-17249548c1be-kube-api-access-lhzdf\") pod \"d1c88473-15b4-4c0f-a2fa-17249548c1be\" (UID: \"d1c88473-15b4-4c0f-a2fa-17249548c1be\") "
Jul 07 18:19:57.144268 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.144241    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c88473-15b4-4c0f-a2fa-17249548c1be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1c88473-15b4-4c0f-a2fa-17249548c1be" (UID: "d1c88473-15b4-4c0f-a2fa-17249548c1be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:19:57.146179 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.146150    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1c88473-15b4-4c0f-a2fa-17249548c1be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1c88473-15b4-4c0f-a2fa-17249548c1be" (UID: "d1c88473-15b4-4c0f-a2fa-17249548c1be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:19:57.146179 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.146156    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1c88473-15b4-4c0f-a2fa-17249548c1be-kube-api-access-lhzdf" (OuterVolumeSpecName: "kube-api-access-lhzdf") pod "d1c88473-15b4-4c0f-a2fa-17249548c1be" (UID: "d1c88473-15b4-4c0f-a2fa-17249548c1be"). InnerVolumeSpecName "kube-api-access-lhzdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:19:57.245278 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.245224    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1c88473-15b4-4c0f-a2fa-17249548c1be-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:57.245278 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.245271    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhzdf\" (UniqueName: \"kubernetes.io/projected/d1c88473-15b4-4c0f-a2fa-17249548c1be-kube-api-access-lhzdf\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:57.245278 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.245281    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c88473-15b4-4c0f-a2fa-17249548c1be-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:19:57.692817 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.692776    2576 generic.go:356] "Generic (PLEG): container finished" podID="d1c88473-15b4-4c0f-a2fa-17249548c1be" containerID="b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168" exitCode=0
Jul 07 18:19:57.693022 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.692830    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7" event={"ID":"d1c88473-15b4-4c0f-a2fa-17249548c1be","Type":"ContainerDied","Data":"b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168"}
Jul 07 18:19:57.693022 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.692864    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"
Jul 07 18:19:57.693022 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.692914    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7" event={"ID":"d1c88473-15b4-4c0f-a2fa-17249548c1be","Type":"ContainerDied","Data":"f1f0b642a9fd483da00c959dcd8e0ad508bfd2c22d98e32bb1c1eae58e29efe5"}
Jul 07 18:19:57.693022 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.692951    2576 scope.go:117] "RemoveContainer" containerID="b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168"
Jul 07 18:19:57.703190 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.703168    2576 scope.go:117] "RemoveContainer" containerID="b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168"
Jul 07 18:19:57.703548 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:19:57.703528    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168\": container with ID starting with b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168 not found: ID does not exist" containerID="b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168"
Jul 07 18:19:57.703625 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.703557    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168"} err="failed to get container status \"b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168\": rpc error: code = NotFound desc = could not find container \"b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168\": container with ID starting with b054aaf3eb63096cea2121eba0bb07605fd17b060088b774b9f120d31043c168 not found: ID does not exist"
Jul 07 18:19:57.718165 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.718134    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"]
Jul 07 18:19:57.722437 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:57.722409    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-2664be57-6b697b58d5-p7qz7"]
Jul 07 18:19:58.888516 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:19:58.888481    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1c88473-15b4-4c0f-a2fa-17249548c1be" path="/var/lib/kubelet/pods/d1c88473-15b4-4c0f-a2fa-17249548c1be/volumes"
Jul 07 18:20:02.713531 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:02.713499    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"]
Jul 07 18:20:02.713982 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:02.713691    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt" podUID="f1bf2849-f01e-4da6-99da-966931b57b5d" containerName="istio-proxy" containerID="cri-o://75995a25e443daf2545fb5bf912aad7b4b2c56130f4bbf53b95bf342a00e0111" gracePeriod=30
Jul 07 18:20:02.724095 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:02.724065    2576 generic.go:356] "Generic (PLEG): container finished" podID="f1bf2849-f01e-4da6-99da-966931b57b5d" containerID="75995a25e443daf2545fb5bf912aad7b4b2c56130f4bbf53b95bf342a00e0111" exitCode=0
Jul 07 18:20:02.724276 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:02.724141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt" event={"ID":"f1bf2849-f01e-4da6-99da-966931b57b5d","Type":"ContainerDied","Data":"75995a25e443daf2545fb5bf912aad7b4b2c56130f4bbf53b95bf342a00e0111"}
Jul 07 18:20:02.869520 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:02.869496    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:20:03.004999 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.004900    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-envoy\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.004999 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.004941    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-credential-socket\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.004999 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.004968    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1bf2849-f01e-4da6-99da-966931b57b5d-istiod-ca-cert\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.005279 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005002    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-data\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.005279 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005051    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-socket\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.005279 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005158    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz72c\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-kube-api-access-cz72c\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.005279 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-token\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.005279 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005249    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-podinfo\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.005570 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005290    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-certs\") pod \"f1bf2849-f01e-4da6-99da-966931b57b5d\" (UID: \"f1bf2849-f01e-4da6-99da-966931b57b5d\") "
Jul 07 18:20:03.005570 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005291    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:03.005570 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005401    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:03.005570 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005450    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1bf2849-f01e-4da6-99da-966931b57b5d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:20:03.005785 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005609    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:03.006027 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.005993    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:03.007246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.007151    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-certs\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.007246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.007179    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-credential-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.007246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.007196    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1bf2849-f01e-4da6-99da-966931b57b5d-istiod-ca-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.007246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.007211    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-data\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.007246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.007223    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-workload-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.007654 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.007433    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:03.008042 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.008018    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-kube-api-access-cz72c" (OuterVolumeSpecName: "kube-api-access-cz72c") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "kube-api-access-cz72c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:20:03.008042 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.008029    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:20:03.008919 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.008898    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f1bf2849-f01e-4da6-99da-966931b57b5d" (UID: "f1bf2849-f01e-4da6-99da-966931b57b5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:20:03.108686 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.108638    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz72c\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-kube-api-access-cz72c\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.108686 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.108680    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-token\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.108686 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.108693    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-podinfo\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.108975 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.108704    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1bf2849-f01e-4da6-99da-966931b57b5d-istio-envoy\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:03.730888 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.730844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt" event={"ID":"f1bf2849-f01e-4da6-99da-966931b57b5d","Type":"ContainerDied","Data":"108e6cb740996f3a24840f8d84c94a76b3e6f5dec988e5ab2c9fb46d5e902042"}
Jul 07 18:20:03.730888 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.730877    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"
Jul 07 18:20:03.731460 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.730926    2576 scope.go:117] "RemoveContainer" containerID="75995a25e443daf2545fb5bf912aad7b4b2c56130f4bbf53b95bf342a00e0111"
Jul 07 18:20:03.759613 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.759584    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"]
Jul 07 18:20:03.761436 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:03.761419    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2664be57-openshift-default-57497d6565-hslmt"]
Jul 07 18:20:04.891070 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:04.891027    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1bf2849-f01e-4da6-99da-966931b57b5d" path="/var/lib/kubelet/pods/f1bf2849-f01e-4da6-99da-966931b57b5d/volumes"
Jul 07 18:20:09.638558 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.638524    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"]
Jul 07 18:20:09.638969 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.638915    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bf2849-f01e-4da6-99da-966931b57b5d" containerName="istio-proxy"
Jul 07 18:20:09.638969 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.638925    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bf2849-f01e-4da6-99da-966931b57b5d" containerName="istio-proxy"
Jul 07 18:20:09.638969 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.638936    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1c88473-15b4-4c0f-a2fa-17249548c1be" containerName="maas-api"
Jul 07 18:20:09.638969 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.638941    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1c88473-15b4-4c0f-a2fa-17249548c1be" containerName="maas-api"
Jul 07 18:20:09.639117 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.639021    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1bf2849-f01e-4da6-99da-966931b57b5d" containerName="istio-proxy"
Jul 07 18:20:09.639117 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.639034    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1c88473-15b4-4c0f-a2fa-17249548c1be" containerName="maas-api"
Jul 07 18:20:09.643816 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.643789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.650267 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.650244    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f432e606-openshift-default-dockercfg-6hqh2\""
Jul 07 18:20:09.666127 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.666097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"]
Jul 07 18:20:09.779776 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.779691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-credential-socket\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.779776 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.779741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-certs\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.779991 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.779840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-data\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.779991 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.779886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-istio-token\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.779991 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.779927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p2vg\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-kube-api-access-4p2vg\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.779991 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.779948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-socket\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.779991 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.779967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b38401-197f-42bf-89ca-daae24f61165-istio-podinfo\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.780225 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.779991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-envoy\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.780225 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.780026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b38401-197f-42bf-89ca-daae24f61165-istiod-ca-cert\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.880632 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-certs\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.880632 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-data\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.880849 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880678    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-istio-token\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.880849 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p2vg\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-kube-api-access-4p2vg\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.880849 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-socket\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.880849 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b38401-197f-42bf-89ca-daae24f61165-istio-podinfo\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.880849 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880802    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-envoy\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.880849 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b38401-197f-42bf-89ca-daae24f61165-istiod-ca-cert\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.881171 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.880887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-credential-socket\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.881171 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.881084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-data\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.881284 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.881175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-certs\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.881284 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.881205    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-socket\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.881447 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.881310    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-credential-socket\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.881672 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.881650    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b38401-197f-42bf-89ca-daae24f61165-istiod-ca-cert\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.883704 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.883680    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-envoy\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.883925 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.883903    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b38401-197f-42bf-89ca-daae24f61165-istio-podinfo\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.890549 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.890521    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-istio-token\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.890695 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.890676    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p2vg\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-kube-api-access-4p2vg\") pod \"e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") " pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:09.954778 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:09.954721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:10.105983 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.105954    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"]
Jul 07 18:20:10.107898 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:20:10.107870    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b38401_197f_42bf_89ca_daae24f61165.slice/crio-1f355b171b79e9d98df844f27b569f8679a513929e77c9bc845f986a5b57913c WatchSource:0}: Error finding container 1f355b171b79e9d98df844f27b569f8679a513929e77c9bc845f986a5b57913c: Status 404 returned error can't find the container with id 1f355b171b79e9d98df844f27b569f8679a513929e77c9bc845f986a5b57913c
Jul 07 18:20:10.110240 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.110207    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:20:10.110331 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.110272    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:20:10.110331 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.110304    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:20:10.775230 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.775189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg" event={"ID":"55b38401-197f-42bf-89ca-daae24f61165","Type":"ContainerStarted","Data":"df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0"}
Jul 07 18:20:10.775680 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.775289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg" event={"ID":"55b38401-197f-42bf-89ca-daae24f61165","Type":"ContainerStarted","Data":"1f355b171b79e9d98df844f27b569f8679a513929e77c9bc845f986a5b57913c"}
Jul 07 18:20:10.803626 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.803577    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg" podStartSLOduration=1.8035611569999999 podStartE2EDuration="1.803561157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:20:10.802378923 +0000 UTC m=+1612.415937651" watchObservedRunningTime="2026-07-07 18:20:10.803561157 +0000 UTC m=+1612.417119861"
Jul 07 18:20:10.861154 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.861117    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"]
Jul 07 18:20:10.864944 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.864924    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:10.867914 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.867892    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-f432e606-serving-cert\""
Jul 07 18:20:10.887946 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.887916    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"]
Jul 07 18:20:10.955486 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.955445    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:10.993749 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.993712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:10.993925 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.993853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckg9t\" (UniqueName: \"kubernetes.io/projected/139743ee-8b9d-4a67-a1db-b0c9749f3c69-kube-api-access-ckg9t\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:10.993925 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:10.993893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/139743ee-8b9d-4a67-a1db-b0c9749f3c69-openshift-service-ca\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.095455 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.095415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/139743ee-8b9d-4a67-a1db-b0c9749f3c69-openshift-service-ca\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.095649 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.095508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.095649 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.095582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckg9t\" (UniqueName: \"kubernetes.io/projected/139743ee-8b9d-4a67-a1db-b0c9749f3c69-kube-api-access-ckg9t\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.095731 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:20:11.095685    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-f432e606-serving-cert: secret "maas-api-e2e-derive-f432e606-serving-cert" not found
Jul 07 18:20:11.095780 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:20:11.095768    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls podName:139743ee-8b9d-4a67-a1db-b0c9749f3c69 nodeName:}" failed. No retries permitted until 2026-07-07 18:20:11.595743247 +0000 UTC m=+1613.209301933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls") pod "maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7" (UID: "139743ee-8b9d-4a67-a1db-b0c9749f3c69") : secret "maas-api-e2e-derive-f432e606-serving-cert" not found
Jul 07 18:20:11.096064 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.096042    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/139743ee-8b9d-4a67-a1db-b0c9749f3c69-openshift-service-ca\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.117752 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.117715    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckg9t\" (UniqueName: \"kubernetes.io/projected/139743ee-8b9d-4a67-a1db-b0c9749f3c69-kube-api-access-ckg9t\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.601673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.601616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.604275 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.604249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls\") pod \"maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") " pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.777891 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.777854    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:11.923390 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.923363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"]
Jul 07 18:20:11.925486 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:20:11.925462    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod139743ee_8b9d_4a67_a1db_b0c9749f3c69.slice/crio-08794c2bfce7f5fda2e3fe5642e47f356bc83d3d5f7dcbd3d1e5f64873c22e62 WatchSource:0}: Error finding container 08794c2bfce7f5fda2e3fe5642e47f356bc83d3d5f7dcbd3d1e5f64873c22e62: Status 404 returned error can't find the container with id 08794c2bfce7f5fda2e3fe5642e47f356bc83d3d5f7dcbd3d1e5f64873c22e62
Jul 07 18:20:11.960124 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:11.960093    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:12.786380 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:12.786231    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7" event={"ID":"139743ee-8b9d-4a67-a1db-b0c9749f3c69","Type":"ContainerStarted","Data":"66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a"}
Jul 07 18:20:12.786380 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:12.786294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7" event={"ID":"139743ee-8b9d-4a67-a1db-b0c9749f3c69","Type":"ContainerStarted","Data":"08794c2bfce7f5fda2e3fe5642e47f356bc83d3d5f7dcbd3d1e5f64873c22e62"}
Jul 07 18:20:12.786915 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:12.786588    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:12.787599 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:12.787579    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:12.810834 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:12.810785    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7" podStartSLOduration=2.386779942 podStartE2EDuration="2.810768129s" totalImagesPullingTime="423.988187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:20:12.808372166 +0000 UTC m=+1614.421930870" watchObservedRunningTime="2026-07-07 18:20:12.810768129 +0000 UTC m=+1614.424326848"
Jul 07 18:20:13.792528 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:13.792493    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:15.403972 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:15.403936    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"]
Jul 07 18:20:15.636591 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:15.636553    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"]
Jul 07 18:20:15.803708 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:15.803614    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg" podUID="55b38401-197f-42bf-89ca-daae24f61165" containerName="istio-proxy" containerID="cri-o://df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0" gracePeriod=30
Jul 07 18:20:15.803881 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:15.803701    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7" podUID="139743ee-8b9d-4a67-a1db-b0c9749f3c69" containerName="maas-api" containerID="cri-o://66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a" gracePeriod=30
Jul 07 18:20:16.101120 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.101095    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:16.153721 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.153681    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/139743ee-8b9d-4a67-a1db-b0c9749f3c69-openshift-service-ca\") pod \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") "
Jul 07 18:20:16.153721 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.153728    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls\") pod \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") "
Jul 07 18:20:16.153994 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.153784    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckg9t\" (UniqueName: \"kubernetes.io/projected/139743ee-8b9d-4a67-a1db-b0c9749f3c69-kube-api-access-ckg9t\") pod \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\" (UID: \"139743ee-8b9d-4a67-a1db-b0c9749f3c69\") "
Jul 07 18:20:16.154126 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.154098    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/139743ee-8b9d-4a67-a1db-b0c9749f3c69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "139743ee-8b9d-4a67-a1db-b0c9749f3c69" (UID: "139743ee-8b9d-4a67-a1db-b0c9749f3c69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:20:16.156038 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.156008    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/139743ee-8b9d-4a67-a1db-b0c9749f3c69-kube-api-access-ckg9t" (OuterVolumeSpecName: "kube-api-access-ckg9t") pod "139743ee-8b9d-4a67-a1db-b0c9749f3c69" (UID: "139743ee-8b9d-4a67-a1db-b0c9749f3c69"). InnerVolumeSpecName "kube-api-access-ckg9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:20:16.156038 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.156025    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "139743ee-8b9d-4a67-a1db-b0c9749f3c69" (UID: "139743ee-8b9d-4a67-a1db-b0c9749f3c69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:20:16.255333 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.255296    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckg9t\" (UniqueName: \"kubernetes.io/projected/139743ee-8b9d-4a67-a1db-b0c9749f3c69-kube-api-access-ckg9t\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:16.255333 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.255329    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/139743ee-8b9d-4a67-a1db-b0c9749f3c69-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:16.255571 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.255339    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/139743ee-8b9d-4a67-a1db-b0c9749f3c69-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:16.810015 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.809977    2576 generic.go:356] "Generic (PLEG): container finished" podID="139743ee-8b9d-4a67-a1db-b0c9749f3c69" containerID="66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a" exitCode=0
Jul 07 18:20:16.810476 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.810038    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"
Jul 07 18:20:16.810476 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.810059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7" event={"ID":"139743ee-8b9d-4a67-a1db-b0c9749f3c69","Type":"ContainerDied","Data":"66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a"}
Jul 07 18:20:16.810476 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.810126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7" event={"ID":"139743ee-8b9d-4a67-a1db-b0c9749f3c69","Type":"ContainerDied","Data":"08794c2bfce7f5fda2e3fe5642e47f356bc83d3d5f7dcbd3d1e5f64873c22e62"}
Jul 07 18:20:16.810476 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.810152    2576 scope.go:117] "RemoveContainer" containerID="66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a"
Jul 07 18:20:16.820121 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.820035    2576 scope.go:117] "RemoveContainer" containerID="66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a"
Jul 07 18:20:16.820577 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:20:16.820550    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a\": container with ID starting with 66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a not found: ID does not exist" containerID="66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a"
Jul 07 18:20:16.820709 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.820590    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a"} err="failed to get container status \"66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a\": rpc error: code = NotFound desc = could not find container \"66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a\": container with ID starting with 66718276b1797c1ac6236abab6213f83d73bb1887667ae520620ffe205d08a4a not found: ID does not exist"
Jul 07 18:20:16.836901 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.836873    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"]
Jul 07 18:20:16.841282 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.841245    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-f432e606-6b94c5555c-w5dk7"]
Jul 07 18:20:16.889360 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:16.889298    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="139743ee-8b9d-4a67-a1db-b0c9749f3c69" path="/var/lib/kubelet/pods/139743ee-8b9d-4a67-a1db-b0c9749f3c69/volumes"
Jul 07 18:20:21.564172 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.564147    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:21.613699 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b38401-197f-42bf-89ca-daae24f61165-istio-podinfo\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613699 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613652    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-socket\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613699 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613679    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b38401-197f-42bf-89ca-daae24f61165-istiod-ca-cert\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613977 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613718    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-credential-socket\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613977 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p2vg\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-kube-api-access-4p2vg\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613977 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613782    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-istio-token\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613977 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613853    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-certs\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613977 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613889    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-data\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613977 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613913    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-envoy\") pod \"55b38401-197f-42bf-89ca-daae24f61165\" (UID: \"55b38401-197f-42bf-89ca-daae24f61165\") "
Jul 07 18:20:21.613977 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.613919    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:21.614337 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.614097    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:21.614337 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.614176    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:21.614337 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.614294    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-credential-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.614337 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.614303    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55b38401-197f-42bf-89ca-daae24f61165-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:20:21.614337 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.614316    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-certs\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.614337 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.614332    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-workload-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.615318 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.615290    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-data" (OuterVolumeSpecName: "istio-data") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:21.616390 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.616364    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-istio-token" (OuterVolumeSpecName: "istio-token") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:20:21.616390 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.616373    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-kube-api-access-4p2vg" (OuterVolumeSpecName: "kube-api-access-4p2vg") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "kube-api-access-4p2vg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:20:21.616554 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.616440    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:20:21.616797 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.616778    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55b38401-197f-42bf-89ca-daae24f61165-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55b38401-197f-42bf-89ca-daae24f61165" (UID: "55b38401-197f-42bf-89ca-daae24f61165"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:20:21.715855 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.715819    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-data\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.715855 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.715846    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b38401-197f-42bf-89ca-daae24f61165-istio-envoy\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.715855 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.715855    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b38401-197f-42bf-89ca-daae24f61165-istio-podinfo\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.715855 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.715863    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b38401-197f-42bf-89ca-daae24f61165-istiod-ca-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.716139 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.715871    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p2vg\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-kube-api-access-4p2vg\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.716139 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.715880    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b38401-197f-42bf-89ca-daae24f61165-istio-token\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:20:21.840686 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.840648    2576 generic.go:356] "Generic (PLEG): container finished" podID="55b38401-197f-42bf-89ca-daae24f61165" containerID="df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0" exitCode=0
Jul 07 18:20:21.840839 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.840691    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg" event={"ID":"55b38401-197f-42bf-89ca-daae24f61165","Type":"ContainerDied","Data":"df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0"}
Jul 07 18:20:21.840839 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.840706    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"
Jul 07 18:20:21.840839 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.840761    2576 scope.go:117] "RemoveContainer" containerID="df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0"
Jul 07 18:20:21.841033 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.840750    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg" event={"ID":"55b38401-197f-42bf-89ca-daae24f61165","Type":"ContainerDied","Data":"1f355b171b79e9d98df844f27b569f8679a513929e77c9bc845f986a5b57913c"}
Jul 07 18:20:21.850717 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.850698    2576 scope.go:117] "RemoveContainer" containerID="df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0"
Jul 07 18:20:21.850994 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:20:21.850975    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0\": container with ID starting with df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0 not found: ID does not exist" containerID="df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0"
Jul 07 18:20:21.851049 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.851013    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0"} err="failed to get container status \"df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0\": rpc error: code = NotFound desc = could not find container \"df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0\": container with ID starting with df072ddef5a19a75dcbadd96af7a39c51dbd2ce8ff46222b9c98ba64b1c8c8f0 not found: ID does not exist"
Jul 07 18:20:21.874681 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.874593    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"]
Jul 07 18:20:21.890071 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:21.889998    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f432e606-openshift-default-c4bc6f859-2dvxg"]
Jul 07 18:20:22.885362 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:20:22.885314    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55b38401-197f-42bf-89ca-daae24f61165" path="/var/lib/kubelet/pods/55b38401-197f-42bf-89ca-daae24f61165/volumes"
Jul 07 18:22:00.396906 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.396858    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"]
Jul 07 18:22:00.397483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.397302    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="139743ee-8b9d-4a67-a1db-b0c9749f3c69" containerName="maas-api"
Jul 07 18:22:00.397483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.397315    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="139743ee-8b9d-4a67-a1db-b0c9749f3c69" containerName="maas-api"
Jul 07 18:22:00.397483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.397331    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b38401-197f-42bf-89ca-daae24f61165" containerName="istio-proxy"
Jul 07 18:22:00.397483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.397336    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b38401-197f-42bf-89ca-daae24f61165" containerName="istio-proxy"
Jul 07 18:22:00.397483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.397425    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="55b38401-197f-42bf-89ca-daae24f61165" containerName="istio-proxy"
Jul 07 18:22:00.397483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.397434    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="139743ee-8b9d-4a67-a1db-b0c9749f3c69" containerName="maas-api"
Jul 07 18:22:00.400537 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.400522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.403582 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.403561    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-52675068-openshift-default-dockercfg-98kw9\""
Jul 07 18:22:00.427993 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.427958    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"]
Jul 07 18:22:00.498121 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-certs\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.498121 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-socket\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.498392 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6nbl\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-kube-api-access-d6nbl\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.498392 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/284d1155-5051-4917-a203-644c8f62200f-istio-podinfo\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.498392 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-istio-token\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.498392 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-envoy\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.498392 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/284d1155-5051-4917-a203-644c8f62200f-istiod-ca-cert\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.498593 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-data\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.498593 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.498428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-credential-socket\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599339 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-certs\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599339 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-socket\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599339 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6nbl\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-kube-api-access-d6nbl\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599339 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/284d1155-5051-4917-a203-644c8f62200f-istio-podinfo\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599339 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-istio-token\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-envoy\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/284d1155-5051-4917-a203-644c8f62200f-istiod-ca-cert\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-data\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-credential-socket\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.599890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599775    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-certs\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.600140 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.599952    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-data\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.600140 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.600029    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-credential-socket\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.600140 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.600114    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-socket\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.600295 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.600277    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/284d1155-5051-4917-a203-644c8f62200f-istiod-ca-cert\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.601915 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.601894    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-envoy\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.602122 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.602102    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/284d1155-5051-4917-a203-644c8f62200f-istio-podinfo\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.611382 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.611296    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6nbl\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-kube-api-access-d6nbl\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.612412 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.612381    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-istio-token\") pod \"e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") " pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.710740 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.710652    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:00.861055 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.861029    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"]
Jul 07 18:22:00.864139 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:22:00.864113    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284d1155_5051_4917_a203_644c8f62200f.slice/crio-807e54d1f62f5abc70c0825171554b5946019bf5a7588160d1f4fbfad43efa4e WatchSource:0}: Error finding container 807e54d1f62f5abc70c0825171554b5946019bf5a7588160d1f4fbfad43efa4e: Status 404 returned error can't find the container with id 807e54d1f62f5abc70c0825171554b5946019bf5a7588160d1f4fbfad43efa4e
Jul 07 18:22:00.866204 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.866175    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:00.866262 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.866243    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:00.866303 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:00.866274    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:01.349453 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:01.349410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" event={"ID":"284d1155-5051-4917-a203-644c8f62200f","Type":"ContainerStarted","Data":"7eeef69fb9b497131393ac5ea94b4988a459a5352aafb5b7b964e47f16ea166d"}
Jul 07 18:22:01.349643 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:01.349472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" event={"ID":"284d1155-5051-4917-a203-644c8f62200f","Type":"ContainerStarted","Data":"807e54d1f62f5abc70c0825171554b5946019bf5a7588160d1f4fbfad43efa4e"}
Jul 07 18:22:01.379330 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:01.379277    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" podStartSLOduration=1.379255819 podStartE2EDuration="1.379255819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:01.378792771 +0000 UTC m=+1722.992351486" watchObservedRunningTime="2026-07-07 18:22:01.379255819 +0000 UTC m=+1722.992814524"
Jul 07 18:22:01.711047 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:01.710943    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:01.715813 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:01.715785    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:02.355072 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:02.355041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:02.356038 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:02.356014    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:03.485439 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.485404    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"]
Jul 07 18:22:03.489019 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.488995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.492069 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.492047    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-52675068-serving-cert\""
Jul 07 18:22:03.510462 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.510407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"]
Jul 07 18:22:03.634977 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.634930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b919b51-830e-4b1d-ab18-0491c9bc62d3-openshift-service-ca\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.635198 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.635094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b919b51-830e-4b1d-ab18-0491c9bc62d3-maas-api-tls\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.635198 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.635149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2v6j\" (UniqueName: \"kubernetes.io/projected/3b919b51-830e-4b1d-ab18-0491c9bc62d3-kube-api-access-n2v6j\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.736172 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.736054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b919b51-830e-4b1d-ab18-0491c9bc62d3-openshift-service-ca\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.736172 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.736151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b919b51-830e-4b1d-ab18-0491c9bc62d3-maas-api-tls\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.736481 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.736180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2v6j\" (UniqueName: \"kubernetes.io/projected/3b919b51-830e-4b1d-ab18-0491c9bc62d3-kube-api-access-n2v6j\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.736795 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.736772    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b919b51-830e-4b1d-ab18-0491c9bc62d3-openshift-service-ca\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.739160 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.739108    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b919b51-830e-4b1d-ab18-0491c9bc62d3-maas-api-tls\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.748407 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.748377    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2v6j\" (UniqueName: \"kubernetes.io/projected/3b919b51-830e-4b1d-ab18-0491c9bc62d3-kube-api-access-n2v6j\") pod \"maas-api-e2e-mt-52675068-7d66764bd8-5fcj7\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") " pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.802802 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.802761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:03.949984 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:03.949952    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"]
Jul 07 18:22:03.951794 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:22:03.951760    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b919b51_830e_4b1d_ab18_0491c9bc62d3.slice/crio-82fbafda3b6f815b1b52d7b2c61725838dde341b21d5551aa360aa1cdaa682de WatchSource:0}: Error finding container 82fbafda3b6f815b1b52d7b2c61725838dde341b21d5551aa360aa1cdaa682de: Status 404 returned error can't find the container with id 82fbafda3b6f815b1b52d7b2c61725838dde341b21d5551aa360aa1cdaa682de
Jul 07 18:22:04.366041 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:04.366004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7" event={"ID":"3b919b51-830e-4b1d-ab18-0491c9bc62d3","Type":"ContainerStarted","Data":"82fbafda3b6f815b1b52d7b2c61725838dde341b21d5551aa360aa1cdaa682de"}
Jul 07 18:22:05.372741 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:05.372701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7" event={"ID":"3b919b51-830e-4b1d-ab18-0491c9bc62d3","Type":"ContainerStarted","Data":"1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571"}
Jul 07 18:22:05.373141 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:05.372819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:05.398863 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:05.398784    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7" podStartSLOduration=1.5982264069999998 podStartE2EDuration="2.398768346s" totalImagesPullingTime="800.541939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:05.395044058 +0000 UTC m=+1727.008602785" watchObservedRunningTime="2026-07-07 18:22:05.398768346 +0000 UTC m=+1727.012327061"
Jul 07 18:22:11.392379 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:11.392318    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:16.429550 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.429511    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"]
Jul 07 18:22:16.430001 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.429715    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7" podUID="3b919b51-830e-4b1d-ab18-0491c9bc62d3" containerName="maas-api" containerID="cri-o://1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571" gracePeriod=30
Jul 07 18:22:16.692407 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.692301    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:16.753149 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.753116    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b919b51-830e-4b1d-ab18-0491c9bc62d3-openshift-service-ca\") pod \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") "
Jul 07 18:22:16.753335 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.753300    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2v6j\" (UniqueName: \"kubernetes.io/projected/3b919b51-830e-4b1d-ab18-0491c9bc62d3-kube-api-access-n2v6j\") pod \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") "
Jul 07 18:22:16.753438 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.753397    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b919b51-830e-4b1d-ab18-0491c9bc62d3-maas-api-tls\") pod \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\" (UID: \"3b919b51-830e-4b1d-ab18-0491c9bc62d3\") "
Jul 07 18:22:16.753728 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.753691    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b919b51-830e-4b1d-ab18-0491c9bc62d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b919b51-830e-4b1d-ab18-0491c9bc62d3" (UID: "3b919b51-830e-4b1d-ab18-0491c9bc62d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:22:16.754828 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.754806    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b919b51-830e-4b1d-ab18-0491c9bc62d3-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:16.756287 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.756256    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b919b51-830e-4b1d-ab18-0491c9bc62d3-kube-api-access-n2v6j" (OuterVolumeSpecName: "kube-api-access-n2v6j") pod "3b919b51-830e-4b1d-ab18-0491c9bc62d3" (UID: "3b919b51-830e-4b1d-ab18-0491c9bc62d3"). InnerVolumeSpecName "kube-api-access-n2v6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:22:16.756441 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.756324    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b919b51-830e-4b1d-ab18-0491c9bc62d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b919b51-830e-4b1d-ab18-0491c9bc62d3" (UID: "3b919b51-830e-4b1d-ab18-0491c9bc62d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:22:16.855808 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.855755    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2v6j\" (UniqueName: \"kubernetes.io/projected/3b919b51-830e-4b1d-ab18-0491c9bc62d3-kube-api-access-n2v6j\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:16.855808 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:16.855789    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b919b51-830e-4b1d-ab18-0491c9bc62d3-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:17.439445 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.439409    2576 generic.go:356] "Generic (PLEG): container finished" podID="3b919b51-830e-4b1d-ab18-0491c9bc62d3" containerID="1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571" exitCode=0
Jul 07 18:22:17.439920 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.439457    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"
Jul 07 18:22:17.439920 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.439490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7" event={"ID":"3b919b51-830e-4b1d-ab18-0491c9bc62d3","Type":"ContainerDied","Data":"1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571"}
Jul 07 18:22:17.439920 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.439565    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7" event={"ID":"3b919b51-830e-4b1d-ab18-0491c9bc62d3","Type":"ContainerDied","Data":"82fbafda3b6f815b1b52d7b2c61725838dde341b21d5551aa360aa1cdaa682de"}
Jul 07 18:22:17.439920 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.439600    2576 scope.go:117] "RemoveContainer" containerID="1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571"
Jul 07 18:22:17.450543 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.450522    2576 scope.go:117] "RemoveContainer" containerID="1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571"
Jul 07 18:22:17.450870 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:22:17.450846    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571\": container with ID starting with 1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571 not found: ID does not exist" containerID="1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571"
Jul 07 18:22:17.450981 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.450878    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571"} err="failed to get container status \"1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571\": rpc error: code = NotFound desc = could not find container \"1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571\": container with ID starting with 1c5f4665c2eeaff36e73a02dc5b4d6c14b98960acacc09b86284e5af68d9d571 not found: ID does not exist"
Jul 07 18:22:17.459517 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.459484    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"]
Jul 07 18:22:17.461948 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.461924    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-52675068-7d66764bd8-5fcj7"]
Jul 07 18:22:17.876088 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.875066    2576 patch_prober.go:28] interesting pod/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:44026->10.132.0.47:15021: read: connection reset by peer" start-of-body=
Jul 07 18:22:17.876088 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:17.875168    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:44026->10.132.0.47:15021: read: connection reset by peer"
Jul 07 18:22:18.448092 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:18.448059    2576 generic.go:356] "Generic (PLEG): container finished" podID="284d1155-5051-4917-a203-644c8f62200f" containerID="7eeef69fb9b497131393ac5ea94b4988a459a5352aafb5b7b964e47f16ea166d" exitCode=0
Jul 07 18:22:18.448521 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:18.448132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" event={"ID":"284d1155-5051-4917-a203-644c8f62200f","Type":"ContainerDied","Data":"7eeef69fb9b497131393ac5ea94b4988a459a5352aafb5b7b964e47f16ea166d"}
Jul 07 18:22:18.448679 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:18.448663    2576 scope.go:117] "RemoveContainer" containerID="7eeef69fb9b497131393ac5ea94b4988a459a5352aafb5b7b964e47f16ea166d"
Jul 07 18:22:18.449713 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:18.449686    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:18.449774 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:18.449754    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:18.449810 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:18.449803    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:18.889755 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:18.889722    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b919b51-830e-4b1d-ab18-0491c9bc62d3" path="/var/lib/kubelet/pods/3b919b51-830e-4b1d-ab18-0491c9bc62d3/volumes"
Jul 07 18:22:19.455102 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:19.455060    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" event={"ID":"284d1155-5051-4917-a203-644c8f62200f","Type":"ContainerStarted","Data":"de0a428b8865adc0280dbfb82d035fca428ba4728a6326b5a1d4d3dbd49aa934"}
Jul 07 18:22:19.711261 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:19.711152    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:19.711478 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:19.711443    2576 patch_prober.go:28] interesting pod/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:22:19.711557 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:19.711504    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 18:22:20.711537 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:20.711497    2576 patch_prober.go:28] interesting pod/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:22:20.711951 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:20.711565    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 18:22:21.711733 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:21.711692    2576 patch_prober.go:28] interesting pod/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:22:21.712133 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:21.711759    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 18:22:22.711050 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:22.711014    2576 patch_prober.go:28] interesting pod/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 18:22:22.711234 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:22.711083    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 18:22:23.259126 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:23.259081    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"]
Jul 07 18:22:23.259586 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:23.259305    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy" containerID="cri-o://de0a428b8865adc0280dbfb82d035fca428ba4728a6326b5a1d4d3dbd49aa934" gracePeriod=30
Jul 07 18:22:28.506128 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.506095    2576 generic.go:356] "Generic (PLEG): container finished" podID="284d1155-5051-4917-a203-644c8f62200f" containerID="de0a428b8865adc0280dbfb82d035fca428ba4728a6326b5a1d4d3dbd49aa934" exitCode=0
Jul 07 18:22:28.506561 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.506168    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" event={"ID":"284d1155-5051-4917-a203-644c8f62200f","Type":"ContainerDied","Data":"de0a428b8865adc0280dbfb82d035fca428ba4728a6326b5a1d4d3dbd49aa934"}
Jul 07 18:22:28.506561 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.506236    2576 scope.go:117] "RemoveContainer" containerID="7eeef69fb9b497131393ac5ea94b4988a459a5352aafb5b7b964e47f16ea166d"
Jul 07 18:22:28.624314 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.624287    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:28.677629 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677535    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-socket\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677629 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677594    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-certs\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677629 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677625    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6nbl\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-kube-api-access-d6nbl\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677910 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677664    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-envoy\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677910 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677706    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-data\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677910 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677741    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-istio-token\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677910 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677766    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/284d1155-5051-4917-a203-644c8f62200f-istio-podinfo\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677910 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677837    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/284d1155-5051-4917-a203-644c8f62200f-istiod-ca-cert\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677910 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677827    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:22:28.677910 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677888    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-credential-socket\") pod \"284d1155-5051-4917-a203-644c8f62200f\" (UID: \"284d1155-5051-4917-a203-644c8f62200f\") "
Jul 07 18:22:28.677910 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.677883    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:22:28.678296 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.678196    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:28.678296 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.678213    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-workload-certs\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:28.678296 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.678251    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/284d1155-5051-4917-a203-644c8f62200f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:22:28.678485 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.678462    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:22:28.679092 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.679059    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-data" (OuterVolumeSpecName: "istio-data") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:22:28.680444 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.680406    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:22:28.680553 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.680513    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-kube-api-access-d6nbl" (OuterVolumeSpecName: "kube-api-access-d6nbl") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "kube-api-access-d6nbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:22:28.680619 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.680562    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/284d1155-5051-4917-a203-644c8f62200f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:22:28.680619 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.680579    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-istio-token" (OuterVolumeSpecName: "istio-token") pod "284d1155-5051-4917-a203-644c8f62200f" (UID: "284d1155-5051-4917-a203-644c8f62200f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:22:28.779533 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.779500    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-istio-token\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:28.779533 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.779526    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/284d1155-5051-4917-a203-644c8f62200f-istio-podinfo\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:28.779533 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.779536    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/284d1155-5051-4917-a203-644c8f62200f-istiod-ca-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:28.779533 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.779544    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-credential-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:28.779819 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.779554    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6nbl\" (UniqueName: \"kubernetes.io/projected/284d1155-5051-4917-a203-644c8f62200f-kube-api-access-d6nbl\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:28.779819 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.779562    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-envoy\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:28.779819 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:28.779570    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/284d1155-5051-4917-a203-644c8f62200f-istio-data\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:22:29.513509 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:29.513479    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"
Jul 07 18:22:29.513964 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:29.513473    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q" event={"ID":"284d1155-5051-4917-a203-644c8f62200f","Type":"ContainerDied","Data":"807e54d1f62f5abc70c0825171554b5946019bf5a7588160d1f4fbfad43efa4e"}
Jul 07 18:22:29.513964 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:29.513623    2576 scope.go:117] "RemoveContainer" containerID="de0a428b8865adc0280dbfb82d035fca428ba4728a6326b5a1d4d3dbd49aa934"
Jul 07 18:22:29.535563 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:29.535534    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"]
Jul 07 18:22:29.539139 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:29.539115    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-52675068-openshift-default-74cb8d6999-ndf2q"]
Jul 07 18:22:30.885641 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:30.885605    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="284d1155-5051-4917-a203-644c8f62200f" path="/var/lib/kubelet/pods/284d1155-5051-4917-a203-644c8f62200f/volumes"
Jul 07 18:22:43.366651 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.366610    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"]
Jul 07 18:22:43.367246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.367033    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b919b51-830e-4b1d-ab18-0491c9bc62d3" containerName="maas-api"
Jul 07 18:22:43.367246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.367045    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b919b51-830e-4b1d-ab18-0491c9bc62d3" containerName="maas-api"
Jul 07 18:22:43.367246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.367059    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy"
Jul 07 18:22:43.367246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.367065    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy"
Jul 07 18:22:43.367246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.367134    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy"
Jul 07 18:22:43.367246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.367144    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy"
Jul 07 18:22:43.367246 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.367151    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b919b51-830e-4b1d-ab18-0491c9bc62d3" containerName="maas-api"
Jul 07 18:22:43.370373 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.370331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.374890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.374872    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ab291522-openshift-default-dockercfg-q7nwh\""
Jul 07 18:22:43.475730 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.475689    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"]
Jul 07 18:22:43.535094 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctsrp\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-kube-api-access-ctsrp\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.535094 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-socket\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.535395 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-token\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.535395 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad0191e7-b161-4738-b1b3-a54b70da3401-istiod-ca-cert\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.535395 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-podinfo\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.535395 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-envoy\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.535602 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-certs\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.535602 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-data\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.535602 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.535516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-credential-socket\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636442 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-certs\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636606 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-data\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636606 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-credential-socket\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636606 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636517    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctsrp\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-kube-api-access-ctsrp\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636606 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-socket\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636606 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-token\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636861 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad0191e7-b161-4738-b1b3-a54b70da3401-istiod-ca-cert\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636861 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636757    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-certs\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636861 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-podinfo\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636861 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636806    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-data\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636861 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-credential-socket\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.636861 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-envoy\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.637155 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.636872    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-socket\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.637320 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.637295    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad0191e7-b161-4738-b1b3-a54b70da3401-istiod-ca-cert\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.639187 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.639165    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-envoy\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.639553 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.639531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-podinfo\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.647041 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.647016    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-token\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.647175 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.647157    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctsrp\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-kube-api-access-ctsrp\") pod \"e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") " pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.680971 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.680936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:43.831266 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.831239    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"]
Jul 07 18:22:43.833307 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:22:43.833267    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0191e7_b161_4738_b1b3_a54b70da3401.slice/crio-c5e14db77d8943795c75aedc74d1779743bc050ba895262f6e86f53bd58f4bc2 WatchSource:0}: Error finding container c5e14db77d8943795c75aedc74d1779743bc050ba895262f6e86f53bd58f4bc2: Status 404 returned error can't find the container with id c5e14db77d8943795c75aedc74d1779743bc050ba895262f6e86f53bd58f4bc2
Jul 07 18:22:43.835468 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.835433    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:43.835581 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.835521    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:43.835581 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:43.835564    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:22:44.592918 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:44.592882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" event={"ID":"ad0191e7-b161-4738-b1b3-a54b70da3401","Type":"ContainerStarted","Data":"2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d"}
Jul 07 18:22:44.593335 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:44.592952    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" event={"ID":"ad0191e7-b161-4738-b1b3-a54b70da3401","Type":"ContainerStarted","Data":"c5e14db77d8943795c75aedc74d1779743bc050ba895262f6e86f53bd58f4bc2"}
Jul 07 18:22:44.625870 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:44.625814    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" podStartSLOduration=1.6257955769999999 podStartE2EDuration="1.625795577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:44.623383071 +0000 UTC m=+1766.236941781" watchObservedRunningTime="2026-07-07 18:22:44.625795577 +0000 UTC m=+1766.239354281"
Jul 07 18:22:44.682036 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:44.681995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:44.687142 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:44.687117    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:45.597810 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:45.597778    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:45.598847 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:45.598825    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:22:46.764680 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.764636    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"]
Jul 07 18:22:46.765282 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.765267    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy"
Jul 07 18:22:46.765331 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.765288    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="284d1155-5051-4917-a203-644c8f62200f" containerName="istio-proxy"
Jul 07 18:22:46.768930 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.768910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.778037 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.778010    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-ab291522-serving-cert\""
Jul 07 18:22:46.800430 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.800399    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"]
Jul 07 18:22:46.867318 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.867286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8pvh\" (UniqueName: \"kubernetes.io/projected/009726fb-0d39-416f-8c9c-d5b49b5df2f1-kube-api-access-r8pvh\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.867588 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.867371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009726fb-0d39-416f-8c9c-d5b49b5df2f1-openshift-service-ca\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.867588 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.867413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009726fb-0d39-416f-8c9c-d5b49b5df2f1-maas-api-tls\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.968810 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.968778    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8pvh\" (UniqueName: \"kubernetes.io/projected/009726fb-0d39-416f-8c9c-d5b49b5df2f1-kube-api-access-r8pvh\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.969012 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.968838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009726fb-0d39-416f-8c9c-d5b49b5df2f1-openshift-service-ca\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.969012 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.968861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009726fb-0d39-416f-8c9c-d5b49b5df2f1-maas-api-tls\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.969546 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.969527    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009726fb-0d39-416f-8c9c-d5b49b5df2f1-openshift-service-ca\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.971494 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.971474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009726fb-0d39-416f-8c9c-d5b49b5df2f1-maas-api-tls\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:46.997948 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:46.997869    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8pvh\" (UniqueName: \"kubernetes.io/projected/009726fb-0d39-416f-8c9c-d5b49b5df2f1-kube-api-access-r8pvh\") pod \"maas-api-e2e-mt-ab291522-7fb47447bf-72687\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") " pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:47.079432 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:47.079391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:47.250365 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:47.250320    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"]
Jul 07 18:22:47.252691 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:22:47.252661    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009726fb_0d39_416f_8c9c_d5b49b5df2f1.slice/crio-2549919db75e6da9d847d5b8075c9249636fd4841f3614bae6631d4d4b29c66e WatchSource:0}: Error finding container 2549919db75e6da9d847d5b8075c9249636fd4841f3614bae6631d4d4b29c66e: Status 404 returned error can't find the container with id 2549919db75e6da9d847d5b8075c9249636fd4841f3614bae6631d4d4b29c66e
Jul 07 18:22:47.608895 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:47.608857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687" event={"ID":"009726fb-0d39-416f-8c9c-d5b49b5df2f1","Type":"ContainerStarted","Data":"2549919db75e6da9d847d5b8075c9249636fd4841f3614bae6631d4d4b29c66e"}
Jul 07 18:22:48.615751 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:48.615716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687" event={"ID":"009726fb-0d39-416f-8c9c-d5b49b5df2f1","Type":"ContainerStarted","Data":"56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410"}
Jul 07 18:22:48.616207 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:48.615776    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:22:48.661248 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:48.661190    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687" podStartSLOduration=2.295591636 podStartE2EDuration="2.661172088s" totalImagesPullingTime="365.580452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:48.658841399 +0000 UTC m=+1770.272400105" watchObservedRunningTime="2026-07-07 18:22:48.661172088 +0000 UTC m=+1770.274730791"
Jul 07 18:22:54.627121 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:22:54.627091    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:23:01.598544 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:01.598503    2576 patch_prober.go:28] interesting pod/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 18:23:01.600944 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:01.598563    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 18:23:01.692543 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:01.692507    2576 generic.go:356] "Generic (PLEG): container finished" podID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerID="2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d" exitCode=0
Jul 07 18:23:01.692739 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:01.692569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" event={"ID":"ad0191e7-b161-4738-b1b3-a54b70da3401","Type":"ContainerDied","Data":"2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d"}
Jul 07 18:23:01.693039 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:01.693022    2576 scope.go:117] "RemoveContainer" containerID="2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d"
Jul 07 18:23:01.694119 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:01.694090    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:23:01.694177 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:01.694165    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:23:01.694214 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:01.694200    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:23:02.699575 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:02.699536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" event={"ID":"ad0191e7-b161-4738-b1b3-a54b70da3401","Type":"ContainerStarted","Data":"b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187"}
Jul 07 18:23:03.681721 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:03.681669    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:23:03.681951 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:03.681829    2576 patch_prober.go:28] interesting pod/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 18:23:03.681951 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:03.681875    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 18:23:04.683835 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:04.683797    2576 patch_prober.go:28] interesting pod/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 18:23:04.684434 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:04.684405    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 18:23:05.681929 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:05.681885    2576 patch_prober.go:28] interesting pod/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 18:23:05.682267 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:05.682230    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 18:23:06.682255 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:06.682208    2576 patch_prober.go:28] interesting pod/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 18:23:06.682799 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:06.682277    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 18:23:07.685505 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:07.685473    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:23:07.685989 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:07.685872    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:23:07.686615 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:07.686593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:23:29.379614 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.379580    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"]
Jul 07 18:23:29.380096 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.379788    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687" podUID="009726fb-0d39-416f-8c9c-d5b49b5df2f1" containerName="maas-api" containerID="cri-o://56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410" gracePeriod=30
Jul 07 18:23:29.642119 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.642054    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:23:29.704968 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.704936    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009726fb-0d39-416f-8c9c-d5b49b5df2f1-openshift-service-ca\") pod \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") "
Jul 07 18:23:29.705139 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.705065    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8pvh\" (UniqueName: \"kubernetes.io/projected/009726fb-0d39-416f-8c9c-d5b49b5df2f1-kube-api-access-r8pvh\") pod \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") "
Jul 07 18:23:29.705139 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.705087    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009726fb-0d39-416f-8c9c-d5b49b5df2f1-maas-api-tls\") pod \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\" (UID: \"009726fb-0d39-416f-8c9c-d5b49b5df2f1\") "
Jul 07 18:23:29.705322 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.705299    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/009726fb-0d39-416f-8c9c-d5b49b5df2f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "009726fb-0d39-416f-8c9c-d5b49b5df2f1" (UID: "009726fb-0d39-416f-8c9c-d5b49b5df2f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:23:29.705471 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.705452    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/009726fb-0d39-416f-8c9c-d5b49b5df2f1-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:23:29.707415 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.707386    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009726fb-0d39-416f-8c9c-d5b49b5df2f1-kube-api-access-r8pvh" (OuterVolumeSpecName: "kube-api-access-r8pvh") pod "009726fb-0d39-416f-8c9c-d5b49b5df2f1" (UID: "009726fb-0d39-416f-8c9c-d5b49b5df2f1"). InnerVolumeSpecName "kube-api-access-r8pvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:23:29.707565 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.707544    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/009726fb-0d39-416f-8c9c-d5b49b5df2f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "009726fb-0d39-416f-8c9c-d5b49b5df2f1" (UID: "009726fb-0d39-416f-8c9c-d5b49b5df2f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:23:29.806189 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.806148    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8pvh\" (UniqueName: \"kubernetes.io/projected/009726fb-0d39-416f-8c9c-d5b49b5df2f1-kube-api-access-r8pvh\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:23:29.806189 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.806181    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/009726fb-0d39-416f-8c9c-d5b49b5df2f1-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:23:29.839250 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.839213    2576 generic.go:356] "Generic (PLEG): container finished" podID="009726fb-0d39-416f-8c9c-d5b49b5df2f1" containerID="56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410" exitCode=0
Jul 07 18:23:29.839475 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.839266    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"
Jul 07 18:23:29.839475 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.839286    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687" event={"ID":"009726fb-0d39-416f-8c9c-d5b49b5df2f1","Type":"ContainerDied","Data":"56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410"}
Jul 07 18:23:29.839475 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.839374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687" event={"ID":"009726fb-0d39-416f-8c9c-d5b49b5df2f1","Type":"ContainerDied","Data":"2549919db75e6da9d847d5b8075c9249636fd4841f3614bae6631d4d4b29c66e"}
Jul 07 18:23:29.839475 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.839401    2576 scope.go:117] "RemoveContainer" containerID="56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410"
Jul 07 18:23:29.850676 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.850658    2576 scope.go:117] "RemoveContainer" containerID="56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410"
Jul 07 18:23:29.850991 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:23:29.850972    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410\": container with ID starting with 56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410 not found: ID does not exist" containerID="56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410"
Jul 07 18:23:29.851079 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.851010    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410"} err="failed to get container status \"56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410\": rpc error: code = NotFound desc = could not find container \"56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410\": container with ID starting with 56bffb12b73468ab0ac8c34cd9f41396acba9d663528b2d395b0e73090e80410 not found: ID does not exist"
Jul 07 18:23:29.866096 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.866059    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"]
Jul 07 18:23:29.871065 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:29.871033    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687"]
Jul 07 18:23:30.885236 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:30.885194    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="009726fb-0d39-416f-8c9c-d5b49b5df2f1" path="/var/lib/kubelet/pods/009726fb-0d39-416f-8c9c-d5b49b5df2f1/volumes"
Jul 07 18:23:32.622125 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:23:32.622076    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-ab291522-7fb47447bf-72687" podUID="009726fb-0d39-416f-8c9c-d5b49b5df2f1" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.50:8443/health\": context deadline exceeded"
Jul 07 18:24:25.860189 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:25.860157    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"]
Jul 07 18:24:25.860715 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:25.860428    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy" containerID="cri-o://b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187" gracePeriod=30
Jul 07 18:24:31.129115 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.129047    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:24:31.156259 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.156227    2576 generic.go:356] "Generic (PLEG): container finished" podID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerID="b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187" exitCode=0
Jul 07 18:24:31.156433 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.156273    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"
Jul 07 18:24:31.156433 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.156308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" event={"ID":"ad0191e7-b161-4738-b1b3-a54b70da3401","Type":"ContainerDied","Data":"b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187"}
Jul 07 18:24:31.156433 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.156385    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv" event={"ID":"ad0191e7-b161-4738-b1b3-a54b70da3401","Type":"ContainerDied","Data":"c5e14db77d8943795c75aedc74d1779743bc050ba895262f6e86f53bd58f4bc2"}
Jul 07 18:24:31.156433 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.156416    2576 scope.go:117] "RemoveContainer" containerID="b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187"
Jul 07 18:24:31.167631 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.167608    2576 scope.go:117] "RemoveContainer" containerID="2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d"
Jul 07 18:24:31.176485 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.176463    2576 scope.go:117] "RemoveContainer" containerID="b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187"
Jul 07 18:24:31.176779 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:24:31.176756    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187\": container with ID starting with b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187 not found: ID does not exist" containerID="b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187"
Jul 07 18:24:31.176834 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.176791    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187"} err="failed to get container status \"b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187\": rpc error: code = NotFound desc = could not find container \"b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187\": container with ID starting with b5d7fdb82ce28bf426ff77e6cddc8ee8ca751330498e5f6d26b4e8cbdb190187 not found: ID does not exist"
Jul 07 18:24:31.176834 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.176810    2576 scope.go:117] "RemoveContainer" containerID="2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d"
Jul 07 18:24:31.177080 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:24:31.177061    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d\": container with ID starting with 2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d not found: ID does not exist" containerID="2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d"
Jul 07 18:24:31.177139 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.177089    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d"} err="failed to get container status \"2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d\": rpc error: code = NotFound desc = could not find container \"2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d\": container with ID starting with 2bb2b3c72445e182b121b93261d1bc337a26cf0dd90f4dc8bc7c022c121db13d not found: ID does not exist"
Jul 07 18:24:31.233949 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.233916    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-socket\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.233949 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.233953    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-podinfo\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.234187 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.233983    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-credential-socket\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.234187 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad0191e7-b161-4738-b1b3-a54b70da3401-istiod-ca-cert\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.234187 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234052    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-envoy\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.234187 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctsrp\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-kube-api-access-ctsrp\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.234187 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234127    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-certs\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.234187 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234155    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-token\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.234574 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-data\") pod \"ad0191e7-b161-4738-b1b3-a54b70da3401\" (UID: \"ad0191e7-b161-4738-b1b3-a54b70da3401\") "
Jul 07 18:24:31.234574 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234245    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:24:31.234574 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234445    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:24:31.234574 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234532    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0191e7-b161-4738-b1b3-a54b70da3401-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:24:31.234791 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234663    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:24:31.234791 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234682    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.234791 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234699    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-credential-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.234791 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.234712    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad0191e7-b161-4738-b1b3-a54b70da3401-istiod-ca-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.235172 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.235151    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:24:31.236471 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.236442    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:24:31.236632 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.236612    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-kube-api-access-ctsrp" (OuterVolumeSpecName: "kube-api-access-ctsrp") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "kube-api-access-ctsrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:24:31.236783 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.236770    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:24:31.236912 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.236880    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad0191e7-b161-4738-b1b3-a54b70da3401" (UID: "ad0191e7-b161-4738-b1b3-a54b70da3401"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:24:31.342493 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.342453    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-podinfo\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.342493 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.342488    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-envoy\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.342493 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.342500    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctsrp\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-kube-api-access-ctsrp\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.342823 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.342512    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-workload-certs\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.342823 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.342524    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-token\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.342823 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.342533    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad0191e7-b161-4738-b1b3-a54b70da3401-istio-data\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:24:31.488271 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.488185    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"]
Jul 07 18:24:31.492175 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:31.492145    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ab291522-openshift-default-656bdc7c9f-46mqv"]
Jul 07 18:24:32.885213 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:24:32.885176    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" path="/var/lib/kubelet/pods/ad0191e7-b161-4738-b1b3-a54b70da3401/volumes"
Jul 07 18:25:24.885985 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.885953    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"]
Jul 07 18:25:24.886597 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886549    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy"
Jul 07 18:25:24.886597 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886569    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy"
Jul 07 18:25:24.886597 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886582    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009726fb-0d39-416f-8c9c-d5b49b5df2f1" containerName="maas-api"
Jul 07 18:25:24.886597 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886590    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="009726fb-0d39-416f-8c9c-d5b49b5df2f1" containerName="maas-api"
Jul 07 18:25:24.886825 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886618    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy"
Jul 07 18:25:24.886825 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886626    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy"
Jul 07 18:25:24.886825 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886715    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy"
Jul 07 18:25:24.886825 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886726    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="009726fb-0d39-416f-8c9c-d5b49b5df2f1" containerName="maas-api"
Jul 07 18:25:24.886825 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.886734    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0191e7-b161-4738-b1b3-a54b70da3401" containerName="istio-proxy"
Jul 07 18:25:24.890124 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.890092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.893729 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.893706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2ac3c6-openshift-default-dockercfg-xpp2f\""
Jul 07 18:25:24.925488 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.925449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"]
Jul 07 18:25:24.980652 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.980612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616d6f19-5abb-4577-93f5-fe08e8808404-istio-podinfo\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.980852 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.980664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-credential-socket\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.980852 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.980738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-data\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.980852 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.980766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-socket\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.980852 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.980785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6fz\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-kube-api-access-6n6fz\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.981082 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.980874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-istio-token\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.981082 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.980931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616d6f19-5abb-4577-93f5-fe08e8808404-istiod-ca-cert\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.981082 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.980967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-envoy\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:24.981082 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:24.981028    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-certs\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082516 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-istio-token\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082516 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616d6f19-5abb-4577-93f5-fe08e8808404-istiod-ca-cert\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082765 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-envoy\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082765 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082577    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-certs\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082765 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616d6f19-5abb-4577-93f5-fe08e8808404-istio-podinfo\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082765 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082669    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-credential-socket\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082765 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-data\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082765 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-socket\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.082765 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.082756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6fz\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-kube-api-access-6n6fz\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.083141 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.083088    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-certs\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.083183 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.083139    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-data\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.083220 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.083186    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-credential-socket\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.083255 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.083234    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-socket\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.083338 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.083317    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616d6f19-5abb-4577-93f5-fe08e8808404-istiod-ca-cert\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.085380 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.085335    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-envoy\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.085519 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.085500    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616d6f19-5abb-4577-93f5-fe08e8808404-istio-podinfo\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.114833 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.114797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6fz\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-kube-api-access-6n6fz\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.115675 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.115645    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-istio-token\") pod \"e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") " pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.200200 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.200107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:25.360070 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.360041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"]
Jul 07 18:25:25.361528 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:25:25.361496    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616d6f19_5abb_4577_93f5_fe08e8808404.slice/crio-58c97618e91834f64b222a69f5818af90f9ba5b4d1a0079abcdacfc62996fa64 WatchSource:0}: Error finding container 58c97618e91834f64b222a69f5818af90f9ba5b4d1a0079abcdacfc62996fa64: Status 404 returned error can't find the container with id 58c97618e91834f64b222a69f5818af90f9ba5b4d1a0079abcdacfc62996fa64
Jul 07 18:25:25.363775 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.363745    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:25:25.363867 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.363809    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:25:25.363867 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.363838    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:25:25.437042 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.437008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" event={"ID":"616d6f19-5abb-4577-93f5-fe08e8808404","Type":"ContainerStarted","Data":"efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2"}
Jul 07 18:25:25.437209 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.437066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" event={"ID":"616d6f19-5abb-4577-93f5-fe08e8808404","Type":"ContainerStarted","Data":"58c97618e91834f64b222a69f5818af90f9ba5b4d1a0079abcdacfc62996fa64"}
Jul 07 18:25:25.464946 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:25.464826    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" podStartSLOduration=1.464810315 podStartE2EDuration="1.464810315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:25:25.463441181 +0000 UTC m=+1927.076999908" watchObservedRunningTime="2026-07-07 18:25:25.464810315 +0000 UTC m=+1927.078369018"
Jul 07 18:25:26.201177 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:26.201138    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:26.206235 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:26.206204    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:26.443128 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:26.443091    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:26.444076 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:26.444055    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:27.759238 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:27.759196    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"]
Jul 07 18:25:27.763231 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:27.763206    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:27.768147 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:27.768121    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-2ac3c6-serving-cert\""
Jul 07 18:25:27.786978 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:27.786947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"]
Jul 07 18:25:27.908256 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:27.908221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da65fd25-c004-4037-8cdf-864cb5598d65-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:27.908256 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:27.908260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da65fd25-c004-4037-8cdf-864cb5598d65-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:27.908546 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:27.908407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mtv2\" (UniqueName: \"kubernetes.io/projected/da65fd25-c004-4037-8cdf-864cb5598d65-kube-api-access-5mtv2\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:28.008998 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.008959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mtv2\" (UniqueName: \"kubernetes.io/projected/da65fd25-c004-4037-8cdf-864cb5598d65-kube-api-access-5mtv2\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:28.009202 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.009046    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da65fd25-c004-4037-8cdf-864cb5598d65-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:28.009202 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.009067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da65fd25-c004-4037-8cdf-864cb5598d65-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:28.009843 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.009779    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da65fd25-c004-4037-8cdf-864cb5598d65-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:28.011838 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.011813    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da65fd25-c004-4037-8cdf-864cb5598d65-maas-api-tls\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:28.023894 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.023869    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mtv2\" (UniqueName: \"kubernetes.io/projected/da65fd25-c004-4037-8cdf-864cb5598d65-kube-api-access-5mtv2\") pod \"maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") " pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:28.074847 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.074789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:28.477523 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.477476    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"]
Jul 07 18:25:28.480215 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:25:28.480179    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda65fd25_c004_4037_8cdf_864cb5598d65.slice/crio-2b1d241da7377876a51da28a699ff53edb2b1593e05fbde11fa85d4c1d462a36 WatchSource:0}: Error finding container 2b1d241da7377876a51da28a699ff53edb2b1593e05fbde11fa85d4c1d462a36: Status 404 returned error can't find the container with id 2b1d241da7377876a51da28a699ff53edb2b1593e05fbde11fa85d4c1d462a36
Jul 07 18:25:28.482130 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:28.482108    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:25:29.461673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:29.461634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr" event={"ID":"da65fd25-c004-4037-8cdf-864cb5598d65","Type":"ContainerStarted","Data":"f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc"}
Jul 07 18:25:29.462115 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:29.461687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr" event={"ID":"da65fd25-c004-4037-8cdf-864cb5598d65","Type":"ContainerStarted","Data":"2b1d241da7377876a51da28a699ff53edb2b1593e05fbde11fa85d4c1d462a36"}
Jul 07 18:25:29.462115 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:29.461725    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:29.483643 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:29.483583    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr" podStartSLOduration=1.724906332 podStartE2EDuration="2.483566281s" totalImagesPullingTime="758.659949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:25:29.481115398 +0000 UTC m=+1931.094674113" watchObservedRunningTime="2026-07-07 18:25:29.483566281 +0000 UTC m=+1931.097124984"
Jul 07 18:25:35.475309 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:35.475271    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:25:39.855578 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:39.855537    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"]
Jul 07 18:25:39.860106 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:39.860080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:39.876598 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:39.876556    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-8481d0-serving-cert\""
Jul 07 18:25:39.932059 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:39.932015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:39.932270 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:39.932078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-maas-api-tls\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:39.932270 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:39.932172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-955ql\" (UniqueName: \"kubernetes.io/projected/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-kube-api-access-955ql\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:39.940876 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:39.940843    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"]
Jul 07 18:25:40.033675 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.033634    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:40.033890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.033712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-maas-api-tls\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:40.033890 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.033769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-955ql\" (UniqueName: \"kubernetes.io/projected/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-kube-api-access-955ql\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:40.034408 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.034384    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:40.036426 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.036404    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-maas-api-tls\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:40.050410 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.050375    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-955ql\" (UniqueName: \"kubernetes.io/projected/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-kube-api-access-955ql\") pod \"maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") " pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:40.171399 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.171278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:40.347475 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:25:40.347446    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfadfcf_e3b3_4750_b060_0f912fd7ae09.slice/crio-f73caf2d13e670868c0b8e3cabb90845aac534dfdd987c04612b3da746e799a8 WatchSource:0}: Error finding container f73caf2d13e670868c0b8e3cabb90845aac534dfdd987c04612b3da746e799a8: Status 404 returned error can't find the container with id f73caf2d13e670868c0b8e3cabb90845aac534dfdd987c04612b3da746e799a8
Jul 07 18:25:40.348388 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.348359    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"]
Jul 07 18:25:40.523631 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:40.523533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj" event={"ID":"2cfadfcf-e3b3-4750-b060-0f912fd7ae09","Type":"ContainerStarted","Data":"f73caf2d13e670868c0b8e3cabb90845aac534dfdd987c04612b3da746e799a8"}
Jul 07 18:25:41.529897 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:41.529858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj" event={"ID":"2cfadfcf-e3b3-4750-b060-0f912fd7ae09","Type":"ContainerStarted","Data":"62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26"}
Jul 07 18:25:41.530410 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:41.529995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:41.592389 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:41.592316    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj" podStartSLOduration=2.16908955 podStartE2EDuration="2.592298479s" totalImagesPullingTime="423.208929ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:25:41.587367123 +0000 UTC m=+1943.200925840" watchObservedRunningTime="2026-07-07 18:25:41.592298479 +0000 UTC m=+1943.205857202"
Jul 07 18:25:41.652499 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:41.652459    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:56000->10.132.0.51:15021: read: connection reset by peer" start-of-body=
Jul 07 18:25:41.652665 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:41.652558    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:56000->10.132.0.51:15021: read: connection reset by peer"
Jul 07 18:25:42.536397 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:42.536324    2576 generic.go:356] "Generic (PLEG): container finished" podID="616d6f19-5abb-4577-93f5-fe08e8808404" containerID="efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2" exitCode=0
Jul 07 18:25:42.536397 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:42.536400    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" event={"ID":"616d6f19-5abb-4577-93f5-fe08e8808404","Type":"ContainerDied","Data":"efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2"}
Jul 07 18:25:42.543307 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:42.537456    2576 scope.go:117] "RemoveContainer" containerID="efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2"
Jul 07 18:25:42.544381 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:42.544321    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:25:42.544518 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:42.544418    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:25:42.544518 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:42.544459    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:25:43.545432 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:43.545395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" event={"ID":"616d6f19-5abb-4577-93f5-fe08e8808404","Type":"ContainerStarted","Data":"a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7"}
Jul 07 18:25:44.201205 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:44.201157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:44.201481 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:44.201460    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 07 18:25:44.201535 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:44.201507    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 07 18:25:45.201167 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:45.201131    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 07 18:25:45.201608 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:45.201191    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 07 18:25:46.200882 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:46.200844    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 07 18:25:46.201080 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:46.200914    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 07 18:25:47.201207 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:47.201170    2576 patch_prober.go:28] interesting pod/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 07 18:25:47.201669 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:47.201229    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 07 18:25:47.543180 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:47.543097    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:25:48.204239 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:48.204202    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:48.204708 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:48.204555    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:25:48.205308 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:25:48.205291    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:27:07.370509 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.370046    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"]
Jul 07 18:27:07.370509 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.370288    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr" podUID="da65fd25-c004-4037-8cdf-864cb5598d65" containerName="maas-api" containerID="cri-o://f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc" gracePeriod=30
Jul 07 18:27:07.629801 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.629735    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:27:07.734669 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.734629    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mtv2\" (UniqueName: \"kubernetes.io/projected/da65fd25-c004-4037-8cdf-864cb5598d65-kube-api-access-5mtv2\") pod \"da65fd25-c004-4037-8cdf-864cb5598d65\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") "
Jul 07 18:27:07.734669 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.734676    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da65fd25-c004-4037-8cdf-864cb5598d65-openshift-service-ca\") pod \"da65fd25-c004-4037-8cdf-864cb5598d65\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") "
Jul 07 18:27:07.734888 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.734810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da65fd25-c004-4037-8cdf-864cb5598d65-maas-api-tls\") pod \"da65fd25-c004-4037-8cdf-864cb5598d65\" (UID: \"da65fd25-c004-4037-8cdf-864cb5598d65\") "
Jul 07 18:27:07.735079 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.735054    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da65fd25-c004-4037-8cdf-864cb5598d65-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da65fd25-c004-4037-8cdf-864cb5598d65" (UID: "da65fd25-c004-4037-8cdf-864cb5598d65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:27:07.735156 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.735142    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da65fd25-c004-4037-8cdf-864cb5598d65-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:07.737019 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.736996    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da65fd25-c004-4037-8cdf-864cb5598d65-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da65fd25-c004-4037-8cdf-864cb5598d65" (UID: "da65fd25-c004-4037-8cdf-864cb5598d65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:27:07.737095 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.737076    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da65fd25-c004-4037-8cdf-864cb5598d65-kube-api-access-5mtv2" (OuterVolumeSpecName: "kube-api-access-5mtv2") pod "da65fd25-c004-4037-8cdf-864cb5598d65" (UID: "da65fd25-c004-4037-8cdf-864cb5598d65"). InnerVolumeSpecName "kube-api-access-5mtv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:27:07.835706 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.835667    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mtv2\" (UniqueName: \"kubernetes.io/projected/da65fd25-c004-4037-8cdf-864cb5598d65-kube-api-access-5mtv2\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:07.835706 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.835698    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da65fd25-c004-4037-8cdf-864cb5598d65-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:07.983178 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.983094    2576 generic.go:356] "Generic (PLEG): container finished" podID="da65fd25-c004-4037-8cdf-864cb5598d65" containerID="f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc" exitCode=0
Jul 07 18:27:07.983178 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.983136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr" event={"ID":"da65fd25-c004-4037-8cdf-864cb5598d65","Type":"ContainerDied","Data":"f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc"}
Jul 07 18:27:07.983178 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.983143    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"
Jul 07 18:27:07.983473 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.983186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr" event={"ID":"da65fd25-c004-4037-8cdf-864cb5598d65","Type":"ContainerDied","Data":"2b1d241da7377876a51da28a699ff53edb2b1593e05fbde11fa85d4c1d462a36"}
Jul 07 18:27:07.983473 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.983210    2576 scope.go:117] "RemoveContainer" containerID="f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc"
Jul 07 18:27:07.993950 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.993928    2576 scope.go:117] "RemoveContainer" containerID="f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc"
Jul 07 18:27:07.994212 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:27:07.994192    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc\": container with ID starting with f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc not found: ID does not exist" containerID="f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc"
Jul 07 18:27:07.994282 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:07.994219    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc"} err="failed to get container status \"f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc\": rpc error: code = NotFound desc = could not find container \"f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc\": container with ID starting with f388e8032ea451491ad76f21ac0ec1d10765d82083097334df7b940dc5e961cc not found: ID does not exist"
Jul 07 18:27:08.007406 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:08.007380    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"]
Jul 07 18:27:08.011412 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:08.011384    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-2ac3c6-574bfd669-pggxr"]
Jul 07 18:27:08.886041 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:08.886004    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da65fd25-c004-4037-8cdf-864cb5598d65" path="/var/lib/kubelet/pods/da65fd25-c004-4037-8cdf-864cb5598d65/volumes"
Jul 07 18:27:49.484030 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:49.483990    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"]
Jul 07 18:27:49.484594 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:49.484226    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy" containerID="cri-o://a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7" gracePeriod=30
Jul 07 18:27:50.621752 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.621707    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"]
Jul 07 18:27:50.622334 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.621990    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj" podUID="2cfadfcf-e3b3-4750-b060-0f912fd7ae09" containerName="maas-api" containerID="cri-o://62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26" gracePeriod=30
Jul 07 18:27:50.878358 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.878274    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:27:50.968551 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.968514    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-955ql\" (UniqueName: \"kubernetes.io/projected/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-kube-api-access-955ql\") pod \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") "
Jul 07 18:27:50.968770 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.968579    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-openshift-service-ca\") pod \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") "
Jul 07 18:27:50.968770 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.968651    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-maas-api-tls\") pod \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\" (UID: \"2cfadfcf-e3b3-4750-b060-0f912fd7ae09\") "
Jul 07 18:27:50.969005 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.968976    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2cfadfcf-e3b3-4750-b060-0f912fd7ae09" (UID: "2cfadfcf-e3b3-4750-b060-0f912fd7ae09"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:27:50.969366 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.969311    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:50.971017 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.970978    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2cfadfcf-e3b3-4750-b060-0f912fd7ae09" (UID: "2cfadfcf-e3b3-4750-b060-0f912fd7ae09"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:27:50.971662 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:50.971643    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-kube-api-access-955ql" (OuterVolumeSpecName: "kube-api-access-955ql") pod "2cfadfcf-e3b3-4750-b060-0f912fd7ae09" (UID: "2cfadfcf-e3b3-4750-b060-0f912fd7ae09"). InnerVolumeSpecName "kube-api-access-955ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:27:51.070047 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.070006    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-955ql\" (UniqueName: \"kubernetes.io/projected/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-kube-api-access-955ql\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:51.070047 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.070044    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cfadfcf-e3b3-4750-b060-0f912fd7ae09-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:51.214648 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.214555    2576 generic.go:356] "Generic (PLEG): container finished" podID="2cfadfcf-e3b3-4750-b060-0f912fd7ae09" containerID="62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26" exitCode=0
Jul 07 18:27:51.214810 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.214659    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"
Jul 07 18:27:51.214810 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.214685    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj" event={"ID":"2cfadfcf-e3b3-4750-b060-0f912fd7ae09","Type":"ContainerDied","Data":"62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26"}
Jul 07 18:27:51.214810 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.214734    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj" event={"ID":"2cfadfcf-e3b3-4750-b060-0f912fd7ae09","Type":"ContainerDied","Data":"f73caf2d13e670868c0b8e3cabb90845aac534dfdd987c04612b3da746e799a8"}
Jul 07 18:27:51.214810 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.214757    2576 scope.go:117] "RemoveContainer" containerID="62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26"
Jul 07 18:27:51.224812 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.224790    2576 scope.go:117] "RemoveContainer" containerID="62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26"
Jul 07 18:27:51.225097 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:27:51.225077    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26\": container with ID starting with 62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26 not found: ID does not exist" containerID="62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26"
Jul 07 18:27:51.225160 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.225103    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26"} err="failed to get container status \"62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26\": rpc error: code = NotFound desc = could not find container \"62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26\": container with ID starting with 62d32646528c70b222ded7a42b5e2bef79c6420588dfdd24328bb580064bfa26 not found: ID does not exist"
Jul 07 18:27:51.241029 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.240992    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"]
Jul 07 18:27:51.247208 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:51.247183    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-8481d0-84d69cff59-rgnrj"]
Jul 07 18:27:52.885597 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:52.885559    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cfadfcf-e3b3-4750-b060-0f912fd7ae09" path="/var/lib/kubelet/pods/2cfadfcf-e3b3-4750-b060-0f912fd7ae09/volumes"
Jul 07 18:27:54.742933 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.742864    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:27:54.810395 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810337    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-socket\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.810395 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n6fz\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-kube-api-access-6n6fz\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.810673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810441    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-data\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.810673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810455    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-envoy\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.810673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810476    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-credential-socket\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.810673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810497    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616d6f19-5abb-4577-93f5-fe08e8808404-istiod-ca-cert\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.810673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810528    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616d6f19-5abb-4577-93f5-fe08e8808404-istio-podinfo\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.810673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810590    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-certs\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.810673 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810633    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-istio-token\") pod \"616d6f19-5abb-4577-93f5-fe08e8808404\" (UID: \"616d6f19-5abb-4577-93f5-fe08e8808404\") "
Jul 07 18:27:54.811047 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810684    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:54.811047 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810949    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:54.811047 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810969    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:54.811047 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810968    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/616d6f19-5abb-4577-93f5-fe08e8808404-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:27:54.811047 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.810957    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:54.811681 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.811599    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-data" (OuterVolumeSpecName: "istio-data") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:54.812841 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.812816    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:27:54.812971 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.812882    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/616d6f19-5abb-4577-93f5-fe08e8808404-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:27:54.813036 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.812982    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-istio-token" (OuterVolumeSpecName: "istio-token") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:27:54.813241 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.813216    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-kube-api-access-6n6fz" (OuterVolumeSpecName: "kube-api-access-6n6fz") pod "616d6f19-5abb-4577-93f5-fe08e8808404" (UID: "616d6f19-5abb-4577-93f5-fe08e8808404"). InnerVolumeSpecName "kube-api-access-6n6fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:27:54.912312 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.912265    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-credential-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:54.912312 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.912305    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/616d6f19-5abb-4577-93f5-fe08e8808404-istiod-ca-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:54.912312 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.912321    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/616d6f19-5abb-4577-93f5-fe08e8808404-istio-podinfo\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:54.912580 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.912333    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-workload-certs\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:54.912580 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.912373    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-istio-token\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:54.912580 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.912384    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n6fz\" (UniqueName: \"kubernetes.io/projected/616d6f19-5abb-4577-93f5-fe08e8808404-kube-api-access-6n6fz\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:54.912580 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.912396    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-data\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:54.912580 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:54.912408    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/616d6f19-5abb-4577-93f5-fe08e8808404-istio-envoy\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:27:55.237411 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.237373    2576 generic.go:356] "Generic (PLEG): container finished" podID="616d6f19-5abb-4577-93f5-fe08e8808404" containerID="a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7" exitCode=0
Jul 07 18:27:55.237623 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.237438    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"
Jul 07 18:27:55.237623 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.237472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" event={"ID":"616d6f19-5abb-4577-93f5-fe08e8808404","Type":"ContainerDied","Data":"a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7"}
Jul 07 18:27:55.237623 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.237546    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs" event={"ID":"616d6f19-5abb-4577-93f5-fe08e8808404","Type":"ContainerDied","Data":"58c97618e91834f64b222a69f5818af90f9ba5b4d1a0079abcdacfc62996fa64"}
Jul 07 18:27:55.237623 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.237577    2576 scope.go:117] "RemoveContainer" containerID="a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7"
Jul 07 18:27:55.246875 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.246857    2576 scope.go:117] "RemoveContainer" containerID="efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2"
Jul 07 18:27:55.256835 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.256805    2576 scope.go:117] "RemoveContainer" containerID="a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7"
Jul 07 18:27:55.257408 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:27:55.257364    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7\": container with ID starting with a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7 not found: ID does not exist" containerID="a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7"
Jul 07 18:27:55.257528 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.257418    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7"} err="failed to get container status \"a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7\": rpc error: code = NotFound desc = could not find container \"a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7\": container with ID starting with a3fe32a7dae822a3044b83df6bad976d7c990a6cf8c3630a17cb379d971891d7 not found: ID does not exist"
Jul 07 18:27:55.257528 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.257443    2576 scope.go:117] "RemoveContainer" containerID="efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2"
Jul 07 18:27:55.259794 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:27:55.259650    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2\": container with ID starting with efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2 not found: ID does not exist" containerID="efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2"
Jul 07 18:27:55.259794 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.259693    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2"} err="failed to get container status \"efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2\": rpc error: code = NotFound desc = could not find container \"efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2\": container with ID starting with efb4ff377ffde0e8a76f604a7219cd63d6521e40a61730370c64af6ee4b9c6b2 not found: ID does not exist"
Jul 07 18:27:55.259794 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.259751    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"]
Jul 07 18:27:55.263547 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:55.263518    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2ac3c6-openshift-default-77c7b6c857-nn8qs"]
Jul 07 18:27:56.885645 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:27:56.885610    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" path="/var/lib/kubelet/pods/616d6f19-5abb-4577-93f5-fe08e8808404/volumes"
Jul 07 18:28:01.728160 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.728121    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"]
Jul 07 18:28:01.728829 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.728806    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy"
Jul 07 18:28:01.729064 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729044    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy"
Jul 07 18:28:01.729164 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729094    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da65fd25-c004-4037-8cdf-864cb5598d65" containerName="maas-api"
Jul 07 18:28:01.729164 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729104    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="da65fd25-c004-4037-8cdf-864cb5598d65" containerName="maas-api"
Jul 07 18:28:01.729164 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729118    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cfadfcf-e3b3-4750-b060-0f912fd7ae09" containerName="maas-api"
Jul 07 18:28:01.729164 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729129    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cfadfcf-e3b3-4750-b060-0f912fd7ae09" containerName="maas-api"
Jul 07 18:28:01.729387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729265    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="da65fd25-c004-4037-8cdf-864cb5598d65" containerName="maas-api"
Jul 07 18:28:01.729387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729290    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cfadfcf-e3b3-4750-b060-0f912fd7ae09" containerName="maas-api"
Jul 07 18:28:01.729387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729300    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy"
Jul 07 18:28:01.729387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.729310    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy"
Jul 07 18:28:01.733930 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.733909    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:01.737241 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.737219    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-32f803-serving-cert\""
Jul 07 18:28:01.745909 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.745882    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"]
Jul 07 18:28:01.881964 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.881927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfaba69-bb25-4bbd-90e4-d34801af2320-openshift-service-ca\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:01.882143 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.882006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:01.882188 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.882141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzdx9\" (UniqueName: \"kubernetes.io/projected/8bfaba69-bb25-4bbd-90e4-d34801af2320-kube-api-access-wzdx9\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:01.983455 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.983326    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzdx9\" (UniqueName: \"kubernetes.io/projected/8bfaba69-bb25-4bbd-90e4-d34801af2320-kube-api-access-wzdx9\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:01.983455 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.983413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfaba69-bb25-4bbd-90e4-d34801af2320-openshift-service-ca\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:01.983660 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.983492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:01.983660 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:28:01.983595    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-32f803-serving-cert: secret "maas-api-e2e-api-a-32f803-serving-cert" not found
Jul 07 18:28:01.983660 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:28:01.983658    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls podName:8bfaba69-bb25-4bbd-90e4-d34801af2320 nodeName:}" failed. No retries permitted until 2026-07-07 18:28:02.483642731 +0000 UTC m=+2084.097201412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls") pod "maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf" (UID: "8bfaba69-bb25-4bbd-90e4-d34801af2320") : secret "maas-api-e2e-api-a-32f803-serving-cert" not found
Jul 07 18:28:01.984076 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.984046    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfaba69-bb25-4bbd-90e4-d34801af2320-openshift-service-ca\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:01.993424 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:01.993398    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzdx9\" (UniqueName: \"kubernetes.io/projected/8bfaba69-bb25-4bbd-90e4-d34801af2320-kube-api-access-wzdx9\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:02.489013 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:02.488970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:02.491970 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:02.491943    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls\") pod \"maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") " pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:02.648405 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:02.648370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:02.800251 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:02.800221    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"]
Jul 07 18:28:02.802002 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:28:02.801971    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfaba69_bb25_4bbd_90e4_d34801af2320.slice/crio-971d9b3660c99dd6a895728b96dcb51ba046622c6724a258681eac4e10d355f9 WatchSource:0}: Error finding container 971d9b3660c99dd6a895728b96dcb51ba046622c6724a258681eac4e10d355f9: Status 404 returned error can't find the container with id 971d9b3660c99dd6a895728b96dcb51ba046622c6724a258681eac4e10d355f9
Jul 07 18:28:03.280171 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:03.280132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf" event={"ID":"8bfaba69-bb25-4bbd-90e4-d34801af2320","Type":"ContainerStarted","Data":"971d9b3660c99dd6a895728b96dcb51ba046622c6724a258681eac4e10d355f9"}
Jul 07 18:28:04.287695 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:04.287654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf" event={"ID":"8bfaba69-bb25-4bbd-90e4-d34801af2320","Type":"ContainerStarted","Data":"0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a"}
Jul 07 18:28:04.288194 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:04.287712    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:04.307921 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:04.307866    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf" podStartSLOduration=2.804343499 podStartE2EDuration="3.307846302s" totalImagesPullingTime="503.502803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:04.306599766 +0000 UTC m=+2085.920158480" watchObservedRunningTime="2026-07-07 18:28:04.307846302 +0000 UTC m=+2085.921405006"
Jul 07 18:28:09.730624 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.730587    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"]
Jul 07 18:28:09.731036 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.731002    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy"
Jul 07 18:28:09.731036 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.731014    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="616d6f19-5abb-4577-93f5-fe08e8808404" containerName="istio-proxy"
Jul 07 18:28:09.734433 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.734410    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.741753 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.741728    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-c0421f-serving-cert\""
Jul 07 18:28:09.753624 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.753599    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"]
Jul 07 18:28:09.862452 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.862411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9951c48a-ebc0-4e0e-ab09-822347622706-maas-api-tls\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.862685 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.862509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd72k\" (UniqueName: \"kubernetes.io/projected/9951c48a-ebc0-4e0e-ab09-822347622706-kube-api-access-sd72k\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.862685 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.862646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9951c48a-ebc0-4e0e-ab09-822347622706-openshift-service-ca\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.963617 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.963583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd72k\" (UniqueName: \"kubernetes.io/projected/9951c48a-ebc0-4e0e-ab09-822347622706-kube-api-access-sd72k\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.963814 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.963677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9951c48a-ebc0-4e0e-ab09-822347622706-openshift-service-ca\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.963814 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.963705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9951c48a-ebc0-4e0e-ab09-822347622706-maas-api-tls\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.964483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.964396    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9951c48a-ebc0-4e0e-ab09-822347622706-openshift-service-ca\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.966218 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.966196    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9951c48a-ebc0-4e0e-ab09-822347622706-maas-api-tls\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:09.973321 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:09.973295    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd72k\" (UniqueName: \"kubernetes.io/projected/9951c48a-ebc0-4e0e-ab09-822347622706-kube-api-access-sd72k\") pod \"maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") " pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:10.044738 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:10.044633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:10.189525 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:10.189500    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"]
Jul 07 18:28:10.191460 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:28:10.191433    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9951c48a_ebc0_4e0e_ab09_822347622706.slice/crio-4f54000c9f2e9e70713c4ab95b9e42c112324459bd2bcabd7b1ab3e3d82a1313 WatchSource:0}: Error finding container 4f54000c9f2e9e70713c4ab95b9e42c112324459bd2bcabd7b1ab3e3d82a1313: Status 404 returned error can't find the container with id 4f54000c9f2e9e70713c4ab95b9e42c112324459bd2bcabd7b1ab3e3d82a1313
Jul 07 18:28:10.298656 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:10.298562    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:10.319502 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:10.319458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz" event={"ID":"9951c48a-ebc0-4e0e-ab09-822347622706","Type":"ContainerStarted","Data":"4f54000c9f2e9e70713c4ab95b9e42c112324459bd2bcabd7b1ab3e3d82a1313"}
Jul 07 18:28:11.326173 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:11.326141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz" event={"ID":"9951c48a-ebc0-4e0e-ab09-822347622706","Type":"ContainerStarted","Data":"49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902"}
Jul 07 18:28:11.326578 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:11.326281    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:17.344797 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:17.344768    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:17.377735 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:17.377678    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz" podStartSLOduration=8.003803963 podStartE2EDuration="8.377661702s" totalImagesPullingTime="373.857739ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:11.35126775 +0000 UTC m=+2092.964826454" watchObservedRunningTime="2026-07-07 18:28:17.377661702 +0000 UTC m=+2098.991220424"
Jul 07 18:28:23.782827 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:23.782788    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"]
Jul 07 18:28:23.783385 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:23.782977    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf" podUID="8bfaba69-bb25-4bbd-90e4-d34801af2320" containerName="maas-api" containerID="cri-o://0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a" gracePeriod=30
Jul 07 18:28:24.047614 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.047548    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:24.102764 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.102727    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzdx9\" (UniqueName: \"kubernetes.io/projected/8bfaba69-bb25-4bbd-90e4-d34801af2320-kube-api-access-wzdx9\") pod \"8bfaba69-bb25-4bbd-90e4-d34801af2320\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") "
Jul 07 18:28:24.102980 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.102809    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfaba69-bb25-4bbd-90e4-d34801af2320-openshift-service-ca\") pod \"8bfaba69-bb25-4bbd-90e4-d34801af2320\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") "
Jul 07 18:28:24.102980 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.102967    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls\") pod \"8bfaba69-bb25-4bbd-90e4-d34801af2320\" (UID: \"8bfaba69-bb25-4bbd-90e4-d34801af2320\") "
Jul 07 18:28:24.103237 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.103202    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bfaba69-bb25-4bbd-90e4-d34801af2320-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8bfaba69-bb25-4bbd-90e4-d34801af2320" (UID: "8bfaba69-bb25-4bbd-90e4-d34801af2320"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:28:24.103451 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.103315    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bfaba69-bb25-4bbd-90e4-d34801af2320-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:28:24.105460 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.105426    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bfaba69-bb25-4bbd-90e4-d34801af2320-kube-api-access-wzdx9" (OuterVolumeSpecName: "kube-api-access-wzdx9") pod "8bfaba69-bb25-4bbd-90e4-d34801af2320" (UID: "8bfaba69-bb25-4bbd-90e4-d34801af2320"). InnerVolumeSpecName "kube-api-access-wzdx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:28:24.105578 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.105523    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8bfaba69-bb25-4bbd-90e4-d34801af2320" (UID: "8bfaba69-bb25-4bbd-90e4-d34801af2320"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:28:24.204772 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.204734    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bfaba69-bb25-4bbd-90e4-d34801af2320-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:28:24.204772 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.204766    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzdx9\" (UniqueName: \"kubernetes.io/projected/8bfaba69-bb25-4bbd-90e4-d34801af2320-kube-api-access-wzdx9\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:28:24.401662 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.401631    2576 generic.go:356] "Generic (PLEG): container finished" podID="8bfaba69-bb25-4bbd-90e4-d34801af2320" containerID="0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a" exitCode=0
Jul 07 18:28:24.401871 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.401681    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"
Jul 07 18:28:24.401871 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.401730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf" event={"ID":"8bfaba69-bb25-4bbd-90e4-d34801af2320","Type":"ContainerDied","Data":"0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a"}
Jul 07 18:28:24.401871 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.401791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf" event={"ID":"8bfaba69-bb25-4bbd-90e4-d34801af2320","Type":"ContainerDied","Data":"971d9b3660c99dd6a895728b96dcb51ba046622c6724a258681eac4e10d355f9"}
Jul 07 18:28:24.401871 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.401820    2576 scope.go:117] "RemoveContainer" containerID="0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a"
Jul 07 18:28:24.411821 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.411803    2576 scope.go:117] "RemoveContainer" containerID="0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a"
Jul 07 18:28:24.412122 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:28:24.412103    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a\": container with ID starting with 0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a not found: ID does not exist" containerID="0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a"
Jul 07 18:28:24.412202 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.412136    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a"} err="failed to get container status \"0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a\": rpc error: code = NotFound desc = could not find container \"0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a\": container with ID starting with 0bec649159869ebe12f105035ed83b553e5594a8c1d413a6a4629b5dcbd4439a not found: ID does not exist"
Jul 07 18:28:24.431810 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.431774    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"]
Jul 07 18:28:24.440987 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.440959    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-32f803-7669fd4f4-dxpcf"]
Jul 07 18:28:24.886220 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:24.886186    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bfaba69-bb25-4bbd-90e4-d34801af2320" path="/var/lib/kubelet/pods/8bfaba69-bb25-4bbd-90e4-d34801af2320/volumes"
Jul 07 18:28:31.505169 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.505138    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"]
Jul 07 18:28:31.505708 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.505331    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz" podUID="9951c48a-ebc0-4e0e-ab09-822347622706" containerName="maas-api" containerID="cri-o://49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902" gracePeriod=30
Jul 07 18:28:31.767294 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.767231    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:31.881194 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.881163    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd72k\" (UniqueName: \"kubernetes.io/projected/9951c48a-ebc0-4e0e-ab09-822347622706-kube-api-access-sd72k\") pod \"9951c48a-ebc0-4e0e-ab09-822347622706\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") "
Jul 07 18:28:31.881410 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.881269    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9951c48a-ebc0-4e0e-ab09-822347622706-openshift-service-ca\") pod \"9951c48a-ebc0-4e0e-ab09-822347622706\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") "
Jul 07 18:28:31.881458 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.881408    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9951c48a-ebc0-4e0e-ab09-822347622706-maas-api-tls\") pod \"9951c48a-ebc0-4e0e-ab09-822347622706\" (UID: \"9951c48a-ebc0-4e0e-ab09-822347622706\") "
Jul 07 18:28:31.881638 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.881616    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9951c48a-ebc0-4e0e-ab09-822347622706-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9951c48a-ebc0-4e0e-ab09-822347622706" (UID: "9951c48a-ebc0-4e0e-ab09-822347622706"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:28:31.883560 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.883534    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9951c48a-ebc0-4e0e-ab09-822347622706-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9951c48a-ebc0-4e0e-ab09-822347622706" (UID: "9951c48a-ebc0-4e0e-ab09-822347622706"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:28:31.883685 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.883634    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9951c48a-ebc0-4e0e-ab09-822347622706-kube-api-access-sd72k" (OuterVolumeSpecName: "kube-api-access-sd72k") pod "9951c48a-ebc0-4e0e-ab09-822347622706" (UID: "9951c48a-ebc0-4e0e-ab09-822347622706"). InnerVolumeSpecName "kube-api-access-sd72k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:28:31.982758 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.982718    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd72k\" (UniqueName: \"kubernetes.io/projected/9951c48a-ebc0-4e0e-ab09-822347622706-kube-api-access-sd72k\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:28:31.982758 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.982757    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9951c48a-ebc0-4e0e-ab09-822347622706-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:28:31.983036 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:31.982772    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9951c48a-ebc0-4e0e-ab09-822347622706-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:28:32.445120 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.445086    2576 generic.go:356] "Generic (PLEG): container finished" podID="9951c48a-ebc0-4e0e-ab09-822347622706" containerID="49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902" exitCode=0
Jul 07 18:28:32.445329 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.445135    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"
Jul 07 18:28:32.445329 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.445174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz" event={"ID":"9951c48a-ebc0-4e0e-ab09-822347622706","Type":"ContainerDied","Data":"49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902"}
Jul 07 18:28:32.445329 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.445235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz" event={"ID":"9951c48a-ebc0-4e0e-ab09-822347622706","Type":"ContainerDied","Data":"4f54000c9f2e9e70713c4ab95b9e42c112324459bd2bcabd7b1ab3e3d82a1313"}
Jul 07 18:28:32.445329 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.445266    2576 scope.go:117] "RemoveContainer" containerID="49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902"
Jul 07 18:28:32.455090 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.455068    2576 scope.go:117] "RemoveContainer" containerID="49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902"
Jul 07 18:28:32.455402 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:28:32.455381    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902\": container with ID starting with 49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902 not found: ID does not exist" containerID="49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902"
Jul 07 18:28:32.455483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.455413    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902"} err="failed to get container status \"49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902\": rpc error: code = NotFound desc = could not find container \"49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902\": container with ID starting with 49fcbc260fd1d9cc7aec89a7f7af3250cb25f5659eb18cbc459b20dbcfa54902 not found: ID does not exist"
Jul 07 18:28:32.472780 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.472746    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"]
Jul 07 18:28:32.479151 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.479122    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c0421f-76cfcd9459-bb6qz"]
Jul 07 18:28:32.885641 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:32.885609    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9951c48a-ebc0-4e0e-ab09-822347622706" path="/var/lib/kubelet/pods/9951c48a-ebc0-4e0e-ab09-822347622706/volumes"
Jul 07 18:28:41.891061 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.891026    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"]
Jul 07 18:28:41.892168 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.892140    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9951c48a-ebc0-4e0e-ab09-822347622706" containerName="maas-api"
Jul 07 18:28:41.892168 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.892168    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9951c48a-ebc0-4e0e-ab09-822347622706" containerName="maas-api"
Jul 07 18:28:41.892321 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.892186    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bfaba69-bb25-4bbd-90e4-d34801af2320" containerName="maas-api"
Jul 07 18:28:41.892321 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.892217    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bfaba69-bb25-4bbd-90e4-d34801af2320" containerName="maas-api"
Jul 07 18:28:41.892321 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.892304    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9951c48a-ebc0-4e0e-ab09-822347622706" containerName="maas-api"
Jul 07 18:28:41.892448 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.892320    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bfaba69-bb25-4bbd-90e4-d34801af2320" containerName="maas-api"
Jul 07 18:28:41.895962 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.895928    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:41.899967 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.899941    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-a6b471-serving-cert\""
Jul 07 18:28:41.907660 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:41.907633    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"]
Jul 07 18:28:42.085069 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.085027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581fc9e9-8397-44f0-95e9-5f2be1c035f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.085297 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.085100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-922qr\" (UniqueName: \"kubernetes.io/projected/581fc9e9-8397-44f0-95e9-5f2be1c035f9-kube-api-access-922qr\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.085297 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.085153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fc9e9-8397-44f0-95e9-5f2be1c035f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.185862 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.185757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581fc9e9-8397-44f0-95e9-5f2be1c035f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.185862 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.185819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-922qr\" (UniqueName: \"kubernetes.io/projected/581fc9e9-8397-44f0-95e9-5f2be1c035f9-kube-api-access-922qr\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.185862 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.185857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fc9e9-8397-44f0-95e9-5f2be1c035f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.186462 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.186440    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fc9e9-8397-44f0-95e9-5f2be1c035f9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.188608 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.188572    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581fc9e9-8397-44f0-95e9-5f2be1c035f9-maas-api-tls\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.195030 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.195001    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-922qr\" (UniqueName: \"kubernetes.io/projected/581fc9e9-8397-44f0-95e9-5f2be1c035f9-kube-api-access-922qr\") pod \"maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") " pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.209743 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.209713    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:42.360186 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:28:42.360149    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581fc9e9_8397_44f0_95e9_5f2be1c035f9.slice/crio-73caca820a27e84c51dda61e7a249d757f23b3cac46470f1cc752fa02af076a2 WatchSource:0}: Error finding container 73caca820a27e84c51dda61e7a249d757f23b3cac46470f1cc752fa02af076a2: Status 404 returned error can't find the container with id 73caca820a27e84c51dda61e7a249d757f23b3cac46470f1cc752fa02af076a2
Jul 07 18:28:42.361618 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.361557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"]
Jul 07 18:28:42.498026 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:42.497941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk" event={"ID":"581fc9e9-8397-44f0-95e9-5f2be1c035f9","Type":"ContainerStarted","Data":"73caca820a27e84c51dda61e7a249d757f23b3cac46470f1cc752fa02af076a2"}
Jul 07 18:28:43.504550 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:43.504511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk" event={"ID":"581fc9e9-8397-44f0-95e9-5f2be1c035f9","Type":"ContainerStarted","Data":"6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9"}
Jul 07 18:28:43.504961 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:43.504598    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:43.576050 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:43.575993    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk" podStartSLOduration=2.260530191 podStartE2EDuration="2.575974305s" totalImagesPullingTime="315.444114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:43.572998008 +0000 UTC m=+2125.186556712" watchObservedRunningTime="2026-07-07 18:28:43.575974305 +0000 UTC m=+2125.189533013"
Jul 07 18:28:46.921003 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:46.920969    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"]
Jul 07 18:28:46.925834 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:46.925811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:46.928823 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:46.928802    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-89d0f3-openshift-default-dockercfg-k2xs9\""
Jul 07 18:28:46.935742 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:46.935714    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"]
Jul 07 18:28:47.033936 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.033847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-envoy\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.033936 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.033892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-token\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.033936 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.033919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-credential-socket\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.034232 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.033944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-certs\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.034232 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.033977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-data\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.034232 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.034003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-socket\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.034232 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.034092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2tt\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-kube-api-access-cc2tt\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.034232 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.034177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/687d5b03-e5aa-4b9e-9443-e830e1172983-istiod-ca-cert\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.034232 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.034231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-podinfo\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.134843 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.134801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-data\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135059 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.134856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-socket\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135059 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.134898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2tt\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-kube-api-access-cc2tt\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135184 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/687d5b03-e5aa-4b9e-9443-e830e1172983-istiod-ca-cert\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135184 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135130    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-podinfo\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135184 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-envoy\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-token\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-credential-socket\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135298    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-data\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135320    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-socket\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135387 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-certs\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135663 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135607    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-certs\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.135715 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135671    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-credential-socket\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.136042 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.135883    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/687d5b03-e5aa-4b9e-9443-e830e1172983-istiod-ca-cert\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.137632 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.137610    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-envoy\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.137749 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.137731    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-podinfo\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.144420 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.144385    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2tt\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-kube-api-access-cc2tt\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.144560 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.144542    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-token\") pod \"e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") " pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.238175 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.238135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:47.394711 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.394685    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"]
Jul 07 18:28:47.396319 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:28:47.396294    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687d5b03_e5aa_4b9e_9443_e830e1172983.slice/crio-d14cdc1c4a40e9b7bba6b6892260b5fd15793631682d6a4022dc3608e1ae7dc3 WatchSource:0}: Error finding container d14cdc1c4a40e9b7bba6b6892260b5fd15793631682d6a4022dc3608e1ae7dc3: Status 404 returned error can't find the container with id d14cdc1c4a40e9b7bba6b6892260b5fd15793631682d6a4022dc3608e1ae7dc3
Jul 07 18:28:47.398945 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.398914    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:28:47.399031 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.398981    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:28:47.399031 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.399019    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:28:47.529784 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.529368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" event={"ID":"687d5b03-e5aa-4b9e-9443-e830e1172983","Type":"ContainerStarted","Data":"bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8"}
Jul 07 18:28:47.529784 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.529436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" event={"ID":"687d5b03-e5aa-4b9e-9443-e830e1172983","Type":"ContainerStarted","Data":"d14cdc1c4a40e9b7bba6b6892260b5fd15793631682d6a4022dc3608e1ae7dc3"}
Jul 07 18:28:47.553700 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:47.553588    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" podStartSLOduration=1.553571609 podStartE2EDuration="1.553571609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:47.550740586 +0000 UTC m=+2129.164299313" watchObservedRunningTime="2026-07-07 18:28:47.553571609 +0000 UTC m=+2129.167130313"
Jul 07 18:28:48.238320 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:48.238284    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:48.243515 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:48.243494    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:48.535224 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:48.535140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:48.536289 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:48.536270    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:28:49.515943 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.515910    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:28:49.719593 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.719546    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"]
Jul 07 18:28:49.723662 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.723639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.726566 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.726539    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-89d0f3-serving-cert\""
Jul 07 18:28:49.735122 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.735097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"]
Jul 07 18:28:49.759804 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.759776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58359c8e-6a80-48c1-b650-af188401462c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.759999 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.759861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58359c8e-6a80-48c1-b650-af188401462c-maas-api-tls\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.759999 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.759889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9wnx\" (UniqueName: \"kubernetes.io/projected/58359c8e-6a80-48c1-b650-af188401462c-kube-api-access-w9wnx\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.861371 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.861313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58359c8e-6a80-48c1-b650-af188401462c-maas-api-tls\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.861579 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.861389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9wnx\" (UniqueName: \"kubernetes.io/projected/58359c8e-6a80-48c1-b650-af188401462c-kube-api-access-w9wnx\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.861579 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.861483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58359c8e-6a80-48c1-b650-af188401462c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.862162 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.862136    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58359c8e-6a80-48c1-b650-af188401462c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.864064 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.864046    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58359c8e-6a80-48c1-b650-af188401462c-maas-api-tls\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:49.872721 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:49.872696    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9wnx\" (UniqueName: \"kubernetes.io/projected/58359c8e-6a80-48c1-b650-af188401462c-kube-api-access-w9wnx\") pod \"maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") " pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:50.038905 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:50.038869    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:50.179873 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:50.179845    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"]
Jul 07 18:28:50.182766 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:28:50.182730    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58359c8e_6a80_48c1_b650_af188401462c.slice/crio-a7bea9183db85b35627717e637e9987f637d153ea4a7c226272967ae60d97ede WatchSource:0}: Error finding container a7bea9183db85b35627717e637e9987f637d153ea4a7c226272967ae60d97ede: Status 404 returned error can't find the container with id a7bea9183db85b35627717e637e9987f637d153ea4a7c226272967ae60d97ede
Jul 07 18:28:50.546727 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:50.546702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc" event={"ID":"58359c8e-6a80-48c1-b650-af188401462c","Type":"ContainerStarted","Data":"a7bea9183db85b35627717e637e9987f637d153ea4a7c226272967ae60d97ede"}
Jul 07 18:28:51.553488 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:51.553447    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc" event={"ID":"58359c8e-6a80-48c1-b650-af188401462c","Type":"ContainerStarted","Data":"9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd"}
Jul 07 18:28:51.553894 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:51.553509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:28:51.574689 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:51.574636    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc" podStartSLOduration=2.215860814 podStartE2EDuration="2.574619068s" totalImagesPullingTime="358.758254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:51.573715626 +0000 UTC m=+2133.187274351" watchObservedRunningTime="2026-07-07 18:28:51.574619068 +0000 UTC m=+2133.188177803"
Jul 07 18:28:57.565827 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:28:57.565799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:29:01.628281 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:01.628246    2576 generic.go:356] "Generic (PLEG): container finished" podID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerID="bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8" exitCode=0
Jul 07 18:29:01.628838 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:01.628325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" event={"ID":"687d5b03-e5aa-4b9e-9443-e830e1172983","Type":"ContainerDied","Data":"bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8"}
Jul 07 18:29:01.628952 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:01.628935    2576 scope.go:117] "RemoveContainer" containerID="bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8"
Jul 07 18:29:01.630050 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:01.630021    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:29:01.630111 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:01.630093    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:29:01.630147 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:01.630132    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 18:29:02.636449 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:02.636416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" event={"ID":"687d5b03-e5aa-4b9e-9443-e830e1172983","Type":"ContainerStarted","Data":"388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281"}
Jul 07 18:29:03.239206 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:03.239158    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:29:03.240390 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:03.240368    2576 patch_prober.go:28] interesting pod/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 07 18:29:03.240456 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:03.240414    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 07 18:29:03.535331 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:03.535235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:29:04.239565 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:04.239522    2576 patch_prober.go:28] interesting pod/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 07 18:29:04.239973 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:04.239584    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 07 18:29:05.239289 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:05.239252    2576 patch_prober.go:28] interesting pod/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 07 18:29:05.239520 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:05.239310    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 07 18:29:06.238914 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:06.238876    2576 patch_prober.go:28] interesting pod/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 07 18:29:06.239316 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:06.238956    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 07 18:29:07.242531 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:07.242500    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:29:07.243563 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:29:07.243544    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:34:42.899499 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:42.899453    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"]
Jul 07 18:34:42.902284 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:42.899715    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk" podUID="581fc9e9-8397-44f0-95e9-5f2be1c035f9" containerName="maas-api" containerID="cri-o://6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9" gracePeriod=30
Jul 07 18:34:43.156635 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.156563    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:34:43.299217 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.299176    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fc9e9-8397-44f0-95e9-5f2be1c035f9-openshift-service-ca\") pod \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") "
Jul 07 18:34:43.299463 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.299269    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581fc9e9-8397-44f0-95e9-5f2be1c035f9-maas-api-tls\") pod \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") "
Jul 07 18:34:43.299463 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.299405    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-922qr\" (UniqueName: \"kubernetes.io/projected/581fc9e9-8397-44f0-95e9-5f2be1c035f9-kube-api-access-922qr\") pod \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\" (UID: \"581fc9e9-8397-44f0-95e9-5f2be1c035f9\") "
Jul 07 18:34:43.299597 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.299575    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581fc9e9-8397-44f0-95e9-5f2be1c035f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "581fc9e9-8397-44f0-95e9-5f2be1c035f9" (UID: "581fc9e9-8397-44f0-95e9-5f2be1c035f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:34:43.299789 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.299772    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fc9e9-8397-44f0-95e9-5f2be1c035f9-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:34:43.301528 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.301500    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581fc9e9-8397-44f0-95e9-5f2be1c035f9-kube-api-access-922qr" (OuterVolumeSpecName: "kube-api-access-922qr") pod "581fc9e9-8397-44f0-95e9-5f2be1c035f9" (UID: "581fc9e9-8397-44f0-95e9-5f2be1c035f9"). InnerVolumeSpecName "kube-api-access-922qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:34:43.301634 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.301614    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581fc9e9-8397-44f0-95e9-5f2be1c035f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "581fc9e9-8397-44f0-95e9-5f2be1c035f9" (UID: "581fc9e9-8397-44f0-95e9-5f2be1c035f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:34:43.393602 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.393563    2576 generic.go:356] "Generic (PLEG): container finished" podID="581fc9e9-8397-44f0-95e9-5f2be1c035f9" containerID="6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9" exitCode=0
Jul 07 18:34:43.393785 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.393614    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"
Jul 07 18:34:43.393785 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.393646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk" event={"ID":"581fc9e9-8397-44f0-95e9-5f2be1c035f9","Type":"ContainerDied","Data":"6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9"}
Jul 07 18:34:43.393785 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.393703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk" event={"ID":"581fc9e9-8397-44f0-95e9-5f2be1c035f9","Type":"ContainerDied","Data":"73caca820a27e84c51dda61e7a249d757f23b3cac46470f1cc752fa02af076a2"}
Jul 07 18:34:43.393785 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.393726    2576 scope.go:117] "RemoveContainer" containerID="6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9"
Jul 07 18:34:43.400561 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.400524    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/581fc9e9-8397-44f0-95e9-5f2be1c035f9-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:34:43.400561 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.400556    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-922qr\" (UniqueName: \"kubernetes.io/projected/581fc9e9-8397-44f0-95e9-5f2be1c035f9-kube-api-access-922qr\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:34:43.403704 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.403681    2576 scope.go:117] "RemoveContainer" containerID="6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9"
Jul 07 18:34:43.404011 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:34:43.403991    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9\": container with ID starting with 6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9 not found: ID does not exist" containerID="6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9"
Jul 07 18:34:43.404083 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.404020    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9"} err="failed to get container status \"6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9\": rpc error: code = NotFound desc = could not find container \"6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9\": container with ID starting with 6c63083a5a23a97b3da4c6d5cf965261e7c3e3addeeff255e050f510386973f9 not found: ID does not exist"
Jul 07 18:34:43.418263 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.418178    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"]
Jul 07 18:34:43.426022 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:43.425992    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-a6b471-5d54f96f56-w7klk"]
Jul 07 18:34:44.885021 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:34:44.884987    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581fc9e9-8397-44f0-95e9-5f2be1c035f9" path="/var/lib/kubelet/pods/581fc9e9-8397-44f0-95e9-5f2be1c035f9/volumes"
Jul 07 18:35:22.933723 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:22.933686    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"]
Jul 07 18:35:22.934186 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:22.933887    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc" podUID="58359c8e-6a80-48c1-b650-af188401462c" containerName="maas-api" containerID="cri-o://9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd" gracePeriod=30
Jul 07 18:35:23.189850 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.189784    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:35:23.311273 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.311237    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58359c8e-6a80-48c1-b650-af188401462c-maas-api-tls\") pod \"58359c8e-6a80-48c1-b650-af188401462c\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") "
Jul 07 18:35:23.311505 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.311308    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9wnx\" (UniqueName: \"kubernetes.io/projected/58359c8e-6a80-48c1-b650-af188401462c-kube-api-access-w9wnx\") pod \"58359c8e-6a80-48c1-b650-af188401462c\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") "
Jul 07 18:35:23.311505 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.311489    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58359c8e-6a80-48c1-b650-af188401462c-openshift-service-ca\") pod \"58359c8e-6a80-48c1-b650-af188401462c\" (UID: \"58359c8e-6a80-48c1-b650-af188401462c\") "
Jul 07 18:35:23.311829 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.311804    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58359c8e-6a80-48c1-b650-af188401462c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58359c8e-6a80-48c1-b650-af188401462c" (UID: "58359c8e-6a80-48c1-b650-af188401462c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:35:23.311925 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.311912    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58359c8e-6a80-48c1-b650-af188401462c-openshift-service-ca\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:23.313574 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.313553    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58359c8e-6a80-48c1-b650-af188401462c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58359c8e-6a80-48c1-b650-af188401462c" (UID: "58359c8e-6a80-48c1-b650-af188401462c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:35:23.313685 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.313617    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58359c8e-6a80-48c1-b650-af188401462c-kube-api-access-w9wnx" (OuterVolumeSpecName: "kube-api-access-w9wnx") pod "58359c8e-6a80-48c1-b650-af188401462c" (UID: "58359c8e-6a80-48c1-b650-af188401462c"). InnerVolumeSpecName "kube-api-access-w9wnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:35:23.412506 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.412465    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58359c8e-6a80-48c1-b650-af188401462c-maas-api-tls\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:23.412506 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.412498    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9wnx\" (UniqueName: \"kubernetes.io/projected/58359c8e-6a80-48c1-b650-af188401462c-kube-api-access-w9wnx\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:23.618687 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.618653    2576 generic.go:356] "Generic (PLEG): container finished" podID="58359c8e-6a80-48c1-b650-af188401462c" containerID="9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd" exitCode=0
Jul 07 18:35:23.618875 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.618703    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"
Jul 07 18:35:23.618875 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.618744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc" event={"ID":"58359c8e-6a80-48c1-b650-af188401462c","Type":"ContainerDied","Data":"9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd"}
Jul 07 18:35:23.618875 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.618796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc" event={"ID":"58359c8e-6a80-48c1-b650-af188401462c","Type":"ContainerDied","Data":"a7bea9183db85b35627717e637e9987f637d153ea4a7c226272967ae60d97ede"}
Jul 07 18:35:23.618875 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.618821    2576 scope.go:117] "RemoveContainer" containerID="9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd"
Jul 07 18:35:23.628483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.628465    2576 scope.go:117] "RemoveContainer" containerID="9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd"
Jul 07 18:35:23.628774 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:35:23.628755    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd\": container with ID starting with 9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd not found: ID does not exist" containerID="9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd"
Jul 07 18:35:23.628825 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.628783    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd"} err="failed to get container status \"9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd\": rpc error: code = NotFound desc = could not find container \"9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd\": container with ID starting with 9ca9410f0052ee5e671b9bd76f432240e63f2490249b004c993c3055afce43bd not found: ID does not exist"
Jul 07 18:35:23.651855 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.651820    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"]
Jul 07 18:35:23.660606 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:23.660575    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-89d0f3-6c5dcf4846-x7vwc"]
Jul 07 18:35:24.885645 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:24.885612    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58359c8e-6a80-48c1-b650-af188401462c" path="/var/lib/kubelet/pods/58359c8e-6a80-48c1-b650-af188401462c/volumes"
Jul 07 18:35:29.238974 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:29.238933    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"]
Jul 07 18:35:29.239426 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:29.239208    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy" containerID="cri-o://388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281" gracePeriod=30
Jul 07 18:35:34.501332 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.501261    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:35:34.519655 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519621    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-data\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.519805 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519673    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-certs\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.519805 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-envoy\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.519805 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519733    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-socket\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.519805 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519754    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-token\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.519805 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519785    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/687d5b03-e5aa-4b9e-9443-e830e1172983-istiod-ca-cert\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.520059 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519822    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-credential-socket\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.520059 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519886    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc2tt\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-kube-api-access-cc2tt\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.520059 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.519911    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-podinfo\") pod \"687d5b03-e5aa-4b9e-9443-e830e1172983\" (UID: \"687d5b03-e5aa-4b9e-9443-e830e1172983\") "
Jul 07 18:35:34.520213 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.520053    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:34.520213 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.520089    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:34.520309 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.520241    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:34.520411 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.520390    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.520483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.520416    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-credential-socket\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.520483 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.520431    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-workload-certs\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.520878 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.520791    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-data" (OuterVolumeSpecName: "istio-data") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:34.520878 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.520815    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687d5b03-e5aa-4b9e-9443-e830e1172983-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:35:34.522175 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.522148    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-token" (OuterVolumeSpecName: "istio-token") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:35:34.522265 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.522206    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:35:34.522265 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.522223    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:35:34.522376 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.522265    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-kube-api-access-cc2tt" (OuterVolumeSpecName: "kube-api-access-cc2tt") pod "687d5b03-e5aa-4b9e-9443-e830e1172983" (UID: "687d5b03-e5aa-4b9e-9443-e830e1172983"). InnerVolumeSpecName "kube-api-access-cc2tt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:35:34.621498 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.621454    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc2tt\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-kube-api-access-cc2tt\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.621498 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.621495    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-podinfo\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.621498 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.621504    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-data\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.621752 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.621512    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-envoy\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.621752 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.621521    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/687d5b03-e5aa-4b9e-9443-e830e1172983-istio-token\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.621752 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.621528    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/687d5b03-e5aa-4b9e-9443-e830e1172983-istiod-ca-cert\") on node \"ip-10-0-133-54.ec2.internal\" DevicePath \"\""
Jul 07 18:35:34.675114 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.675076    2576 generic.go:356] "Generic (PLEG): container finished" podID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerID="388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281" exitCode=0
Jul 07 18:35:34.675318 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.675128    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"
Jul 07 18:35:34.675318 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.675150    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" event={"ID":"687d5b03-e5aa-4b9e-9443-e830e1172983","Type":"ContainerDied","Data":"388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281"}
Jul 07 18:35:34.675318 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.675206    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4" event={"ID":"687d5b03-e5aa-4b9e-9443-e830e1172983","Type":"ContainerDied","Data":"d14cdc1c4a40e9b7bba6b6892260b5fd15793631682d6a4022dc3608e1ae7dc3"}
Jul 07 18:35:34.675318 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.675236    2576 scope.go:117] "RemoveContainer" containerID="388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281"
Jul 07 18:35:34.685276 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.685251    2576 scope.go:117] "RemoveContainer" containerID="bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8"
Jul 07 18:35:34.694228 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.694203    2576 scope.go:117] "RemoveContainer" containerID="388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281"
Jul 07 18:35:34.694519 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:35:34.694500    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281\": container with ID starting with 388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281 not found: ID does not exist" containerID="388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281"
Jul 07 18:35:34.694583 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.694530    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281"} err="failed to get container status \"388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281\": rpc error: code = NotFound desc = could not find container \"388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281\": container with ID starting with 388683519fe7cbc5b5a6f501307d1631690e383a7a52b76097c04ca9e87ff281 not found: ID does not exist"
Jul 07 18:35:34.694583 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.694555    2576 scope.go:117] "RemoveContainer" containerID="bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8"
Jul 07 18:35:34.694825 ip-10-0-133-54 kubenswrapper[2576]: E0707 18:35:34.694810    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8\": container with ID starting with bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8 not found: ID does not exist" containerID="bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8"
Jul 07 18:35:34.694879 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.694831    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8"} err="failed to get container status \"bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8\": rpc error: code = NotFound desc = could not find container \"bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8\": container with ID starting with bb9cf3e0ddf496d94825c1957f9c0c1c9423728b0b7f7d661574dad1b77beeb8 not found: ID does not exist"
Jul 07 18:35:34.713071 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.713040    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"]
Jul 07 18:35:34.725142 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.725107    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-89d0f3-openshift-default-898c7b77f-zdrl4"]
Jul 07 18:35:34.887014 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:34.886974    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" path="/var/lib/kubelet/pods/687d5b03-e5aa-4b9e-9443-e830e1172983/volumes"
Jul 07 18:35:35.315777 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:35.315747    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9sbzv_89d391e9-7c70-4252-9074-881bf8c184de/manager/0.log"
Jul 07 18:35:35.461337 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:35.461300    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-c9shq_bcc9b791-f30c-4a56-b846-6af4a847c048/manager/0.log"
Jul 07 18:35:35.606842 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:35.606752    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-f7696796f-8tnsw_c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf/maas-api/0.log"
Jul 07 18:35:36.757031 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:36.757008    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb7f7967-zmhxn_588669b1-2c85-4ca2-92ae-989cb05cdebe/copy-manifests/0.log"
Jul 07 18:35:36.773220 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:36.773191    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb7f7967-zmhxn_588669b1-2c85-4ca2-92ae-989cb05cdebe/manager/0.log"
Jul 07 18:35:36.912233 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:36.912201    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-d7x4s_d14df388-103d-47cd-b416-8e7a00b4f61e/postgres/0.log"
Jul 07 18:35:38.556980 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:38.556948    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ddnq6_2a3b2fa5-3dae-41ba-8811-746fbf242483/manager/0.log"
Jul 07 18:35:38.684467 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:38.684430    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rqqkw_fb13081a-d7fe-488a-aa64-5e7dbf82bb27/manager/0.log"
Jul 07 18:35:39.734012 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:39.733979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4npv84_f3416f1d-50de-4334-865f-c9f8588526e9/istio-proxy/0.log"
Jul 07 18:35:40.242926 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:40.242890    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-889fn_88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897/istio-proxy/1.log"
Jul 07 18:35:40.498190 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:40.498100    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zw7r4_49387ada-439f-4eb1-8034-18bfe68da0d0/payload-processing/0.log"
Jul 07 18:35:40.986991 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:40.986960    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9k8jt_b2b71865-1b18-49ec-a252-c59ff8fef952/main/0.log"
Jul 07 18:35:41.371482 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:41.371439    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7ncn9_00a3cb3c-b4c4-46b3-ba20-64d59f06f29e/main/0.log"
Jul 07 18:35:49.970278 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:49.970248    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nr6d5_451479c6-8617-4573-8043-00f8e2ea11e1/global-pull-secret-syncer/0.log"
Jul 07 18:35:50.166111 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:50.166079    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v9vgv_41fc40ad-0e0a-4c64-acf7-b8367e3d9db7/konnectivity-agent/0.log"
Jul 07 18:35:50.240241 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:50.240161    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-54.ec2.internal_8dc84e52c4b49cddad14a3e8e44364d9/haproxy/0.log"
Jul 07 18:35:55.286167 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:55.286128    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ddnq6_2a3b2fa5-3dae-41ba-8811-746fbf242483/manager/0.log"
Jul 07 18:35:55.330026 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:55.329979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rqqkw_fb13081a-d7fe-488a-aa64-5e7dbf82bb27/manager/0.log"
Jul 07 18:35:57.476626 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.476601    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e794fea3-0d81-4a78-8946-dede5c142c1e/alertmanager/0.log"
Jul 07 18:35:57.525712 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.525689    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e794fea3-0d81-4a78-8946-dede5c142c1e/config-reloader/0.log"
Jul 07 18:35:57.560643 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.560595    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e794fea3-0d81-4a78-8946-dede5c142c1e/kube-rbac-proxy-web/0.log"
Jul 07 18:35:57.588981 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.588957    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e794fea3-0d81-4a78-8946-dede5c142c1e/kube-rbac-proxy/0.log"
Jul 07 18:35:57.631626 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.631598    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e794fea3-0d81-4a78-8946-dede5c142c1e/kube-rbac-proxy-metric/0.log"
Jul 07 18:35:57.671169 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.671139    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e794fea3-0d81-4a78-8946-dede5c142c1e/prom-label-proxy/0.log"
Jul 07 18:35:57.731056 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.730933    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e794fea3-0d81-4a78-8946-dede5c142c1e/init-config-reloader/0.log"
Jul 07 18:35:57.847122 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.847094    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mfn2x_246c2574-44f0-4e72-a3ae-c187f3792de3/kube-state-metrics/0.log"
Jul 07 18:35:57.870180 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.870145    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mfn2x_246c2574-44f0-4e72-a3ae-c187f3792de3/kube-rbac-proxy-main/0.log"
Jul 07 18:35:57.898477 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.898450    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mfn2x_246c2574-44f0-4e72-a3ae-c187f3792de3/kube-rbac-proxy-self/0.log"
Jul 07 18:35:57.927373 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:57.927323    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c6bdf99b9-fgz5z_1b9250aa-8a6b-47e4-895f-c5180ee2174f/metrics-server/0.log"
Jul 07 18:35:58.213180 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.213144    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdnq7_f5c8f988-ee3a-47cf-b70c-9995ad7f2284/node-exporter/0.log"
Jul 07 18:35:58.243191 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.243162    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdnq7_f5c8f988-ee3a-47cf-b70c-9995ad7f2284/kube-rbac-proxy/0.log"
Jul 07 18:35:58.271931 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.271900    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zdnq7_f5c8f988-ee3a-47cf-b70c-9995ad7f2284/init-textfile/0.log"
Jul 07 18:35:58.307756 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.307729    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-rj8h8_9f714cf5-eac5-474a-bdee-7b597a98f49e/kube-rbac-proxy-main/0.log"
Jul 07 18:35:58.337607 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.337524    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-rj8h8_9f714cf5-eac5-474a-bdee-7b597a98f49e/kube-rbac-proxy-self/0.log"
Jul 07 18:35:58.365227 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.365195    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-rj8h8_9f714cf5-eac5-474a-bdee-7b597a98f49e/openshift-state-metrics/0.log"
Jul 07 18:35:58.410715 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.410683    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57/prometheus/0.log"
Jul 07 18:35:58.439772 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.439740    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57/config-reloader/0.log"
Jul 07 18:35:58.466095 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.466065    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57/thanos-sidecar/0.log"
Jul 07 18:35:58.493881 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.493854    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57/kube-rbac-proxy-web/0.log"
Jul 07 18:35:58.523296 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.523272    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57/kube-rbac-proxy/0.log"
Jul 07 18:35:58.558839 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.558812    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57/kube-rbac-proxy-thanos/0.log"
Jul 07 18:35:58.584691 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:58.584641    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4d6cfc6a-8f64-4acb-8ce9-a4ba709d5d57/init-config-reloader/0.log"
Jul 07 18:35:59.569674 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.569639    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"]
Jul 07 18:35:59.570062 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570045    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58359c8e-6a80-48c1-b650-af188401462c" containerName="maas-api"
Jul 07 18:35:59.570062 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570057    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="58359c8e-6a80-48c1-b650-af188401462c" containerName="maas-api"
Jul 07 18:35:59.570134 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570067    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy"
Jul 07 18:35:59.570134 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570072    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy"
Jul 07 18:35:59.570134 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570080    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy"
Jul 07 18:35:59.570134 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570085    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy"
Jul 07 18:35:59.570134 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570100    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581fc9e9-8397-44f0-95e9-5f2be1c035f9" containerName="maas-api"
Jul 07 18:35:59.570134 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570106    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="581fc9e9-8397-44f0-95e9-5f2be1c035f9" containerName="maas-api"
Jul 07 18:35:59.570334 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570170    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy"
Jul 07 18:35:59.570334 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570178    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="581fc9e9-8397-44f0-95e9-5f2be1c035f9" containerName="maas-api"
Jul 07 18:35:59.570334 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570185    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="687d5b03-e5aa-4b9e-9443-e830e1172983" containerName="istio-proxy"
Jul 07 18:35:59.570334 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.570192    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="58359c8e-6a80-48c1-b650-af188401462c" containerName="maas-api"
Jul 07 18:35:59.573711 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.573692    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.582844 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.582821    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wg5s4\"/\"kube-root-ca.crt\""
Jul 07 18:35:59.584003 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.583981    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wg5s4\"/\"openshift-service-ca.crt\""
Jul 07 18:35:59.584127 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.584028    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wg5s4\"/\"default-dockercfg-8779w\""
Jul 07 18:35:59.589202 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.589176    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"]
Jul 07 18:35:59.666909 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.666876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-proc\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.667121 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.666926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-lib-modules\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.667121 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.667008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-podres\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.667121 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.667088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnjlm\" (UniqueName: \"kubernetes.io/projected/053c0e01-ce9f-4db9-abd3-403ecd08981d-kube-api-access-cnjlm\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.667241 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.667125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-sys\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768042 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.767990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-lib-modules\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768253 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.768055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-podres\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768253 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.768118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnjlm\" (UniqueName: \"kubernetes.io/projected/053c0e01-ce9f-4db9-abd3-403ecd08981d-kube-api-access-cnjlm\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768253 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.768161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-sys\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768253 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.768178    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-lib-modules\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768253 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.768178    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-podres\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768253 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.768253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-proc\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768534 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.768249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-sys\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.768534 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.768312    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/053c0e01-ce9f-4db9-abd3-403ecd08981d-proc\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.778395 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.778374    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnjlm\" (UniqueName: \"kubernetes.io/projected/053c0e01-ce9f-4db9-abd3-403ecd08981d-kube-api-access-cnjlm\") pod \"perf-node-gather-daemonset-jkbpj\" (UID: \"053c0e01-ce9f-4db9-abd3-403ecd08981d\") " pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:35:59.883737 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:35:59.883645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:36:00.033210 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:00.033182    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"]
Jul 07 18:36:00.035489 ip-10-0-133-54 kubenswrapper[2576]: W0707 18:36:00.035462    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod053c0e01_ce9f_4db9_abd3_403ecd08981d.slice/crio-c1c265cbc6c107c2171e60368313863389ca60c326741d2391456e3e7668fbd1 WatchSource:0}: Error finding container c1c265cbc6c107c2171e60368313863389ca60c326741d2391456e3e7668fbd1: Status 404 returned error can't find the container with id c1c265cbc6c107c2171e60368313863389ca60c326741d2391456e3e7668fbd1
Jul 07 18:36:00.813139 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:00.813102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj" event={"ID":"053c0e01-ce9f-4db9-abd3-403ecd08981d","Type":"ContainerStarted","Data":"277af7b5b9942b561b9c1c909a9d6730b1e80060ec4c3c42918b0d0e72e32c5c"}
Jul 07 18:36:00.813568 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:00.813159    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj" event={"ID":"053c0e01-ce9f-4db9-abd3-403ecd08981d","Type":"ContainerStarted","Data":"c1c265cbc6c107c2171e60368313863389ca60c326741d2391456e3e7668fbd1"}
Jul 07 18:36:00.813568 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:00.813180    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:36:00.837587 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:00.837532    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj" podStartSLOduration=1.8375126499999999 podStartE2EDuration="1.83751265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:36:00.836447429 +0000 UTC m=+2562.450006153" watchObservedRunningTime="2026-07-07 18:36:00.83751265 +0000 UTC m=+2562.451071355"
Jul 07 18:36:01.268479 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:01.268402    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-648cd8cd95-mf596_424ae422-1ed8-4460-a93f-1ef8cb6e9fad/console/0.log"
Jul 07 18:36:03.093204 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:03.093173    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rp9kx_36d1dd46-e3ef-4ca4-894c-3f81da69b65f/dns/0.log"
Jul 07 18:36:03.130907 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:03.130877    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rp9kx_36d1dd46-e3ef-4ca4-894c-3f81da69b65f/kube-rbac-proxy/0.log"
Jul 07 18:36:03.331520 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:03.331491    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xkjn4_10e91e04-35db-47b7-af63-57ecc01537c3/dns-node-resolver/0.log"
Jul 07 18:36:04.099882 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:04.099853    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fr5qf_d5dc7ae3-702f-4a3c-b906-0793fba272ec/node-ca/0.log"
Jul 07 18:36:05.259027 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:05.258988    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4npv84_f3416f1d-50de-4334-865f-c9f8588526e9/istio-proxy/0.log"
Jul 07 18:36:05.531654 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:05.531552    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-889fn_88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897/istio-proxy/0.log"
Jul 07 18:36:05.559894 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:05.559858    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-889fn_88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897/istio-proxy/1.log"
Jul 07 18:36:05.756182 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:05.756143    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zw7r4_49387ada-439f-4eb1-8034-18bfe68da0d0/payload-processing/0.log"
Jul 07 18:36:06.710464 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:06.710434    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h4jl9_d268491c-994c-4b1e-91aa-dca256c3c78c/serve-healthcheck-canary/0.log"
Jul 07 18:36:06.831850 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:06.831825    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wg5s4/perf-node-gather-daemonset-jkbpj"
Jul 07 18:36:07.652918 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:07.652892    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpj9k_517e1774-b586-4e1d-97ae-81f8d8ae987d/kube-rbac-proxy/0.log"
Jul 07 18:36:07.689077 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:07.689053    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpj9k_517e1774-b586-4e1d-97ae-81f8d8ae987d/exporter/0.log"
Jul 07 18:36:07.723509 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:07.723477    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jpj9k_517e1774-b586-4e1d-97ae-81f8d8ae987d/extractor/0.log"
Jul 07 18:36:10.362359 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:10.362320    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9sbzv_89d391e9-7c70-4252-9074-881bf8c184de/manager/0.log"
Jul 07 18:36:10.499186 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:10.499151    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-c9shq_bcc9b791-f30c-4a56-b846-6af4a847c048/manager/0.log"
Jul 07 18:36:10.539048 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:10.539010    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-f7696796f-8tnsw_c6ecf57a-bfd6-4e16-8fc8-f9af83a2fdbf/maas-api/0.log"
Jul 07 18:36:10.547284 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:10.547257    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4npv84_f3416f1d-50de-4334-865f-c9f8588526e9/istio-proxy/0.log"
Jul 07 18:36:10.762085 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:10.762048    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-889fn_88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897/istio-proxy/0.log"
Jul 07 18:36:10.790490 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:10.790450    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-889fn_88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897/istio-proxy/1.log"
Jul 07 18:36:10.874301 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:10.874275    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zw7r4_49387ada-439f-4eb1-8034-18bfe68da0d0/payload-processing/0.log"
Jul 07 18:36:11.260608 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:11.260571    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb7f7967-zmhxn_588669b1-2c85-4ca2-92ae-989cb05cdebe/manager/0.log"
Jul 07 18:36:11.333191 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:11.333114    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fcb7f7967-zmhxn_588669b1-2c85-4ca2-92ae-989cb05cdebe/copy-manifests/0.log"
Jul 07 18:36:11.391297 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:11.391268    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-d7x4s_d14df388-103d-47cd-b416-8e7a00b4f61e/postgres/0.log"
Jul 07 18:36:12.148719 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:12.148695    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4npv84_f3416f1d-50de-4334-865f-c9f8588526e9/istio-proxy/0.log"
Jul 07 18:36:12.341312 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:12.341281    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-889fn_88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897/istio-proxy/0.log"
Jul 07 18:36:12.375711 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:12.375679    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-889fn_88c6d450-c9d2-4c5a-b7bd-f69a7fe7f897/istio-proxy/1.log"
Jul 07 18:36:12.462664 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:12.462557    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zw7r4_49387ada-439f-4eb1-8034-18bfe68da0d0/payload-processing/0.log"
Jul 07 18:36:12.746463 ip-10-0-133-54 kubenswrapper[2576]: I0707 18:36:12.746361    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-694995b85-4kjrk_5ff1a800-d299-4e3a-acee-a7fc8feb2f3b/manager/0.log"