Jul 06 21:19:22.091791 ip-10-0-133-11 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 21:19:22.091805 ip-10-0-133-11 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 21:19:22.091815 ip-10-0-133-11 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 21:19:22.092157 ip-10-0-133-11 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 21:19:32.124729 ip-10-0-133-11 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 21:19:32.124753 ip-10-0-133-11 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8b523e40a77f4c078fde3f8322e51470 --
Jul 06 21:21:31.256706 ip-10-0-133-11 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 21:21:31.669966 ip-10-0-133-11 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 21:21:31.669966 ip-10-0-133-11 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 21:21:31.669966 ip-10-0-133-11 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 21:21:31.669966 ip-10-0-133-11 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 21:21:31.669966 ip-10-0-133-11 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 21:21:31.671112 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.671022    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 21:21:31.676669 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676644    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.676669 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676663    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.676669 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676671    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676677    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676683    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676687    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676691    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676694    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676698    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676703    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676706    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676710    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676714    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676718    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676722    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676727    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676730    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676734    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676739    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676743    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676748    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676752    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676757    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.676883 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676761    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676765    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676777    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676781    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676785    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676789    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676794    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676798    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676803    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676808    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676813    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676817    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676825    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676832    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676837    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676842    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676847    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676852    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676857    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.677642 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676862    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676866    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676871    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676876    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676880    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676884    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676888    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676893    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676898    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676903    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676909    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676913    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676919    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676923    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676928    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676933    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676938    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676943    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676948    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676952    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.678324 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676957    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676961    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676966    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676971    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676975    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676980    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676985    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676990    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676995    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.676999    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677004    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677008    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677013    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677018    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677022    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677027    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677032    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677036    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677040    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.679203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677045    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677054    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677062    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677068    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677072    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677078    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677083    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677088    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677092    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677097    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677101    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677106    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677112    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677117    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677121    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677126    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677131    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.677135    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679161    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679175    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.680082 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679181    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679186    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679191    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679197    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679201    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679205    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679209    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679214    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679218    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679223    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679227    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679232    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679237    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679242    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679246    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679252    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679257    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679262    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679266    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679271    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.680996 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679275    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679280    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679284    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679288    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679292    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679297    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679302    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679306    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679311    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679316    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679320    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679327    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679332    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679337    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679342    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679346    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679353    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679360    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679365    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679370    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.681977 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679374    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679380    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679385    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679391    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679397    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679402    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679407    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679412    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679419    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679424    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679429    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679434    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679441    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679447    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679452    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679457    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679462    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679467    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679472    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.682812 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679477    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679482    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679487    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679492    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679497    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679502    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679530    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679538    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679543    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679547    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679552    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679557    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679561    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679566    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679571    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679575    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679580    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679584    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679589    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679593    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.683331 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679598    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679606    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679612    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679617    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679622    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679626    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679630    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679635    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679639    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679644    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679649    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679654    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679659    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679663    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679668    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679672    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679677    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.679682    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680349    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.683952 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680358    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680363    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680367    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680372    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680377    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680382    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680386    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680391    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680396    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680400    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680405    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680409    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680414    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680419    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680424    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680430    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680434    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680439    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680443    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680448    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.684750 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680452    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680457    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680461    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680465    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680470    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680474    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680479    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680484    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680489    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680495    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680500    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680526    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680531    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680536    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680541    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680544    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680549    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680554    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680559    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680566    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.685296 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680571    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680576    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680580    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680585    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680589    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680594    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680625    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680633    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680639    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680645    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680650    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680654    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680659    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680665    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680669    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680675    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680680    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680686    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680690    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680695    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.686120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680700    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680706    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680712    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680717    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680721    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680726    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680731    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680735    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680739    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680744    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680748    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680754    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680758    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680763    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680767    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680771    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680776    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680780    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680785    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680789    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.686716 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680794    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680799    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680804    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680808    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680813    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680817    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680824    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680830    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680836    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680840    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680845    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680852    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680857    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680862    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680870    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680875    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680881    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.680887    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.680988    2554 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681000    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 21:21:31.687252 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681009    2554 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681015    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681022    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681027    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681035    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681043    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681048    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681053    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681059    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681068    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681073    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681079    2554 flags.go:64] FLAG: --cgroup-root=""
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681083    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681089    2554 flags.go:64] FLAG: --client-ca-file=""
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681096    2554 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681101    2554 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681109    2554 flags.go:64] FLAG: --cluster-domain=""
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681113    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681119    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681125    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681130    2554 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681137    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681142    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 21:21:31.687828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681148    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681153    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681159    2554 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681164    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681169    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681175    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681180    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681187    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681193    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681198    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681203    2554 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681208    2554 flags.go:64] FLAG: --enable-server="true"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681214    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681221    2554 flags.go:64] FLAG: --event-burst="100"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681226    2554 flags.go:64] FLAG: --event-qps="50"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681231    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681236    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681241    2554 flags.go:64] FLAG: --eviction-hard=""
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681249    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681254    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681260    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681265    2554 flags.go:64] FLAG: --eviction-soft=""
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681270    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681275    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681281    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 21:21:31.688415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681286    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681291    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681296    2554 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681300    2554 flags.go:64] FLAG: --feature-gates=""
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681314    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681320    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681325    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681331    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681336    2554 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681341    2554 flags.go:64] FLAG: --help="false"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681346    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-133-11.ec2.internal"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681352    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681358    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681363    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681369    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681374    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681379    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681384    2554 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681389    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681394    2554 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681399    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681404    2554 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681409    2554 flags.go:64] FLAG: --kube-reserved=""
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681414    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 21:21:31.689134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681419    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681427    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681432    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681437    2554 flags.go:64] FLAG: --lock-file=""
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681441    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681447    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681452    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681461    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681472    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681478    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681483    2554 flags.go:64] FLAG: --logging-format="text"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681488    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681493    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681498    2554 flags.go:64] FLAG: --manifest-url=""
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681521    2554 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681530    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681535    2554 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681545    2554 flags.go:64] FLAG: --max-pods="110"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681550    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681556    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681560    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681566    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681570    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681575    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681581    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 21:21:31.689798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681593    2554 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681598    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681603    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681615    2554 flags.go:64] FLAG: --pod-cidr=""
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681620    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681630    2554 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681634    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681640    2554 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681646    2554 flags.go:64] FLAG: --port="10250"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681652    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681656    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06709df6714b650c0"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681662    2554 flags.go:64] FLAG: --qos-reserved=""
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681667    2554 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681672    2554 flags.go:64] FLAG: --register-node="true"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681678    2554 flags.go:64] FLAG: --register-with-taints=""
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681684    2554 flags.go:64] FLAG: --registry-burst="10"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681698    2554 flags.go:64] FLAG: --registry-qps="5"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681703    2554 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681708    2554 flags.go:64] FLAG: --reserved-memory=""
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681715    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681721    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681726    2554 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681731    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681736    2554 flags.go:64] FLAG: --runonce="false"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681740    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 21:21:31.690463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681747    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681752    2554 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681758    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681763    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681768    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681774    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681779    2554 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681784    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681789    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681793    2554 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681798    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681804    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681809    2554 flags.go:64] FLAG: --system-cgroups=""
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681814    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681823    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681830    2554 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681834    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681849    2554 flags.go:64] FLAG: --tls-min-version=""
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681854    2554 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681859    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681864    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681870    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681875    2554 flags.go:64] FLAG: --v="2"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681881    2554 flags.go:64] FLAG: --version="false"
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681889    2554 flags.go:64] FLAG: --vmodule=""
Jul 06 21:21:31.691143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681896    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.681902    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682090    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682097    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682103    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682108    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682113    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682121    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682126    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682130    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682135    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682140    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682144    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682148    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682153    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682157    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682163    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682167    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682172    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682176    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.691861 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682181    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682185    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682192    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682197    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682202    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682207    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682212    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682216    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682221    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682225    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682230    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682234    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682240    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682244    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682250    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682254    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682259    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682264    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682269    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682276    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.692386 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682280    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682285    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682289    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682294    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682299    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682303    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682310    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682316    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682324    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682330    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682336    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682342    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682347    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682352    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682363    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682368    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682373    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682378    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682383    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.692934 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682388    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682392    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682397    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682401    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682406    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682411    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682416    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682420    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682425    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682429    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682434    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682438    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682445    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682449    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682454    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682459    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682464    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682468    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682472    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.693434 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682477    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682482    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682486    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682491    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682496    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682500    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682522    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682527    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682534    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682539    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682544    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682549    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682553    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682558    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682563    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682568    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682572    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682580    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682586    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.693984 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682591    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682601    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682607    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.682612    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.683319    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.690909    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.690926    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.690948    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.690954    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691018    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691024    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691027    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691030    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691033    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691036    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.694499 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691039    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691042    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691045    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691047    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691050    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691053    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691056    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691059    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691062    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691065    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691068    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691071    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691074    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691077    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691079    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691082    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691085    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691088    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691091    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691094    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.694943 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691096    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691099    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691102    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691106    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691109    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691112    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691115    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691118    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691120    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691123    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691126    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691129    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691131    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691134    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691137    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691140    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691143    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691146    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691149    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691152    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.695468 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691155    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691158    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691161    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691164    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691167    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691170    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691173    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691175    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691178    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691182    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691186    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691189    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691192    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691196    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691199    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691203    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691214    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691217    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691220    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691223    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.696014 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691226    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691229    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691231    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691234    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691237    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691241    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691245    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691248    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691251    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691254    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691257    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691259    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691262    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691265    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691268    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691270    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691273    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691276    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691279    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.696560 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691281    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691284    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691287    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691289    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691292    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691295    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691298    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691301    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691304    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691307    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691316    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691321    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691325    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691328    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.691333    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 21:21:31.697045 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691480    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691486    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691489    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691492    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691495    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691498    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691501    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691519    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691523    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691526    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691529    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691532    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691535    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691538    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691541    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691544    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691546    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691549    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691552    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.697453 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691554    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691557    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691560    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691563    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691565    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691568    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691580    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691583    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691586    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691595    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691598    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691601    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691604    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691607    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691609    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691612    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691615    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691617    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691620    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691623    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.698012 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691626    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691628    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691631    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691633    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691636    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691639    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691641    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691644    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691646    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691649    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691652    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691654    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691657    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691660    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691662    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691665    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691669    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691672    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691676    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691680    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.698557 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691683    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691686    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691696    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691699    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691702    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691704    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691707    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691710    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691713    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691716    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691718    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691721    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691723    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691726    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691729    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691732    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691734    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691737    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691740    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691743    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.699106 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691745    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691748    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691751    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691755    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691759    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691762    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691765    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691768    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691770    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691773    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691776    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691780    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691782    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691785    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691788    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691797    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691799    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691802    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691805    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.699733 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:31.691807    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.700226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.691813    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 21:21:31.700226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.691945    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 21:21:31.700226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.694120    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 21:21:31.700226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.695967    2554 server.go:1019] "Starting client certificate rotation"
Jul 06 21:21:31.700226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.696091    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 21:21:31.700226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.696132    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 21:21:31.700226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.699005    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 21:21:31.700712 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.700683    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 21:21:31.709805 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.709784    2554 log.go:25] "Validated CRI v1 runtime API"
Jul 06 21:21:31.711869 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.711853    2554 log.go:25] "Validated CRI v1 image API"
Jul 06 21:21:31.712655 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.712640    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 21:21:31.717720 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.717698    2554 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c3ce82c4-13fd-47ee-ad3b-e617baf893c9:/dev/nvme0n1p3 d2550307-872b-4a0f-a747-a5fff9dcda03:/dev/nvme0n1p4]
Jul 06 21:21:31.717777 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.717719    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 21:21:31.724627 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.724479    2554 manager.go:216] Machine: {Timestamp:2026-07-06 21:21:31.723115899 +0000 UTC m=+0.344698232 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3158102 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2acfd719b90f01e7d71dc62dc6214b SystemUUID:ec2acfd7-19b9-0f01-e7d7-1dc62dc6214b BootID:8b523e40-a77f-4c07-8fde-3f8322e51470 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:82:39:d3:e6:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:82:39:d3:e6:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:c0:f3:25:fc:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 21:21:31.724627 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.724622    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 21:21:31.724741 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.724710    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 21:21:31.728119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.728087    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 21:21:31.728274 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.728123    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-11.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 21:21:31.728877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.728866    2554 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 21:21:31.728912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.728880    2554 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 21:21:31.728912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.728888    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 21:21:31.729372 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.729360    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 21:21:31.730738 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.730725    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 21:21:31.734045 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734026    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 21:21:31.734215 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734202    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 21:21:31.734361 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734351    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 21:21:31.734394 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734385    2554 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 21:21:31.734427 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734403    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 21:21:31.734427 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734419    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 21:21:31.734486 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734429    2554 kubelet.go:398] "Adding apiserver pod source"
Jul 06 21:21:31.734486 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734438    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 21:21:31.734947 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734932    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 21:21:31.735003 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.734964    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 21:21:31.737715 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.737679    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 21:21:31.739720 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.739702    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 21:21:31.739763 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.739739    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 21:21:31.740842 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740820    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 21:21:31.740842 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740838    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 21:21:31.740842 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740845    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 21:21:31.740842 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740851    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 21:21:31.741092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740860    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 21:21:31.741092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740866    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 21:21:31.741092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740874    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 21:21:31.741092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740880    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 21:21:31.741092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740891    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 21:21:31.741092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740897    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 21:21:31.741092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740906    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 21:21:31.741092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.740911    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 21:21:31.741594 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.741582    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 21:21:31.741594 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.741593    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 21:21:31.745288 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.745274    2554 server.go:1268] "Started kubelet"
Jul 06 21:21:31.745543 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.745443    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 21:21:31.749846 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.749698    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 21:21:31.749846 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.749799    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 21:21:31.750388 ip-10-0-133-11 systemd[1]: Started Kubernetes Kubelet.
Jul 06 21:21:31.751471 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.751208    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-11.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 21:21:31.751471 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.751435    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 21:21:31.752003 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.751979    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 21:21:31.752090 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.752069    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 21:21:31.753454 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.753424    2554 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 21:21:31.757627 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.757600    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 21:21:31.758062 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.757059    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18bfd03242895b6a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.745246058 +0000 UTC m=+0.366828368,LastTimestamp:2026-07-06 21:21:31.745246058 +0000 UTC m=+0.366828368,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}"
Jul 06 21:21:31.760728 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.760711    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 21:21:31.760728 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.760722    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 21:21:31.760844 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.760813    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:31.761513 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761405    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 21:21:31.761513 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761505    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 21:21:31.761682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761522    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 21:21:31.761682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761606    2554 factory.go:55] Registering systemd factory
Jul 06 21:21:31.761682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761621    2554 factory.go:223] Registration of the systemd container factory successfully
Jul 06 21:21:31.761682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761679    2554 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 21:21:31.761682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761687    2554 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 21:21:31.761949 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761935    2554 factory.go:153] Registering CRI-O factory
Jul 06 21:21:31.761984 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.761954    2554 factory.go:223] Registration of the crio container factory successfully
Jul 06 21:21:31.762032 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.762011    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 21:21:31.762073 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.762041    2554 factory.go:103] Registering Raw factory
Jul 06 21:21:31.762073 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.762058    2554 manager.go:1196] Started watching for new ooms in manager
Jul 06 21:21:31.762627 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.762609    2554 manager.go:349] Starting recovery of all containers
Jul 06 21:21:31.765335 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.765307    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 21:21:31.765429 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.765356    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 21:21:31.774084 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.774063    2554 manager.go:354] Recovery completed
Jul 06 21:21:31.778396 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.778382    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:31.782349 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.782325    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:31.782446 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.782368    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:31.782446 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.782379    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:31.783314 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.783299    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 21:21:31.783314 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.783311    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 21:21:31.783462 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.783319    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:31.783462 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.783328    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 21:21:31.784085 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.784070    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:31.784155 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.784103    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:31.784155 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.784119    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:31.784762 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.784748    2554 policy_none.go:49] "None policy: Start"
Jul 06 21:21:31.784815 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.784765    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 21:21:31.784815 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.784776    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 21:21:31.787289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.787269    2554 policy_none.go:47] "Start"
Jul 06 21:21:31.787469 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.787378    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18bfd03244bf804d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-11.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.782348877 +0000 UTC m=+0.403931195,LastTimestamp:2026-07-06 21:21:31.782348877 +0000 UTC m=+0.403931195,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}"
Jul 06 21:21:31.799952 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.799765    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18bfd03244bfe0db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-11.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.782373595 +0000 UTC m=+0.403955906,LastTimestamp:2026-07-06 21:21:31.782373595 +0000 UTC m=+0.403955906,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}"
Jul 06 21:21:31.801882 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.801813    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18bfd03244c0088e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-11.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.782383758 +0000 UTC m=+0.403966071,LastTimestamp:2026-07-06 21:21:31.782383758 +0000 UTC m=+0.403966071,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}"
Jul 06 21:21:31.812677 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.812612    2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-11.ec2.internal.18bfd03244bf804d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18bfd03244bf804d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-11.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.782348877 +0000 UTC m=+0.403931195,LastTimestamp:2026-07-06 21:21:31.784085366 +0000 UTC m=+0.405667681,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}"
Jul 06 21:21:31.821551 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.821529    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rps6t"
Jul 06 21:21:31.822686 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.822617    2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-11.ec2.internal.18bfd03244bfe0db\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18bfd03244bfe0db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-11.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.782373595 +0000 UTC m=+0.403955906,LastTimestamp:2026-07-06 21:21:31.784110316 +0000 UTC m=+0.405692632,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}"
Jul 06 21:21:31.824957 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.824938    2554 manager.go:337] "Starting Device Plugin manager"
Jul 06 21:21:31.825040 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.824977    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 21:21:31.825040 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.824988    2554 server.go:87] "Starting device plugin registration server"
Jul 06 21:21:31.825236 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.825222    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 21:21:31.825298 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.825235    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 21:21:31.825347 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.825317    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 21:21:31.825413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.825398    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 21:21:31.825469 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.825415    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 21:21:31.826022 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.826003    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 21:21:31.826091 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.826048    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:31.833315 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.833297    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rps6t"
Jul 06 21:21:31.834895 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.834836    2554 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-11.ec2.internal.18bfd03244c0088e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-11.ec2.internal.18bfd03244c0088e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-11.ec2.internal,UID:ip-10-0-133-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-11.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-11.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.782383758 +0000 UTC m=+0.403966071,LastTimestamp:2026-07-06 21:21:31.784125494 +0000 UTC m=+0.405707810,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-11.ec2.internal,}"
Jul 06 21:21:31.929073 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.928990    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:31.930273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.930071    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:31.930273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.930111    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:31.930273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.930127    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:31.930273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.930161    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-11.ec2.internal"
Jul 06 21:21:31.944094 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.944066    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-11.ec2.internal"
Jul 06 21:21:31.944094 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.944093    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-11.ec2.internal\": node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:31.978481 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.978435    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 21:21:31.979804 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.979783    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 21:21:31.979928 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.979823    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 21:21:31.979928 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.979850    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 21:21:31.979928 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.979887    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 21:21:31.982373 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:31.982354    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:31.983664 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:31.983645    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.080736 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.080690    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal"]
Jul 06 21:21:32.080924 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.080853    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.082598 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.082578    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.082681 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.082613    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.082681 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.082625    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.084153 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.084136    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.084198 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.084154    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.084325 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.084297    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.084366 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.084339    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.084919 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.084902    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.084997 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.084930    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.084997 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.084941    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.084997 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.084905    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.085151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.085006    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.085151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.085017    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.086347 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.086333    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.086412 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.086359    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.087033 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.087014    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.087148 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.087045    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.087148 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.087056    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.109348 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.109325    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-11.ec2.internal\" not found" node="ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.114035 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.114015    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-11.ec2.internal\" not found" node="ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.165682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.165649    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.165682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.165686    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.165849 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.165706    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9534bd1ba9e0a23b627fcaab9f623fa1-config\") pod \"kube-apiserver-proxy-ip-10-0-133-11.ec2.internal\" (UID: \"9534bd1ba9e0a23b627fcaab9f623fa1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.186551 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.184803    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.266656 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.266621    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.266656 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.266637    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.266863 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.266680    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.266863 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.266706    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9534bd1ba9e0a23b627fcaab9f623fa1-config\") pod \"kube-apiserver-proxy-ip-10-0-133-11.ec2.internal\" (UID: \"9534bd1ba9e0a23b627fcaab9f623fa1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.266863 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.266755    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9534bd1ba9e0a23b627fcaab9f623fa1-config\") pod \"kube-apiserver-proxy-ip-10-0-133-11.ec2.internal\" (UID: \"9534bd1ba9e0a23b627fcaab9f623fa1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.266863 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.266775    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bbadb413c950138009b9d470a71bb26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal\" (UID: \"bbadb413c950138009b9d470a71bb26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.285712 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.285680    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.386462 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.386392    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.412925 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.412892    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.418146 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.418127    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:32.487655 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.487551    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.588659 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.588618    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.690054 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.690015    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.695403 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.695378    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 21:21:32.695628 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.695594    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 21:21:32.790866 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.790777    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.836824 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.836772    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 21:16:32 +0000 UTC" deadline="2028-01-01 06:54:38.248850008 +0000 UTC"
Jul 06 21:21:32.836943 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.836826    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13041h33m5.412034293s"
Jul 06 21:21:32.860725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.860694    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.867570 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.867545    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.867694 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.867582    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.867694 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.867592    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.891944 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.891921    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:32.960308 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:32.960278    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:32.992028 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:32.991994    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-11.ec2.internal\" not found"
Jul 06 21:21:33.037796 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.037768    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:33.061364 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.061319    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:33.080190 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.080152    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 21:21:33.082387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.082362    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal"
Jul 06 21:21:33.110028 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.109998    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 21:21:33.148546 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:33.148478    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbadb413c950138009b9d470a71bb26b.slice/crio-37b6d7f021328c5ce1409a12752645a1cb87a697e3e32e9bb27209449c96fa87 WatchSource:0}: Error finding container 37b6d7f021328c5ce1409a12752645a1cb87a697e3e32e9bb27209449c96fa87: Status 404 returned error can't find the container with id 37b6d7f021328c5ce1409a12752645a1cb87a697e3e32e9bb27209449c96fa87
Jul 06 21:21:33.148904 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:33.148882    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9534bd1ba9e0a23b627fcaab9f623fa1.slice/crio-21041f51ed12b62743c82f1b2e0942f2f9e8e60a443b9d52f7d7a150ed8bac3f WatchSource:0}: Error finding container 21041f51ed12b62743c82f1b2e0942f2f9e8e60a443b9d52f7d7a150ed8bac3f: Status 404 returned error can't find the container with id 21041f51ed12b62743c82f1b2e0942f2f9e8e60a443b9d52f7d7a150ed8bac3f
Jul 06 21:21:33.153424 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.153410    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 21:21:33.213447 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.213411    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:33.736507 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.736473    2554 apiserver.go:52] "Watching apiserver"
Jul 06 21:21:33.746825 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.746792    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 21:21:33.749624 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.749585    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal","openshift-multus/multus-vlbt8","openshift-network-operator/iptables-alerter-j4d55","openshift-ovn-kubernetes/ovnkube-node-thgth","kube-system/global-pull-secret-syncer-447vd","kube-system/konnectivity-agent-vlpm7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s","openshift-cluster-node-tuning-operator/tuned-vk568","openshift-dns/node-resolver-z966s","openshift-multus/multus-additional-cni-plugins-bzk4f","openshift-multus/network-metrics-daemon-slj8s","openshift-network-diagnostics/network-check-target-h2bwk","kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal","openshift-image-registry/node-ca-tzktv"]
Jul 06 21:21:33.751472 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.751452    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:33.752818 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.752780    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.754113 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.754090    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:33.754214 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.754178    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:33.755394 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.755371    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:33.755522 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.755459    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:33.757447 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.757406    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.759025 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.759005    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.759119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.759025    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.759119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.759062    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-577qj\""
Jul 06 21:21:33.759663 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.759641    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nl8nk\""
Jul 06 21:21:33.759931 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.759774    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 21:21:33.759931 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.759799    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 21:21:33.759931 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.759860    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 21:21:33.760178 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.760077    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.760457 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.760365    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.761528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.760725    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.761528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.760870    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 21:21:33.761528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.761123    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-thzln\""
Jul 06 21:21:33.761528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.761334    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 21:21:33.761528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.761439    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 21:21:33.761990 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.761584    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.761990 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.761915    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 21:21:33.762475 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.762260    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.762475 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.762396    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.762475 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.762425    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 21:21:33.762697 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.762676    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 21:21:33.763082 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.763068    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 21:21:33.763652 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.763246    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.763652 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.763456    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 21:21:33.764184 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.764125    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5hv6b\""
Jul 06 21:21:33.764276 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.764201    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.765405 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.765249    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.766240 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.766212    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.766824 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.766470    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sb888\""
Jul 06 21:21:33.766824 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.766503    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 21:21:33.766824 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.766563    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.768166 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.767269    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.768166 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.767599    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5f297\""
Jul 06 21:21:33.768687 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.768569    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.768857 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.768777    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cztsh\""
Jul 06 21:21:33.769491 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.769214    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.769491 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.769323    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:33.770466 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.770306    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.772400 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.772381    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.773448 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773408    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.773700 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-host\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.773803 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773715    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-kubelet\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.773803 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-sys-fs\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.773803 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773764    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cnibin\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.773803 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773789    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-env-overrides\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774021 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773814    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:33.774021 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773839    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-log-socket\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774021 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773892    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2967\" (UniqueName: \"kubernetes.io/projected/316703a3-4854-4359-bcda-1a6c82861629-kube-api-access-g2967\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.774021 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773926    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysctl-d\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.774021 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773955    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-os-release\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.774021 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.773981    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovnkube-config\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774021 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774006    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774038    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-systemd\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774073    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-run-ovn-kubernetes\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774109    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8876d\" (UniqueName: \"kubernetes.io/projected/d320d61c-9702-4005-845e-1f9143567533-kube-api-access-8876d\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774172    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774203    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-run\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774229    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-etc-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774259    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774287    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-ovn\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774312    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-device-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774338    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3-konnectivity-ca\") pod \"konnectivity-agent-vlpm7\" (UID: \"4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3\") " pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:33.774374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774371    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d320d61c-9702-4005-845e-1f9143567533-host\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774394    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-sys\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774419    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-system-cni-dir\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774443    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-lib-modules\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774486    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774557    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-kubernetes\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774601    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774648    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d320d61c-9702-4005-845e-1f9143567533-serviceca\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774684    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-node-log\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774716    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysconfig\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774756    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysctl-conf\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774792    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-tuned\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774816    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-registration-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774842    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-etc-selinux\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.774912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774897    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-systemd\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774943    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-var-lib-kubelet\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fldf7\" (UniqueName: \"kubernetes.io/projected/f4b9a4d2-f659-4637-8310-b2d373ce0a74-kube-api-access-fldf7\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.774997    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-socket-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775026    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775050    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775074    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovnkube-script-lib\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775101    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbx94\" (UniqueName: \"kubernetes.io/projected/4d35cde2-d4f1-4831-bc6e-0db34876af88-kube-api-access-sbx94\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775128    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-modprobe-d\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775154    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnwlp\" (UniqueName: \"kubernetes.io/projected/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-kube-api-access-gnwlp\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-var-lib-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775204    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovn-node-metrics-cert\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775227    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3-agent-certs\") pod \"konnectivity-agent-vlpm7\" (UID: \"4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3\") " pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775251    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-cni-bin\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775275    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-cni-netd\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775302    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb990b9-bb11-47f1-96a4-f77243b073c5-tmp\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.775413 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775326    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2hg2\" (UniqueName: \"kubernetes.io/projected/7fb990b9-bb11-47f1-96a4-f77243b073c5-kube-api-access-b2hg2\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.776172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775388    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-systemd-units\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.776172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775424    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-slash\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.776172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775484    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-run-netns\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.776172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.775673    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.776968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.776945    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 21:21:33.777065 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.777014    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.777065 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.776954    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-smmrp\""
Jul 06 21:21:33.777175 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.777083    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.777175 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.777083    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9b46j\""
Jul 06 21:21:33.780366 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.780274    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 21:21:33.786037 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.786015    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 21:21:33.786155 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.786075    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:33.835031 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.835007    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z44b2"
Jul 06 21:21:33.848071 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.848047    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z44b2"
Jul 06 21:21:33.862903 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.862881    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 21:21:33.876638 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876606    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovnkube-config\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.876761 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876654    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnvs6\" (UniqueName: \"kubernetes.io/projected/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-kube-api-access-qnvs6\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.876761 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876683    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-etc-kubernetes\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.876761 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876712    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.876761 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-systemd\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.876968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876805    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-run-ovn-kubernetes\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.876968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876809    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-systemd\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.876968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876852    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8876d\" (UniqueName: \"kubernetes.io/projected/d320d61c-9702-4005-845e-1f9143567533-kube-api-access-8876d\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.876968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876876    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-run-ovn-kubernetes\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.876968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876919    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:33.876968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876942    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.876968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876952    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-iptables-alerter-script\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.876983    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-host-slash\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877008    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-cnibin\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877034    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-run\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877061    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-etc-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877085    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.877063    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877147    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-ovn\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877153    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877109    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-etc-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.877279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877109    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-run-ovn\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.877308    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs podName:4d35cde2-d4f1-4831-bc6e-0db34876af88 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:34.377256555 +0000 UTC m=+2.998838877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs") pod "network-metrics-daemon-slj8s" (UID: "4d35cde2-d4f1-4831-bc6e-0db34876af88") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877331    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-device-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877384    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3-konnectivity-ca\") pod \"konnectivity-agent-vlpm7\" (UID: \"4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3\") " pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877423    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovnkube-config\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877478    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-device-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d320d61c-9702-4005-845e-1f9143567533-host\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877607    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5zfj\" (UniqueName: \"kubernetes.io/projected/a8dc5d9b-cafa-44e0-9031-cf12c0632135-kube-api-access-h5zfj\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877635    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-sys\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877662    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-system-cni-dir\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877689    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8dc5d9b-cafa-44e0-9031-cf12c0632135-tmp-dir\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877720    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-k8s-cni-cncf-io\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877725    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-run\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.877772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877765    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-hostroot\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877820    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-sys\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877846    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-system-cni-dir\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877881    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-conf-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877915    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d320d61c-9702-4005-845e-1f9143567533-host\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877947    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-daemon-config\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.877991    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-multus-certs\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878043    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-lib-modules\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878104    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-cni-bin\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878143    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsc9t\" (UniqueName: \"kubernetes.io/projected/e1e160fe-0dbb-423a-ba4b-45836113262b-kube-api-access-bsc9t\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878175    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3-konnectivity-ca\") pod \"konnectivity-agent-vlpm7\" (UID: \"4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3\") " pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878184    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-kubernetes\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878214    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.878261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878246    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-kubernetes\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878256    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d320d61c-9702-4005-845e-1f9143567533-serviceca\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878272    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-lib-modules\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878317    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8dc5d9b-cafa-44e0-9031-cf12c0632135-hosts-file\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878325    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878346    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-node-log\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878379    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-node-log\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878381    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-netns\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878412    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysconfig\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878465    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysctl-conf\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878486    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-tuned\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878502    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-registration-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878517    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-etc-selinux\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878553    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7975b17c-b872-4395-a032-094e41b8ac03-dbus\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878618    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-registration-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878723    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-etc-selinux\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878505    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysconfig\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.878918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878777    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysctl-conf\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878815    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878838    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-systemd\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878853    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878876    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-var-lib-kubelet\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878904    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fldf7\" (UniqueName: \"kubernetes.io/projected/f4b9a4d2-f659-4637-8310-b2d373ce0a74-kube-api-access-fldf7\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878909    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-systemd\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878930    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-socket-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878941    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d320d61c-9702-4005-845e-1f9143567533-serviceca\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878973    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-cni-multus\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879004    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.878980    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-var-lib-kubelet\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879032    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879040    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovnkube-script-lib\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879164    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-socket-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879257    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbx94\" (UniqueName: \"kubernetes.io/projected/4d35cde2-d4f1-4831-bc6e-0db34876af88-kube-api-access-sbx94\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:33.879646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879319    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7975b17c-b872-4395-a032-094e41b8ac03-kubelet-config\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879356    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-modprobe-d\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879566    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnwlp\" (UniqueName: \"kubernetes.io/projected/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-kube-api-access-gnwlp\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879631    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879613    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-var-lib-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879682    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovn-node-metrics-cert\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879702    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-var-lib-openvswitch\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879707    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovnkube-script-lib\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879714    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3-agent-certs\") pod \"konnectivity-agent-vlpm7\" (UID: \"4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3\") " pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879949    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.879714    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-modprobe-d\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880190    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-cni-bin\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880221    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-cni-netd\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880248    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb990b9-bb11-47f1-96a4-f77243b073c5-tmp\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880274    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2hg2\" (UniqueName: \"kubernetes.io/projected/7fb990b9-bb11-47f1-96a4-f77243b073c5-kube-api-access-b2hg2\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880303    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-systemd-units\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880324    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-slash\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.880672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880347    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-run-netns\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880368    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880393    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-os-release\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880424    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-host\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880451    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-kubelet\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880479    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-sys-fs\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880516    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-cni-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880544    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-socket-dir-parent\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880568    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-kubelet\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880596    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cnibin\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880624    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-env-overrides\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880661    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880688    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-system-cni-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880710    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1e160fe-0dbb-423a-ba4b-45836113262b-cni-binary-copy\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880755    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-sys-fs\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880768    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-cni-bin\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880764    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-cnibin\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.881646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880805    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/316703a3-4854-4359-bcda-1a6c82861629-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880817    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-slash\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880828    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-host\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880839    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-log-socket\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880659    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-cni-netd\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880887    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-run-netns\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880906    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-host-kubelet\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.880883    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2967\" (UniqueName: \"kubernetes.io/projected/316703a3-4854-4359-bcda-1a6c82861629-kube-api-access-g2967\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.881022    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-systemd-units\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.881039    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysctl-d\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.881075    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-os-release\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.881081    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4b9a4d2-f659-4637-8310-b2d373ce0a74-log-socket\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.881162    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-os-release\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.881183    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4b9a4d2-f659-4637-8310-b2d373ce0a74-env-overrides\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.882492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.881231    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-sysctl-d\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.883651 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.883575    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7fb990b9-bb11-47f1-96a4-f77243b073c5-etc-tuned\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.883821 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.883686    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4b9a4d2-f659-4637-8310-b2d373ce0a74-ovn-node-metrics-cert\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.883821 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.883688    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7fb990b9-bb11-47f1-96a4-f77243b073c5-tmp\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.883945 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.883835    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3-agent-certs\") pod \"konnectivity-agent-vlpm7\" (UID: \"4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3\") " pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:33.903438 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.903401    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:33.903626 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.903491    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:33.903848 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.903770    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqtrw for pod openshift-network-diagnostics/network-check-target-h2bwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:33.903945 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.903881    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw podName:e2f78910-86f6-4cb7-b93d-2e618fbe80fe nodeName:}" failed. No retries permitted until 2026-07-06 21:21:34.403850832 +0000 UTC m=+3.025433129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vqtrw" (UniqueName: "kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw") pod "network-check-target-h2bwk" (UID: "e2f78910-86f6-4cb7-b93d-2e618fbe80fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:33.905196 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.905092    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbx94\" (UniqueName: \"kubernetes.io/projected/4d35cde2-d4f1-4831-bc6e-0db34876af88-kube-api-access-sbx94\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:33.906813 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.906253    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2hg2\" (UniqueName: \"kubernetes.io/projected/7fb990b9-bb11-47f1-96a4-f77243b073c5-kube-api-access-b2hg2\") pod \"tuned-vk568\" (UID: \"7fb990b9-bb11-47f1-96a4-f77243b073c5\") " pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:33.906813 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.906713    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnwlp\" (UniqueName: \"kubernetes.io/projected/5e0b5fbc-e414-4f2f-bccd-42fba0c9f387-kube-api-access-gnwlp\") pod \"multus-additional-cni-plugins-bzk4f\" (UID: \"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387\") " pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:33.907470 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.907443    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2967\" (UniqueName: \"kubernetes.io/projected/316703a3-4854-4359-bcda-1a6c82861629-kube-api-access-g2967\") pod \"aws-ebs-csi-driver-node-6bf6s\" (UID: \"316703a3-4854-4359-bcda-1a6c82861629\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:33.907639 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.907531    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8876d\" (UniqueName: \"kubernetes.io/projected/d320d61c-9702-4005-845e-1f9143567533-kube-api-access-8876d\") pod \"node-ca-tzktv\" (UID: \"d320d61c-9702-4005-845e-1f9143567533\") " pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:33.912552 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.912498    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fldf7\" (UniqueName: \"kubernetes.io/projected/f4b9a4d2-f659-4637-8310-b2d373ce0a74-kube-api-access-fldf7\") pod \"ovnkube-node-thgth\" (UID: \"f4b9a4d2-f659-4637-8310-b2d373ce0a74\") " pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:33.981552 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981519    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-kubelet\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.981750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981578    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-system-cni-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.981750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981601    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1e160fe-0dbb-423a-ba4b-45836113262b-cni-binary-copy\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.981750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981627    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnvs6\" (UniqueName: \"kubernetes.io/projected/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-kube-api-access-qnvs6\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.981750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981650    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-etc-kubernetes\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.981750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981684    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-iptables-alerter-script\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.981750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981706    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-host-slash\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.981750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981730    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-cnibin\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.982151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981770    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5zfj\" (UniqueName: \"kubernetes.io/projected/a8dc5d9b-cafa-44e0-9031-cf12c0632135-kube-api-access-h5zfj\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.982151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981798    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8dc5d9b-cafa-44e0-9031-cf12c0632135-tmp-dir\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.982151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-k8s-cni-cncf-io\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.982151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981852    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-hostroot\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.982151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981914    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-host-slash\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.982151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.981978    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-cnibin\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982486    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-iptables-alerter-script\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982555    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8dc5d9b-cafa-44e0-9031-cf12c0632135-tmp-dir\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-conf-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982553    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-k8s-cni-cncf-io\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982602    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-daemon-config\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982638    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-multus-certs\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982666    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-cni-bin\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982690    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsc9t\" (UniqueName: \"kubernetes.io/projected/e1e160fe-0dbb-423a-ba4b-45836113262b-kube-api-access-bsc9t\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982719    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8dc5d9b-cafa-44e0-9031-cf12c0632135-hosts-file\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982748    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-netns\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982778    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7975b17c-b872-4395-a032-094e41b8ac03-dbus\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982803    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982815    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-multus-certs\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982840    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-cni-bin\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982833    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-cni-multus\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982867    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-etc-kubernetes\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982911    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-hostroot\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.983588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982913    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-system-cni-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982914    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7975b17c-b872-4395-a032-094e41b8ac03-kubelet-config\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982973    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-os-release\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983022    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-cni-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983045    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-socket-dir-parent\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983189    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-socket-dir-parent\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.983194    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983232    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-cni-multus\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:33.983353    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret podName:7975b17c-b872-4395-a032-094e41b8ac03 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:34.483332261 +0000 UTC m=+3.104914563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret") pod "global-pull-secret-syncer-447vd" (UID: "7975b17c-b872-4395-a032-094e41b8ac03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.982915    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a8dc5d9b-cafa-44e0-9031-cf12c0632135-hosts-file\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983398    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7975b17c-b872-4395-a032-094e41b8ac03-dbus\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983412    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-run-netns\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983448    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-conf-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983424    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-cni-dir\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983489    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e1e160fe-0dbb-423a-ba4b-45836113262b-multus-daemon-config\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983512    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-os-release\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983543    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e160fe-0dbb-423a-ba4b-45836113262b-host-var-lib-kubelet\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983561    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7975b17c-b872-4395-a032-094e41b8ac03-kubelet-config\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:33.984387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.983902    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1e160fe-0dbb-423a-ba4b-45836113262b-cni-binary-copy\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:33.988164 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.988076    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" event={"ID":"bbadb413c950138009b9d470a71bb26b","Type":"ContainerStarted","Data":"37b6d7f021328c5ce1409a12752645a1cb87a697e3e32e9bb27209449c96fa87"}
Jul 06 21:21:33.989856 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.989825    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" event={"ID":"9534bd1ba9e0a23b627fcaab9f623fa1","Type":"ContainerStarted","Data":"21041f51ed12b62743c82f1b2e0942f2f9e8e60a443b9d52f7d7a150ed8bac3f"}
Jul 06 21:21:33.997228 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.997180    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5zfj\" (UniqueName: \"kubernetes.io/projected/a8dc5d9b-cafa-44e0-9031-cf12c0632135-kube-api-access-h5zfj\") pod \"node-resolver-z966s\" (UID: \"a8dc5d9b-cafa-44e0-9031-cf12c0632135\") " pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:33.997726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.997704    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnvs6\" (UniqueName: \"kubernetes.io/projected/a3b6cf21-cb1e-4296-af4e-fd361dc01f63-kube-api-access-qnvs6\") pod \"iptables-alerter-j4d55\" (UID: \"a3b6cf21-cb1e-4296-af4e-fd361dc01f63\") " pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:33.997815 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:33.997704    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsc9t\" (UniqueName: \"kubernetes.io/projected/e1e160fe-0dbb-423a-ba4b-45836113262b-kube-api-access-bsc9t\") pod \"multus-vlbt8\" (UID: \"e1e160fe-0dbb-423a-ba4b-45836113262b\") " pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:34.067727 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.067695    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:34.076205 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.076175    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tzktv"
Jul 06 21:21:34.078643 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:34.078610    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9db558_dde6_4a7e_baf3_8ebd4ae0a5b3.slice/crio-a20e6425ec96a49a5c3c13020da7498190cc43ad25154a480c5fbf91468203f0 WatchSource:0}: Error finding container a20e6425ec96a49a5c3c13020da7498190cc43ad25154a480c5fbf91468203f0: Status 404 returned error can't find the container with id a20e6425ec96a49a5c3c13020da7498190cc43ad25154a480c5fbf91468203f0
Jul 06 21:21:34.085405 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.085228    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzk4f"
Jul 06 21:21:34.085634 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:34.085608    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd320d61c_9702_4005_845e_1f9143567533.slice/crio-ae1e338ef2fa3ac00be074658a662857488cf09e2aa2468bf2a512ba6b653dfb WatchSource:0}: Error finding container ae1e338ef2fa3ac00be074658a662857488cf09e2aa2468bf2a512ba6b653dfb: Status 404 returned error can't find the container with id ae1e338ef2fa3ac00be074658a662857488cf09e2aa2468bf2a512ba6b653dfb
Jul 06 21:21:34.093582 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.093557    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:21:34.096131 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:34.095895    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0b5fbc_e414_4f2f_bccd_42fba0c9f387.slice/crio-af034d2f84cbd955cc9807175f7b3122d37faa5e0da2975da57ef9fd3f92d818 WatchSource:0}: Error finding container af034d2f84cbd955cc9807175f7b3122d37faa5e0da2975da57ef9fd3f92d818: Status 404 returned error can't find the container with id af034d2f84cbd955cc9807175f7b3122d37faa5e0da2975da57ef9fd3f92d818
Jul 06 21:21:34.101586 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.101390    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s"
Jul 06 21:21:34.108151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.108129    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vk568"
Jul 06 21:21:34.115502 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.115445    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z966s"
Jul 06 21:21:34.124341 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.124318    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j4d55"
Jul 06 21:21:34.130352 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.130332    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vlbt8"
Jul 06 21:21:34.385755 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.385667    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:34.385933 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:34.385811    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:34.385933 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:34.385883    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs podName:4d35cde2-d4f1-4831-bc6e-0db34876af88 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:35.385863415 +0000 UTC m=+4.007445716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs") pod "network-metrics-daemon-slj8s" (UID: "4d35cde2-d4f1-4831-bc6e-0db34876af88") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:34.486336 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.486306    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:34.486481 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.486374    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:34.486540 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:34.486518    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:34.486580 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:34.486562    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:34.486621 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:34.486588    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:34.486621 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:34.486602    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqtrw for pod openshift-network-diagnostics/network-check-target-h2bwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:34.486682 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:34.486588    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret podName:7975b17c-b872-4395-a032-094e41b8ac03 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:35.486566572 +0000 UTC m=+4.108148873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret") pod "global-pull-secret-syncer-447vd" (UID: "7975b17c-b872-4395-a032-094e41b8ac03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:34.486682 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:34.486674    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw podName:e2f78910-86f6-4cb7-b93d-2e618fbe80fe nodeName:}" failed. No retries permitted until 2026-07-06 21:21:35.486657076 +0000 UTC m=+4.108239373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqtrw" (UniqueName: "kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw") pod "network-check-target-h2bwk" (UID: "e2f78910-86f6-4cb7-b93d-2e618fbe80fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:34.819492 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:34.819384    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b9a4d2_f659_4637_8310_b2d373ce0a74.slice/crio-a6b3e63419f8ab7edb7a3cbac1caae31dd75dd0db6688064d2463a0daabf969a WatchSource:0}: Error finding container a6b3e63419f8ab7edb7a3cbac1caae31dd75dd0db6688064d2463a0daabf969a: Status 404 returned error can't find the container with id a6b3e63419f8ab7edb7a3cbac1caae31dd75dd0db6688064d2463a0daabf969a
Jul 06 21:21:34.851394 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.851349    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 21:16:34 +0000 UTC" deadline="2027-12-15 19:03:02.944281594 +0000 UTC"
Jul 06 21:21:34.851394 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.851385    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12645h41m28.092901943s"
Jul 06 21:21:34.993244 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.993194    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"a6b3e63419f8ab7edb7a3cbac1caae31dd75dd0db6688064d2463a0daabf969a"}
Jul 06 21:21:34.994564 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.994529    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" event={"ID":"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387","Type":"ContainerStarted","Data":"af034d2f84cbd955cc9807175f7b3122d37faa5e0da2975da57ef9fd3f92d818"}
Jul 06 21:21:34.995823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.995775    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tzktv" event={"ID":"d320d61c-9702-4005-845e-1f9143567533","Type":"ContainerStarted","Data":"ae1e338ef2fa3ac00be074658a662857488cf09e2aa2468bf2a512ba6b653dfb"}
Jul 06 21:21:34.997030 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:34.997002    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vlpm7" event={"ID":"4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3","Type":"ContainerStarted","Data":"a20e6425ec96a49a5c3c13020da7498190cc43ad25154a480c5fbf91468203f0"}
Jul 06 21:21:35.233794 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:35.233758    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316703a3_4854_4359_bcda_1a6c82861629.slice/crio-ce911511d6ceaad8ad96808d98a3ece614a515aeb11238be6f322a42c73609e4 WatchSource:0}: Error finding container ce911511d6ceaad8ad96808d98a3ece614a515aeb11238be6f322a42c73609e4: Status 404 returned error can't find the container with id ce911511d6ceaad8ad96808d98a3ece614a515aeb11238be6f322a42c73609e4
Jul 06 21:21:35.236036 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:35.235937    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b6cf21_cb1e_4296_af4e_fd361dc01f63.slice/crio-b424ae2411186da111a1b9fea5eae0f5d585ad9059808f4e11e7a6c811a98c51 WatchSource:0}: Error finding container b424ae2411186da111a1b9fea5eae0f5d585ad9059808f4e11e7a6c811a98c51: Status 404 returned error can't find the container with id b424ae2411186da111a1b9fea5eae0f5d585ad9059808f4e11e7a6c811a98c51
Jul 06 21:21:35.237289 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:35.237261    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb990b9_bb11_47f1_96a4_f77243b073c5.slice/crio-771a3281bb3d557c6ab2decaaafe52cdbf22cd67db3c262b8f1477815d7b01d4 WatchSource:0}: Error finding container 771a3281bb3d557c6ab2decaaafe52cdbf22cd67db3c262b8f1477815d7b01d4: Status 404 returned error can't find the container with id 771a3281bb3d557c6ab2decaaafe52cdbf22cd67db3c262b8f1477815d7b01d4
Jul 06 21:21:35.238503 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:21:35.238481    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8dc5d9b_cafa_44e0_9031_cf12c0632135.slice/crio-becc254e0ba36a349c5ac667d6e424b15297a1e05c16952c1be23166664108e8 WatchSource:0}: Error finding container becc254e0ba36a349c5ac667d6e424b15297a1e05c16952c1be23166664108e8: Status 404 returned error can't find the container with id becc254e0ba36a349c5ac667d6e424b15297a1e05c16952c1be23166664108e8
Jul 06 21:21:35.394132 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:35.393854    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:35.394322 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.394048    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:35.394322 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.394294    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs podName:4d35cde2-d4f1-4831-bc6e-0db34876af88 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:37.394269656 +0000 UTC m=+6.015851968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs") pod "network-metrics-daemon-slj8s" (UID: "4d35cde2-d4f1-4831-bc6e-0db34876af88") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:35.496584 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:35.495609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:35.496584 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:35.495692    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:35.496584 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.495887    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:35.496584 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.495911    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:35.496584 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.495925    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqtrw for pod openshift-network-diagnostics/network-check-target-h2bwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:35.496584 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.495985    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw podName:e2f78910-86f6-4cb7-b93d-2e618fbe80fe nodeName:}" failed. No retries permitted until 2026-07-06 21:21:37.495964787 +0000 UTC m=+6.117547084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqtrw" (UniqueName: "kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw") pod "network-check-target-h2bwk" (UID: "e2f78910-86f6-4cb7-b93d-2e618fbe80fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:35.496584 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.496397    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:35.496584 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.496447    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret podName:7975b17c-b872-4395-a032-094e41b8ac03 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:37.496431166 +0000 UTC m=+6.118013470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret") pod "global-pull-secret-syncer-447vd" (UID: "7975b17c-b872-4395-a032-094e41b8ac03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:35.852031 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:35.851946    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 21:16:34 +0000 UTC" deadline="2027-12-31 16:32:09.248813263 +0000 UTC"
Jul 06 21:21:35.852031 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:35.852008    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13027h10m33.396810287s"
Jul 06 21:21:35.980387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:35.980347    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:35.980583 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.980511    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:35.980955 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:35.980933    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:35.981054 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.981034    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:35.981121 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:35.981103    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:35.981208 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:35.981189    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:36.008812 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.008720    2554 generic.go:356] "Generic (PLEG): container finished" podID="bbadb413c950138009b9d470a71bb26b" containerID="792c1a173aa605feefdd4738f516a7df732aa926f44a06a06aa8a87da1d4cd6d" exitCode=0
Jul 06 21:21:36.010194 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.010031    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" event={"ID":"bbadb413c950138009b9d470a71bb26b","Type":"ContainerDied","Data":"792c1a173aa605feefdd4738f516a7df732aa926f44a06a06aa8a87da1d4cd6d"}
Jul 06 21:21:36.024228 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.024194    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" event={"ID":"9534bd1ba9e0a23b627fcaab9f623fa1","Type":"ContainerStarted","Data":"1f5724b435419cd37dac109ac169515f30ec8eb6992cf65261631ef29a9cc786"}
Jul 06 21:21:36.047246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.047129    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vlbt8" event={"ID":"e1e160fe-0dbb-423a-ba4b-45836113262b","Type":"ContainerStarted","Data":"59bb2e28ddde0e63ca0162892d2d47ad1b42055a3644e3101fd3429176cba15a"}
Jul 06 21:21:36.056322 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.055608    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-11.ec2.internal" podStartSLOduration=3.055577626 podStartE2EDuration="3.055577626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:36.054954629 +0000 UTC m=+4.676536950" watchObservedRunningTime="2026-07-06 21:21:36.055577626 +0000 UTC m=+4.677159946"
Jul 06 21:21:36.061391 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.061277    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vk568" event={"ID":"7fb990b9-bb11-47f1-96a4-f77243b073c5","Type":"ContainerStarted","Data":"771a3281bb3d557c6ab2decaaafe52cdbf22cd67db3c262b8f1477815d7b01d4"}
Jul 06 21:21:36.071005 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.069521    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s" event={"ID":"316703a3-4854-4359-bcda-1a6c82861629","Type":"ContainerStarted","Data":"ce911511d6ceaad8ad96808d98a3ece614a515aeb11238be6f322a42c73609e4"}
Jul 06 21:21:36.071886 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.071823    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z966s" event={"ID":"a8dc5d9b-cafa-44e0-9031-cf12c0632135","Type":"ContainerStarted","Data":"becc254e0ba36a349c5ac667d6e424b15297a1e05c16952c1be23166664108e8"}
Jul 06 21:21:36.075084 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:36.075053    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j4d55" event={"ID":"a3b6cf21-cb1e-4296-af4e-fd361dc01f63","Type":"ContainerStarted","Data":"b424ae2411186da111a1b9fea5eae0f5d585ad9059808f4e11e7a6c811a98c51"}
Jul 06 21:21:37.417551 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:37.416857    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:37.417551 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.417062    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:37.417551 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.417130    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs podName:4d35cde2-d4f1-4831-bc6e-0db34876af88 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:41.417109818 +0000 UTC m=+10.038692162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs") pod "network-metrics-daemon-slj8s" (UID: "4d35cde2-d4f1-4831-bc6e-0db34876af88") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:37.517479 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:37.517415    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:37.517671 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:37.517518    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:37.517755 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.517725    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:37.517755 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.517749    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:37.517864 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.517764    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqtrw for pod openshift-network-diagnostics/network-check-target-h2bwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:37.517864 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.517830    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw podName:e2f78910-86f6-4cb7-b93d-2e618fbe80fe nodeName:}" failed. No retries permitted until 2026-07-06 21:21:41.517810485 +0000 UTC m=+10.139392782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqtrw" (UniqueName: "kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw") pod "network-check-target-h2bwk" (UID: "e2f78910-86f6-4cb7-b93d-2e618fbe80fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:37.518292 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.518270    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:37.518434 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.518329    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret podName:7975b17c-b872-4395-a032-094e41b8ac03 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:41.518313868 +0000 UTC m=+10.139896171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret") pod "global-pull-secret-syncer-447vd" (UID: "7975b17c-b872-4395-a032-094e41b8ac03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:37.986668 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:37.986631    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:37.986864 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.986771    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:37.987503 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:37.987179    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:37.987503 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.987306    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:37.987503 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:37.987376    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:37.987503 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:37.987465    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:39.980149 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:39.980061    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:39.980657 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:39.980213    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:39.980657 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:39.980248    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:39.980657 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:39.980366    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:39.980657 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:39.980248    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:39.980657 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:39.980481    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:41.455670 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:41.455626    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:41.456170 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.455792    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:41.456170 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.455869    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs podName:4d35cde2-d4f1-4831-bc6e-0db34876af88 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:49.455849268 +0000 UTC m=+18.077431566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs") pod "network-metrics-daemon-slj8s" (UID: "4d35cde2-d4f1-4831-bc6e-0db34876af88") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:41.556164 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:41.556113    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:41.556334 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:41.556215    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:41.556394 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.556357    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:41.556481 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.556419    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret podName:7975b17c-b872-4395-a032-094e41b8ac03 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:49.556399524 +0000 UTC m=+18.177981827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret") pod "global-pull-secret-syncer-447vd" (UID: "7975b17c-b872-4395-a032-094e41b8ac03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:41.556813 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.556680    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:41.556813 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.556712    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:41.556813 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.556726    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqtrw for pod openshift-network-diagnostics/network-check-target-h2bwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:41.556813 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.556788    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw podName:e2f78910-86f6-4cb7-b93d-2e618fbe80fe nodeName:}" failed. No retries permitted until 2026-07-06 21:21:49.556769758 +0000 UTC m=+18.178352071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqtrw" (UniqueName: "kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw") pod "network-check-target-h2bwk" (UID: "e2f78910-86f6-4cb7-b93d-2e618fbe80fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:41.982622 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:41.981978    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:41.982622 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.982103    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:41.982622 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:41.982553    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:41.982896 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.982649    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:41.982896 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:41.982723    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:41.982896 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:41.982850    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:43.981121 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:43.980508    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:43.981121 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:43.980624    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:43.981121 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:43.980992    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:43.981121 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:43.981076    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:43.981985 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:43.981620    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:43.981985 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:43.981726    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:45.980804 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:45.980738    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:45.980804 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:45.980758    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:45.981345 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:45.980871    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:45.981345 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:45.981083    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:45.981345 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:45.981205    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:45.981345 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:45.981289    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:47.980654 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:47.980616    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:47.980654 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:47.980655    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:47.981169 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:47.980616    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:47.981169 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:47.980771    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:47.981169 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:47.980875    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:47.981169 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:47.980934    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:49.521944 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:49.521908    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:49.522364 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.522018    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:49.522364 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.522070    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs podName:4d35cde2-d4f1-4831-bc6e-0db34876af88 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:05.522054226 +0000 UTC m=+34.143636522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs") pod "network-metrics-daemon-slj8s" (UID: "4d35cde2-d4f1-4831-bc6e-0db34876af88") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:49.622752 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:49.622726    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:49.622847 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:49.622783    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:49.622880 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.622872    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:49.622918 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.622896    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:49.622951 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.622918    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:49.622951 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.622921    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret podName:7975b17c-b872-4395-a032-094e41b8ac03 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:05.622908874 +0000 UTC m=+34.244491170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret") pod "global-pull-secret-syncer-447vd" (UID: "7975b17c-b872-4395-a032-094e41b8ac03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:49.622951 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.622928    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqtrw for pod openshift-network-diagnostics/network-check-target-h2bwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:49.623043 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.622968    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw podName:e2f78910-86f6-4cb7-b93d-2e618fbe80fe nodeName:}" failed. No retries permitted until 2026-07-06 21:22:05.622956776 +0000 UTC m=+34.244539070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqtrw" (UniqueName: "kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw") pod "network-check-target-h2bwk" (UID: "e2f78910-86f6-4cb7-b93d-2e618fbe80fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:49.980602 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:49.980568    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:49.980771 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:49.980578    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:49.980771 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.980706    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:49.980887 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.980863    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:49.980929 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:49.980580    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:49.980990 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:49.980970    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:51.981164 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:51.981127    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:51.981695 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:51.981214    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:51.981695 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:51.981231    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:51.981695 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:51.981356    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:51.981695 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:51.981383    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:51.981695 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:51.981503    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:53.980369 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:53.980324    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:53.980369 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:53.980357    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:53.980789 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:53.980332    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:53.980789 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:53.980475    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:53.980789 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:53.980534    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:53.980895 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:53.980815    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:55.121415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.120992    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e0b5fbc-e414-4f2f-bccd-42fba0c9f387" containerID="d010358f44cc0b32549f5cd6224c7724d14ca04502241c2f88d4a3ecb061ca99" exitCode=0
Jul 06 21:21:55.121415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.121082    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" event={"ID":"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387","Type":"ContainerDied","Data":"d010358f44cc0b32549f5cd6224c7724d14ca04502241c2f88d4a3ecb061ca99"}
Jul 06 21:21:55.122970 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.122863    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tzktv" event={"ID":"d320d61c-9702-4005-845e-1f9143567533","Type":"ContainerStarted","Data":"5302417bfa36bb1f7f17acd8a9f41d40b4ac5223cd089b45247c551d200e35f1"}
Jul 06 21:21:55.124368 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.124340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vlpm7" event={"ID":"4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3","Type":"ContainerStarted","Data":"8d5b5ae33ffc25e446c93976c72e327e4719fd7f21489779e689f5968467e97d"}
Jul 06 21:21:55.125768 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.125743    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vlbt8" event={"ID":"e1e160fe-0dbb-423a-ba4b-45836113262b","Type":"ContainerStarted","Data":"d29fbbcd59e6bb8bc6462a5a2976868ad107432dc72035b5cfe7c29c640a8dea"}
Jul 06 21:21:55.127186 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.127163    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vk568" event={"ID":"7fb990b9-bb11-47f1-96a4-f77243b073c5","Type":"ContainerStarted","Data":"8171ecade1f7fea6c2a270ea6d793da35ed007177871ae2ae6163a6825546fad"}
Jul 06 21:21:55.128592 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.128571    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s" event={"ID":"316703a3-4854-4359-bcda-1a6c82861629","Type":"ContainerStarted","Data":"9446d914d0cd60fc1cd522c80290fcc74f1b94e0128a2517e619d7424b201269"}
Jul 06 21:21:55.131445 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.131408    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"6685a73ff593a46d85e865abd5c04463233d5f52210549858df4f4c8c1769ed3"}
Jul 06 21:21:55.131522 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.131482    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"370e1bf4c920d7b471bcaff856c4bc7908ec808461092b7da741acce250a9e1f"}
Jul 06 21:21:55.131570 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.131522    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"e6b259dc67e05d5b4492796e9d0d91e1166648402989efb48ea552cf701d37fe"}
Jul 06 21:21:55.131570 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.131564    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"6bb3b07291b9a6525068706f6be2ddf71303aac65e132ed90f7cd8d2e8c39c95"}
Jul 06 21:21:55.131639 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.131595    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"64073850c522251528c251fd772d70afa8497f63d54398281cdcf159c219a345"}
Jul 06 21:21:55.131639 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.131626    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"842c329a5d49fb83dc101696fa4f055e33aaea775ac0837db0959be56eb7a0c7"}
Jul 06 21:21:55.132636 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.132603    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z966s" event={"ID":"a8dc5d9b-cafa-44e0-9031-cf12c0632135","Type":"ContainerStarted","Data":"8e45915deeceb33ec86d7940391d03efc517a3537655583a8fed1dbf3cd23579"}
Jul 06 21:21:55.134215 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.134198    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" event={"ID":"bbadb413c950138009b9d470a71bb26b","Type":"ContainerStarted","Data":"64152ccdd9abc00e52ae684d0ab7dbbe62707065b2ec6aa7cbc1c5886cf4c3f3"}
Jul 06 21:21:55.192040 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.191994    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-11.ec2.internal" podStartSLOduration=22.191977765 podStartE2EDuration="22.191977765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.191733233 +0000 UTC m=+23.813315551" watchObservedRunningTime="2026-07-06 21:21:55.191977765 +0000 UTC m=+23.813560082"
Jul 06 21:21:55.192192 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.192066    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vlbt8" podStartSLOduration=3.323436921 podStartE2EDuration="22.192060814s" totalImagesPullingTime="18.868623893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.173967155 +0000 UTC m=+23.795549473" watchObservedRunningTime="2026-07-06 21:21:55.192060814 +0000 UTC m=+23.813643131"
Jul 06 21:21:55.240492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.240418    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vk568" podStartSLOduration=3.438496082 podStartE2EDuration="22.240401871s" totalImagesPullingTime="18.801905789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.240269861 +0000 UTC m=+23.861852178" watchObservedRunningTime="2026-07-06 21:21:55.240401871 +0000 UTC m=+23.861984180"
Jul 06 21:21:55.240808 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.240782    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tzktv" podStartSLOduration=3.313487193 podStartE2EDuration="23.240775555s" totalImagesPullingTime="19.927288362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.21453315 +0000 UTC m=+23.836115467" watchObservedRunningTime="2026-07-06 21:21:55.240775555 +0000 UTC m=+23.862357872"
Jul 06 21:21:55.266419 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.266371    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z966s" podStartSLOduration=3.4661927869999998 podStartE2EDuration="22.266356353s" totalImagesPullingTime="18.800163566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.266038582 +0000 UTC m=+23.887620899" watchObservedRunningTime="2026-07-06 21:21:55.266356353 +0000 UTC m=+23.887938669"
Jul 06 21:21:55.302410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.302372    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:55.862052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.862024    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 21:21:55.984449 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.984409    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:55.984647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.984543    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:55.984647 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:55.984552    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:55.984647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:55.984575    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:55.984770 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:55.984657    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:55.984770 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:55.984730    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:56.137816 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.137707    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j4d55" event={"ID":"a3b6cf21-cb1e-4296-af4e-fd361dc01f63","Type":"ContainerStarted","Data":"296ce65e6e7396ac8ae951f387290990ae9e6fa00415dd1cca8d83f5af86af3b"}
Jul 06 21:21:56.139497 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.139473    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s" event={"ID":"316703a3-4854-4359-bcda-1a6c82861629","Type":"ContainerStarted","Data":"2232a213d0dad01777e5a82b43ae15615682e59690f68c8f34a0c0bd00aa496b"}
Jul 06 21:21:56.155314 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.155274    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j4d55" podStartSLOduration=4.350238406 podStartE2EDuration="23.15526081s" totalImagesPullingTime="18.805022404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:56.155183623 +0000 UTC m=+24.776765940" watchObservedRunningTime="2026-07-06 21:21:56.15526081 +0000 UTC m=+24.776843126"
Jul 06 21:21:56.155517 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.155496    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vlpm7" podStartSLOduration=4.221751727 podStartE2EDuration="24.155488298s" totalImagesPullingTime="19.933736571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.307345017 +0000 UTC m=+23.928927335" watchObservedRunningTime="2026-07-06 21:21:56.155488298 +0000 UTC m=+24.777070614"
Jul 06 21:21:56.659822 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.659785    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:56.660836 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.660818    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:56.844640 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.844507    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T21:21:55.862051553Z","UUID":"f2c5b1bd-de0d-41e6-8450-b283c644faab","Handler":null,"Name":"","Endpoint":""}
Jul 06 21:21:56.846123 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.846101    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 21:21:56.846258 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:56.846145    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 21:21:57.145319 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:57.145280    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"186cf05cfdedec5e529bc565644761c5477398ce687530ee020ab6bb662bee3f"}
Jul 06 21:21:57.146135 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:57.146112    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vlpm7"
Jul 06 21:21:57.981069 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:57.980868    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:57.981263 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:57.980868    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:57.981263 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:57.981163    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:21:57.981263 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:57.980920    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:57.981263 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:57.981219    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:57.981491 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:57.981315    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:58.151844 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:58.151812    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s" event={"ID":"316703a3-4854-4359-bcda-1a6c82861629","Type":"ContainerStarted","Data":"23e1d76a470517f52fd3c604cb3c2aebde2c653b4800fb4977bc4a3e53e93f81"}
Jul 06 21:21:59.981381 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:59.981077    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:21:59.982205 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:59.981078    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:21:59.982205 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:59.981471    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:21:59.982205 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:21:59.981142    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:21:59.982205 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:59.981546    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:21:59.982205 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:21:59.981614    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:22:00.160755 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:00.160719    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" event={"ID":"f4b9a4d2-f659-4637-8310-b2d373ce0a74","Type":"ContainerStarted","Data":"43c2a35aa1ba0d054359c0c1dd4c7abdf52373d3bb2fc233ec3626ee290e3df8"}
Jul 06 21:22:00.161081 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:00.161056    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:22:00.161179 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:00.161127    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:22:00.161179 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:00.161174    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:22:00.177397 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:00.177326    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:22:00.177786 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:00.177768    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:22:00.193506 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:00.193466    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-thgth" podStartSLOduration=7.844548419 podStartE2EDuration="27.193451618s" totalImagesPullingTime="19.348903199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:00.193278176 +0000 UTC m=+28.814860528" watchObservedRunningTime="2026-07-06 21:22:00.193451618 +0000 UTC m=+28.815033957"
Jul 06 21:22:00.193728 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:00.193707    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6bf6s" podStartSLOduration=5.619047266 podStartE2EDuration="27.193700893s" totalImagesPullingTime="21.574653627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:58.19915338 +0000 UTC m=+26.820735713" watchObservedRunningTime="2026-07-06 21:22:00.193700893 +0000 UTC m=+28.815283207"
Jul 06 21:22:01.522199 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:01.522162    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-447vd"]
Jul 06 21:22:01.522625 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:01.522338    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:22:01.522625 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:01.522448    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:22:01.526922 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:01.526892    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-slj8s"]
Jul 06 21:22:01.527103 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:01.527018    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:22:01.527164 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:01.527134    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:22:01.527645 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:01.527619    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2bwk"]
Jul 06 21:22:01.527755 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:01.527719    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:01.527820 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:01.527798    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:22:02.167412 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:02.167331    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e0b5fbc-e414-4f2f-bccd-42fba0c9f387" containerID="b007eb2e8bf7efafafbfa0b16eda94c3c59f7825f76eda96c86266e0425ce9f1" exitCode=0
Jul 06 21:22:02.167412 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:02.167390    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" event={"ID":"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387","Type":"ContainerDied","Data":"b007eb2e8bf7efafafbfa0b16eda94c3c59f7825f76eda96c86266e0425ce9f1"}
Jul 06 21:22:02.980946 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:02.980914    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:22:02.981381 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:02.980957    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:22:02.981381 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:02.980958    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:02.981381 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:02.981032    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:22:02.981381 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:02.981136    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:22:02.981381 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:02.981245    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:22:04.174775 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:04.174740    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e0b5fbc-e414-4f2f-bccd-42fba0c9f387" containerID="ed7659b7205665b5a0306053cd455d1bd500d4355b0402047431bccd9eca9cf3" exitCode=0
Jul 06 21:22:04.175118 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:04.174787    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" event={"ID":"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387","Type":"ContainerDied","Data":"ed7659b7205665b5a0306053cd455d1bd500d4355b0402047431bccd9eca9cf3"}
Jul 06 21:22:04.980995 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:04.980969    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:04.981113 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:04.980969    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:22:04.981113 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:04.981089    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h2bwk" podUID="e2f78910-86f6-4cb7-b93d-2e618fbe80fe"
Jul 06 21:22:04.981197 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:04.980969    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:22:04.981197 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:04.981152    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-slj8s" podUID="4d35cde2-d4f1-4831-bc6e-0db34876af88"
Jul 06 21:22:04.981253 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:04.981230    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-447vd" podUID="7975b17c-b872-4395-a032-094e41b8ac03"
Jul 06 21:22:05.542389 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:05.542312    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:22:05.542783 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:05.542425    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:22:05.542783 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:05.542498    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs podName:4d35cde2-d4f1-4831-bc6e-0db34876af88 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:37.542485855 +0000 UTC m=+66.164068150 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs") pod "network-metrics-daemon-slj8s" (UID: "4d35cde2-d4f1-4831-bc6e-0db34876af88") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:22:05.643645 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:05.643611    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:05.643795 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:05.643666    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:22:05.643795 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:05.643746    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:22:05.643795 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:05.643764    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:22:05.643795 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:05.643783    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:22:05.643795 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:05.643796    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqtrw for pod openshift-network-diagnostics/network-check-target-h2bwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:22:05.643972 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:05.643805    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret podName:7975b17c-b872-4395-a032-094e41b8ac03 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:37.64379259 +0000 UTC m=+66.265374885 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret") pod "global-pull-secret-syncer-447vd" (UID: "7975b17c-b872-4395-a032-094e41b8ac03") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:22:05.643972 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:05.643854    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw podName:e2f78910-86f6-4cb7-b93d-2e618fbe80fe nodeName:}" failed. No retries permitted until 2026-07-06 21:22:37.643823282 +0000 UTC m=+66.265405578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqtrw" (UniqueName: "kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw") pod "network-check-target-h2bwk" (UID: "e2f78910-86f6-4cb7-b93d-2e618fbe80fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:22:06.181303 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.181260    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e0b5fbc-e414-4f2f-bccd-42fba0c9f387" containerID="1f822dcabfd9a5a99962c3c43d1ba645a49b7f68812009c7d2ead210eb34493c" exitCode=0
Jul 06 21:22:06.181492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.181321    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" event={"ID":"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387","Type":"ContainerDied","Data":"1f822dcabfd9a5a99962c3c43d1ba645a49b7f68812009c7d2ead210eb34493c"}
Jul 06 21:22:06.662141 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.662113    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-11.ec2.internal" event="NodeReady"
Jul 06 21:22:06.662605 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.662249    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 21:22:06.713524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.713490    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c76c95d9c-x72n7"]
Jul 06 21:22:06.724556 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.724528    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"]
Jul 06 21:22:06.724896 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.724873    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.730993 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.730974    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 21:22:06.731111 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.731003    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 21:22:06.731111 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.731027    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 21:22:06.731355 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.731334    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 21:22:06.731444 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.731397    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l8xwz\""
Jul 06 21:22:06.731643 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.731624    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.734321 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.734305    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.734527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.734506    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t"]
Jul 06 21:22:06.734632 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.734617    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:06.739733 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.739709    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h8sk2\""
Jul 06 21:22:06.739733 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.739727    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.739888 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.739706    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 21:22:06.740137 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.739698    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.748455 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.748404    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"]
Jul 06 21:22:06.750138 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.749360    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t"
Jul 06 21:22:06.754774 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.754679    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-fng7d\""
Jul 06 21:22:06.754894 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.754779    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.754894 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.754779    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.760536 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.760515    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rlzt5"]
Jul 06 21:22:06.760640 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.760602    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:06.765779 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.765760    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.765881 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.765759    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 21:22:06.766900 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.766880    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xql67\""
Jul 06 21:22:06.766968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.766908    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.770933 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.770915    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 21:22:06.778773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.778602    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"]
Jul 06 21:22:06.778773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.778732    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:06.781498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.781475    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 21:22:06.781945 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.781926    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.782805 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.782710    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 21:22:06.783367 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.783347    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.785817 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.785796    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bmlr2\""
Jul 06 21:22:06.790033 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.790013    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 21:22:06.792256 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.792237    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-784fb85f99-j9gth"]
Jul 06 21:22:06.792356 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.792338    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:06.795013 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.794998    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 21:22:06.795138 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.795124    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-md69k\""
Jul 06 21:22:06.795678 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.795663    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.796039 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.796022    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.796236 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.796219    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 21:22:06.806807 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.806786    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2thlb"]
Jul 06 21:22:06.806898 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.806882    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.809691 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.809666    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kq6tm\""
Jul 06 21:22:06.810117 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.810102    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 21:22:06.810506 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.810488    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 21:22:06.813851 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.813829    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 21:22:06.816878 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.816859    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 21:22:06.822095 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.822078    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"]
Jul 06 21:22:06.822220 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.822204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:06.827734 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.827715    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 21:22:06.827980 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.827965    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 21:22:06.828054 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.828033    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-knz9j\""
Jul 06 21:22:06.828221 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.828206    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.829170 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.829019    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.834002 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.833981    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c76c95d9c-x72n7"]
Jul 06 21:22:06.834097 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.834015    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t"]
Jul 06 21:22:06.834097 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.834036    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"]
Jul 06 21:22:06.834097 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.834068    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rlzt5"]
Jul 06 21:22:06.834097 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.834085    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2thlb"]
Jul 06 21:22:06.834284 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.834106    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:06.834609 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.834107    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"]
Jul 06 21:22:06.834678 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.834643    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-784fb85f99-j9gth"]
Jul 06 21:22:06.834723 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.834695    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq"]
Jul 06 21:22:06.837905 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.837857    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 21:22:06.840507 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.838310    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.840507 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.838577    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.840507 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.839882    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zrhww\""
Jul 06 21:22:06.841825 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.841182    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 21:22:06.842005 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.841987    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 21:22:06.846477 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.846383    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qw8q4"]
Jul 06 21:22:06.846587 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.846552    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq"
Jul 06 21:22:06.850210 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.849984    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8mlvh\""
Jul 06 21:22:06.850210 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.850026    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.850210 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.850037    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.853611 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.853588    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-default-certificate\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.853707 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.853653    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-stats-auth\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.853707 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.853678    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.853707 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.853696    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpbqj\" (UniqueName: \"kubernetes.io/projected/e5f83e76-e6ae-49c2-b583-a73409caafc8-kube-api-access-fpbqj\") pod \"volume-data-source-validator-5d456fdbcd-qlw9t\" (UID: \"e5f83e76-e6ae-49c2-b583-a73409caafc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t"
Jul 06 21:22:06.853871 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.853767    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6swdf\" (UniqueName: \"kubernetes.io/projected/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-kube-api-access-6swdf\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:06.853871 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.853787    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.853871 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.853802    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:06.853871 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.853817    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjt6j\" (UniqueName: \"kubernetes.io/projected/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-kube-api-access-cjt6j\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.863959 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.863943    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6t952"]
Jul 06 21:22:06.864087 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.864069    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:06.866791 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.866766    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 21:22:06.866868 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.866820    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fg2d\""
Jul 06 21:22:06.867080 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.867066    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 21:22:06.876679 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.876660    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"]
Jul 06 21:22:06.876761 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.876696    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq"]
Jul 06 21:22:06.876814 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.876766    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t952"
Jul 06 21:22:06.876814 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.876789    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qw8q4"]
Jul 06 21:22:06.876912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.876816    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t952"]
Jul 06 21:22:06.876912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.876835    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"]
Jul 06 21:22:06.879199 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.879171    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 21:22:06.879417 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.879389    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v7k9x\""
Jul 06 21:22:06.879516 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.879464    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 21:22:06.879634 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.879617    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 21:22:06.954132 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954096    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0f35886-27bf-4fef-99f9-cae10a51a743-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:06.954303 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954140    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-trusted-ca\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.954303 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954174    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjt6j\" (UniqueName: \"kubernetes.io/projected/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-kube-api-access-cjt6j\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.954303 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954222    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42944ada-62d1-4750-b0e5-65642b3115e9-config\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:06.954303 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954267    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3142fb0d-2203-4835-b135-550232ba736b-tmp\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:06.954303 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954299    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.954520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-stats-auth\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.954520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954487    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.954624 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954521    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e316c648-a5ec-4935-8dae-4b5dc5d02975-config\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:06.954624 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954544    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e316c648-a5ec-4935-8dae-4b5dc5d02975-trusted-ca\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:06.954624 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954580    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:06.954624 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:06.954611    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 21:22:06.954809 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:06.954683    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:07.454663014 +0000 UTC m=+36.076245323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : secret "router-metrics-certs-default" not found
Jul 06 21:22:06.954809 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pc9s\" (UniqueName: \"kubernetes.io/projected/fc0071b9-679d-4b58-9e36-2d01620c2e37-kube-api-access-8pc9s\") pod \"network-check-source-989f8b8dc-n6skq\" (UID: \"fc0071b9-679d-4b58-9e36-2d01620c2e37\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq"
Jul 06 21:22:06.954809 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954744    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3142fb0d-2203-4835-b135-550232ba736b-serving-cert\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:06.954809 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954773    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzq6x\" (UniqueName: \"kubernetes.io/projected/42944ada-62d1-4750-b0e5-65642b3115e9-kube-api-access-jzq6x\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:06.954809 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954801    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2729e991-d331-4162-b6ce-5b8130722c90-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:06.955052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954825    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0f35886-27bf-4fef-99f9-cae10a51a743-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:06.955052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954869    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.955052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954932    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:06.955052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.954965    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4qxh\" (UniqueName: \"kubernetes.io/projected/e0f35886-27bf-4fef-99f9-cae10a51a743-kube-api-access-s4qxh\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:06.955052 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:06.954995    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:07.454977487 +0000 UTC m=+36.076559809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : configmap references non-existent config key: service-ca.crt
Jul 06 21:22:06.955052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955034    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd627\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-kube-api-access-sd627\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.955289 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:06.955060    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 21:22:06.955289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955061    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-registry-certificates\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.955289 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:06.955101    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls podName:ae2fb022-38c9-4af0-bdc3-177c32fc1da5 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:07.455089855 +0000 UTC m=+36.076672155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-qtnvm" (UID: "ae2fb022-38c9-4af0-bdc3-177c32fc1da5") : secret "samples-operator-tls" not found
Jul 06 21:22:06.955289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955140    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-default-certificate\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.955289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955164    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8877a576-935c-4e31-9f4a-da3429986f86-ca-trust-extracted\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.955289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955202    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpbqj\" (UniqueName: \"kubernetes.io/projected/e5f83e76-e6ae-49c2-b583-a73409caafc8-kube-api-access-fpbqj\") pod \"volume-data-source-validator-5d456fdbcd-qlw9t\" (UID: \"e5f83e76-e6ae-49c2-b583-a73409caafc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t"
Jul 06 21:22:06.955289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955233    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-image-registry-private-configuration\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.955289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955269    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7jz\" (UniqueName: \"kubernetes.io/projected/2729e991-d331-4162-b6ce-5b8130722c90-kube-api-access-bk7jz\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955292    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4p9q\" (UniqueName: \"kubernetes.io/projected/3142fb0d-2203-4835-b135-550232ba736b-kube-api-access-c4p9q\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955320    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-bound-sa-token\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955353    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3142fb0d-2203-4835-b135-550232ba736b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955393    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42944ada-62d1-4750-b0e5-65642b3115e9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955448    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-installation-pull-secrets\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955473    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3142fb0d-2203-4835-b135-550232ba736b-snapshots\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955500    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3142fb0d-2203-4835-b135-550232ba736b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955523    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbqz4\" (UniqueName: \"kubernetes.io/projected/e316c648-a5ec-4935-8dae-4b5dc5d02975-kube-api-access-qbqz4\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6swdf\" (UniqueName: \"kubernetes.io/projected/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-kube-api-access-6swdf\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:06.955676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.955627    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e316c648-a5ec-4935-8dae-4b5dc5d02975-serving-cert\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:06.959283 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.959264    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-default-certificate\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.959385 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.959295    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-stats-auth\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.963902 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.963877    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjt6j\" (UniqueName: \"kubernetes.io/projected/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-kube-api-access-cjt6j\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:06.965697 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.965675    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpbqj\" (UniqueName: \"kubernetes.io/projected/e5f83e76-e6ae-49c2-b583-a73409caafc8-kube-api-access-fpbqj\") pod \"volume-data-source-validator-5d456fdbcd-qlw9t\" (UID: \"e5f83e76-e6ae-49c2-b583-a73409caafc8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t"
Jul 06 21:22:06.968819 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.968794    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6swdf\" (UniqueName: \"kubernetes.io/projected/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-kube-api-access-6swdf\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:06.989845 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.989813    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:22:06.994647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.994571    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:22:06.995275 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.994981    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:06.997623 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.997598    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 21:22:06.997900 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.997875    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 21:22:06.997978 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.997910    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lhqbc\""
Jul 06 21:22:06.997978 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:06.997909    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m4jxb\""
Jul 06 21:22:07.056917 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.056888    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzq6x\" (UniqueName: \"kubernetes.io/projected/42944ada-62d1-4750-b0e5-65642b3115e9-kube-api-access-jzq6x\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:07.056917 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.056921    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2729e991-d331-4162-b6ce-5b8130722c90-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:07.057181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.056938    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0f35886-27bf-4fef-99f9-cae10a51a743-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:07.057181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.056977    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qxh\" (UniqueName: \"kubernetes.io/projected/e0f35886-27bf-4fef-99f9-cae10a51a743-kube-api-access-s4qxh\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:07.057181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057007    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afdce3a-fde5-4d11-895a-9abea3702aa7-cert\") pod \"ingress-canary-6t952\" (UID: \"8afdce3a-fde5-4d11-895a-9abea3702aa7\") " pod="openshift-ingress-canary/ingress-canary-6t952"
Jul 06 21:22:07.057181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057027    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd627\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-kube-api-access-sd627\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.057181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057050    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-registry-certificates\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.057181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057078    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8877a576-935c-4e31-9f4a-da3429986f86-ca-trust-extracted\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.057181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057114    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mkl7\" (UniqueName: \"kubernetes.io/projected/8afdce3a-fde5-4d11-895a-9abea3702aa7-kube-api-access-6mkl7\") pod \"ingress-canary-6t952\" (UID: \"8afdce3a-fde5-4d11-895a-9abea3702aa7\") " pod="openshift-ingress-canary/ingress-canary-6t952"
Jul 06 21:22:07.057181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057160    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-image-registry-private-configuration\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057189    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7jz\" (UniqueName: \"kubernetes.io/projected/2729e991-d331-4162-b6ce-5b8130722c90-kube-api-access-bk7jz\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057217    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4p9q\" (UniqueName: \"kubernetes.io/projected/3142fb0d-2203-4835-b135-550232ba736b-kube-api-access-c4p9q\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057248    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-bound-sa-token\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057276    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3142fb0d-2203-4835-b135-550232ba736b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057306    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42944ada-62d1-4750-b0e5-65642b3115e9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057331    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-installation-pull-secrets\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3142fb0d-2203-4835-b135-550232ba736b-snapshots\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057388    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-tmp-dir\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057415    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3142fb0d-2203-4835-b135-550232ba736b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.057614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057462    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8877a576-935c-4e31-9f4a-da3429986f86-ca-trust-extracted\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.058000 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057647    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e0f35886-27bf-4fef-99f9-cae10a51a743-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:07.058000 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057760    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2729e991-d331-4162-b6ce-5b8130722c90-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.057465    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqz4\" (UniqueName: \"kubernetes.io/projected/e316c648-a5ec-4935-8dae-4b5dc5d02975-kube-api-access-qbqz4\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058245    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3142fb0d-2203-4835-b135-550232ba736b-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058387    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-registry-certificates\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058390    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e316c648-a5ec-4935-8dae-4b5dc5d02975-serving-cert\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058461    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0f35886-27bf-4fef-99f9-cae10a51a743-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058489    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058518    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-trusted-ca\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058552    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q47t\" (UniqueName: \"kubernetes.io/projected/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-kube-api-access-5q47t\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058592    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42944ada-62d1-4750-b0e5-65642b3115e9-config\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058633    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3142fb0d-2203-4835-b135-550232ba736b-tmp\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058665    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e316c648-a5ec-4935-8dae-4b5dc5d02975-config\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058751    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e316c648-a5ec-4935-8dae-4b5dc5d02975-trusted-ca\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058775    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-config-volume\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058788    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3142fb0d-2203-4835-b135-550232ba736b-snapshots\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.058872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058806    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.058889    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.058950    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls podName:2729e991-d331-4162-b6ce-5b8130722c90 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:07.558934269 +0000 UTC m=+36.180516576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mfdvq" (UID: "2729e991-d331-4162-b6ce-5b8130722c90") : secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.059157    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3142fb0d-2203-4835-b135-550232ba736b-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.059416    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-trusted-ca\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.059529    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.059546    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784fb85f99-j9gth: secret "image-registry-tls" not found
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.059572    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42944ada-62d1-4750-b0e5-65642b3115e9-config\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.059606    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls podName:8877a576-935c-4e31-9f4a-da3429986f86 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:07.55958329 +0000 UTC m=+36.181165592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls") pod "image-registry-784fb85f99-j9gth" (UID: "8877a576-935c-4e31-9f4a-da3429986f86") : secret "image-registry-tls" not found
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.058886    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pc9s\" (UniqueName: \"kubernetes.io/projected/fc0071b9-679d-4b58-9e36-2d01620c2e37-kube-api-access-8pc9s\") pod \"network-check-source-989f8b8dc-n6skq\" (UID: \"fc0071b9-679d-4b58-9e36-2d01620c2e37\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq"
Jul 06 21:22:07.059791 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.059682    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3142fb0d-2203-4835-b135-550232ba736b-serving-cert\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.060296 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.059847    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3142fb0d-2203-4835-b135-550232ba736b-tmp\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.060296 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.060004    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e316c648-a5ec-4935-8dae-4b5dc5d02975-trusted-ca\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.060723 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.060696    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-installation-pull-secrets\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.060923 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.060902    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e316c648-a5ec-4935-8dae-4b5dc5d02975-config\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.062200 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.061874    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-image-registry-private-configuration\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.062305 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.062280    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3142fb0d-2203-4835-b135-550232ba736b-serving-cert\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.062572 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.062545    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42944ada-62d1-4750-b0e5-65642b3115e9-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:07.062660 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.062581    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0f35886-27bf-4fef-99f9-cae10a51a743-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:07.062892 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.062869    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e316c648-a5ec-4935-8dae-4b5dc5d02975-serving-cert\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.063727 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.063696    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t"
Jul 06 21:22:07.066332 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.066309    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzq6x\" (UniqueName: \"kubernetes.io/projected/42944ada-62d1-4750-b0e5-65642b3115e9-kube-api-access-jzq6x\") pod \"service-ca-operator-5d46d9ffd4-78c98\" (UID: \"42944ada-62d1-4750-b0e5-65642b3115e9\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:07.071576 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.071542    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4qxh\" (UniqueName: \"kubernetes.io/projected/e0f35886-27bf-4fef-99f9-cae10a51a743-kube-api-access-s4qxh\") pod \"kube-storage-version-migrator-operator-846bf668f7-lcr7j\" (UID: \"e0f35886-27bf-4fef-99f9-cae10a51a743\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:07.072273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.071841    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7jz\" (UniqueName: \"kubernetes.io/projected/2729e991-d331-4162-b6ce-5b8130722c90-kube-api-access-bk7jz\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:07.072273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.071988    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"
Jul 06 21:22:07.075764 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.072986    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4p9q\" (UniqueName: \"kubernetes.io/projected/3142fb0d-2203-4835-b135-550232ba736b-kube-api-access-c4p9q\") pod \"insights-operator-5c847dcfc4-rlzt5\" (UID: \"3142fb0d-2203-4835-b135-550232ba736b\") " pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.075764 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.073568    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd627\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-kube-api-access-sd627\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.075764 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.074491    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-bound-sa-token\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.075764 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.075071    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pc9s\" (UniqueName: \"kubernetes.io/projected/fc0071b9-679d-4b58-9e36-2d01620c2e37-kube-api-access-8pc9s\") pod \"network-check-source-989f8b8dc-n6skq\" (UID: \"fc0071b9-679d-4b58-9e36-2d01620c2e37\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq"
Jul 06 21:22:07.077110 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.076909    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbqz4\" (UniqueName: \"kubernetes.io/projected/e316c648-a5ec-4935-8dae-4b5dc5d02975-kube-api-access-qbqz4\") pod \"console-operator-68b757fb67-2thlb\" (UID: \"e316c648-a5ec-4935-8dae-4b5dc5d02975\") " pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.089493 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.089446    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5"
Jul 06 21:22:07.101615 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.101590    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"
Jul 06 21:22:07.132568 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.132499    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:07.158245 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.158216    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq"
Jul 06 21:22:07.161461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.161226    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.161461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.161272    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q47t\" (UniqueName: \"kubernetes.io/projected/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-kube-api-access-5q47t\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.161461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.161361    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-config-volume\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.162827 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.161772    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:07.162827 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.161836    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls podName:1080bc03-6fa6-4840-ba3f-4be61a48ea4a nodeName:}" failed. No retries permitted until 2026-07-06 21:22:07.66181368 +0000 UTC m=+36.283395978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls") pod "dns-default-qw8q4" (UID: "1080bc03-6fa6-4840-ba3f-4be61a48ea4a") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:07.163405 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.163051    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afdce3a-fde5-4d11-895a-9abea3702aa7-cert\") pod \"ingress-canary-6t952\" (UID: \"8afdce3a-fde5-4d11-895a-9abea3702aa7\") " pod="openshift-ingress-canary/ingress-canary-6t952"
Jul 06 21:22:07.163405 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.163100    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkl7\" (UniqueName: \"kubernetes.io/projected/8afdce3a-fde5-4d11-895a-9abea3702aa7-kube-api-access-6mkl7\") pod \"ingress-canary-6t952\" (UID: \"8afdce3a-fde5-4d11-895a-9abea3702aa7\") " pod="openshift-ingress-canary/ingress-canary-6t952"
Jul 06 21:22:07.163405 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.163157    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-tmp-dir\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.163575 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.163496    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-tmp-dir\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.164337 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.163786    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-config-volume\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.170978 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.166201    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8afdce3a-fde5-4d11-895a-9abea3702aa7-cert\") pod \"ingress-canary-6t952\" (UID: \"8afdce3a-fde5-4d11-895a-9abea3702aa7\") " pod="openshift-ingress-canary/ingress-canary-6t952"
Jul 06 21:22:07.179382 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.179149    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mkl7\" (UniqueName: \"kubernetes.io/projected/8afdce3a-fde5-4d11-895a-9abea3702aa7-kube-api-access-6mkl7\") pod \"ingress-canary-6t952\" (UID: \"8afdce3a-fde5-4d11-895a-9abea3702aa7\") " pod="openshift-ingress-canary/ingress-canary-6t952"
Jul 06 21:22:07.179382 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.179287    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q47t\" (UniqueName: \"kubernetes.io/projected/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-kube-api-access-5q47t\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.194836 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.186356    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6t952"
Jul 06 21:22:07.298684 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.296334    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t"]
Jul 06 21:22:07.306497 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:07.306443    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f83e76_e6ae_49c2_b583_a73409caafc8.slice/crio-5d630580f7083543f39937249907d56ba43d7dcb7d16b8b182539da1eca933ad WatchSource:0}: Error finding container 5d630580f7083543f39937249907d56ba43d7dcb7d16b8b182539da1eca933ad: Status 404 returned error can't find the container with id 5d630580f7083543f39937249907d56ba43d7dcb7d16b8b182539da1eca933ad
Jul 06 21:22:07.329560 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.327621    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j"]
Jul 06 21:22:07.362299 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.360741    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rlzt5"]
Jul 06 21:22:07.366255 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:07.366226    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3142fb0d_2203_4835_b135_550232ba736b.slice/crio-cf89e46f13e414d0851da46b58f8f76bc506607bb96b43ed4ee3e311da9ebc65 WatchSource:0}: Error finding container cf89e46f13e414d0851da46b58f8f76bc506607bb96b43ed4ee3e311da9ebc65: Status 404 returned error can't find the container with id cf89e46f13e414d0851da46b58f8f76bc506607bb96b43ed4ee3e311da9ebc65
Jul 06 21:22:07.380027 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.379933    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98"]
Jul 06 21:22:07.382779 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:07.382740    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42944ada_62d1_4750_b0e5_65642b3115e9.slice/crio-37e80599c108e06155faa249be942ea6d65746201d92e1d2389669a9be5ba542 WatchSource:0}: Error finding container 37e80599c108e06155faa249be942ea6d65746201d92e1d2389669a9be5ba542: Status 404 returned error can't find the container with id 37e80599c108e06155faa249be942ea6d65746201d92e1d2389669a9be5ba542
Jul 06 21:22:07.401865 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.401833    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-2thlb"]
Jul 06 21:22:07.406559 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:07.406527    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode316c648_a5ec_4935_8dae_4b5dc5d02975.slice/crio-be8bd08e12ae2d077c516a94661b2b000331f68ba6ee583757b6f58cb5b5fae8 WatchSource:0}: Error finding container be8bd08e12ae2d077c516a94661b2b000331f68ba6ee583757b6f58cb5b5fae8: Status 404 returned error can't find the container with id be8bd08e12ae2d077c516a94661b2b000331f68ba6ee583757b6f58cb5b5fae8
Jul 06 21:22:07.415230 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.415197    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6t952"]
Jul 06 21:22:07.418095 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:07.418070    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afdce3a_fde5_4d11_895a_9abea3702aa7.slice/crio-6634fec7baa73fe291cddb4f39eda35352545f825161bc06c817637833d68763 WatchSource:0}: Error finding container 6634fec7baa73fe291cddb4f39eda35352545f825161bc06c817637833d68763: Status 404 returned error can't find the container with id 6634fec7baa73fe291cddb4f39eda35352545f825161bc06c817637833d68763
Jul 06 21:22:07.427004 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.426981    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq"]
Jul 06 21:22:07.430876 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:07.430851    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0071b9_679d_4b58_9e36_2d01620c2e37.slice/crio-51e98569114dc223cc213a5a1870cafc47a24991c36867d2048150dc8dfe58af WatchSource:0}: Error finding container 51e98569114dc223cc213a5a1870cafc47a24991c36867d2048150dc8dfe58af: Status 404 returned error can't find the container with id 51e98569114dc223cc213a5a1870cafc47a24991c36867d2048150dc8dfe58af
Jul 06 21:22:07.465913 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.465880    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:07.466041 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.465918    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:07.466041 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.466013    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:07.466156 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.466101    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:08.466050063 +0000 UTC m=+37.087632365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : configmap references non-existent config key: service-ca.crt
Jul 06 21:22:07.466156 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.466118    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 21:22:07.466260 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.466118    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 21:22:07.466260 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.466168    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls podName:ae2fb022-38c9-4af0-bdc3-177c32fc1da5 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:08.466154878 +0000 UTC m=+37.087737179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-qtnvm" (UID: "ae2fb022-38c9-4af0-bdc3-177c32fc1da5") : secret "samples-operator-tls" not found
Jul 06 21:22:07.466260 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.466201    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:08.466187671 +0000 UTC m=+37.087769984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : secret "router-metrics-certs-default" not found
Jul 06 21:22:07.566982 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.566940    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:07.567155 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.567021    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:07.567309 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.567282    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:07.567381 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.567312    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784fb85f99-j9gth: secret "image-registry-tls" not found
Jul 06 21:22:07.567381 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.567365    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:07.567503 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.567390    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls podName:8877a576-935c-4e31-9f4a-da3429986f86 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:08.567370022 +0000 UTC m=+37.188952338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls") pod "image-registry-784fb85f99-j9gth" (UID: "8877a576-935c-4e31-9f4a-da3429986f86") : secret "image-registry-tls" not found
Jul 06 21:22:07.567503 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.567419    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls podName:2729e991-d331-4162-b6ce-5b8130722c90 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:08.567406688 +0000 UTC m=+37.188988984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mfdvq" (UID: "2729e991-d331-4162-b6ce-5b8130722c90") : secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:07.667706 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:07.667615    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:07.668352 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.667789    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:07.668352 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:07.667855    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls podName:1080bc03-6fa6-4840-ba3f-4be61a48ea4a nodeName:}" failed. No retries permitted until 2026-07-06 21:22:08.667836539 +0000 UTC m=+37.289418835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls") pod "dns-default-qw8q4" (UID: "1080bc03-6fa6-4840-ba3f-4be61a48ea4a") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:08.196031 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.195993    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98" event={"ID":"42944ada-62d1-4750-b0e5-65642b3115e9","Type":"ContainerStarted","Data":"37e80599c108e06155faa249be942ea6d65746201d92e1d2389669a9be5ba542"}
Jul 06 21:22:08.201311 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.201251    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j" event={"ID":"e0f35886-27bf-4fef-99f9-cae10a51a743","Type":"ContainerStarted","Data":"75bba11c5fc377d0b8e0b097a96b45b98993806403cdab25734bc664077e4153"}
Jul 06 21:22:08.204926 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.204843    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t" event={"ID":"e5f83e76-e6ae-49c2-b583-a73409caafc8","Type":"ContainerStarted","Data":"5d630580f7083543f39937249907d56ba43d7dcb7d16b8b182539da1eca933ad"}
Jul 06 21:22:08.206647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.206591    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq" event={"ID":"fc0071b9-679d-4b58-9e36-2d01620c2e37","Type":"ContainerStarted","Data":"51e98569114dc223cc213a5a1870cafc47a24991c36867d2048150dc8dfe58af"}
Jul 06 21:22:08.211410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.211382    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2thlb" event={"ID":"e316c648-a5ec-4935-8dae-4b5dc5d02975","Type":"ContainerStarted","Data":"be8bd08e12ae2d077c516a94661b2b000331f68ba6ee583757b6f58cb5b5fae8"}
Jul 06 21:22:08.215107 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.215076    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5" event={"ID":"3142fb0d-2203-4835-b135-550232ba736b","Type":"ContainerStarted","Data":"cf89e46f13e414d0851da46b58f8f76bc506607bb96b43ed4ee3e311da9ebc65"}
Jul 06 21:22:08.218082 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.218055    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t952" event={"ID":"8afdce3a-fde5-4d11-895a-9abea3702aa7","Type":"ContainerStarted","Data":"6634fec7baa73fe291cddb4f39eda35352545f825161bc06c817637833d68763"}
Jul 06 21:22:08.476360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.475253    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:08.476360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.475340    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:08.476360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.475371    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:08.476360 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.475521    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 21:22:08.476360 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.475582    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls podName:ae2fb022-38c9-4af0-bdc3-177c32fc1da5 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:10.475564806 +0000 UTC m=+39.097147107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-qtnvm" (UID: "ae2fb022-38c9-4af0-bdc3-177c32fc1da5") : secret "samples-operator-tls" not found
Jul 06 21:22:08.476360 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.476158    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 21:22:08.476360 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.476213    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:10.476196687 +0000 UTC m=+39.097779025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : secret "router-metrics-certs-default" not found
Jul 06 21:22:08.476360 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.476286    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:10.476274179 +0000 UTC m=+39.097856479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : configmap references non-existent config key: service-ca.crt
Jul 06 21:22:08.577704 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.576805    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:08.577704 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.576885    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:08.577704 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.577122    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:08.577704 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.577198    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls podName:2729e991-d331-4162-b6ce-5b8130722c90 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:10.577179375 +0000 UTC m=+39.198761697 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mfdvq" (UID: "2729e991-d331-4162-b6ce-5b8130722c90") : secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:08.577704 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.577605    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:08.577704 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.577622    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784fb85f99-j9gth: secret "image-registry-tls" not found
Jul 06 21:22:08.577704 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.577668    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls podName:8877a576-935c-4e31-9f4a-da3429986f86 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:10.577652352 +0000 UTC m=+39.199234651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls") pod "image-registry-784fb85f99-j9gth" (UID: "8877a576-935c-4e31-9f4a-da3429986f86") : secret "image-registry-tls" not found
Jul 06 21:22:08.678409 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:08.677505    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:08.678409 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.677786    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:08.678409 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:08.677844    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls podName:1080bc03-6fa6-4840-ba3f-4be61a48ea4a nodeName:}" failed. No retries permitted until 2026-07-06 21:22:10.677828456 +0000 UTC m=+39.299410751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls") pod "dns-default-qw8q4" (UID: "1080bc03-6fa6-4840-ba3f-4be61a48ea4a") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:10.229390 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:10.229274    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t" event={"ID":"e5f83e76-e6ae-49c2-b583-a73409caafc8","Type":"ContainerStarted","Data":"ab455dcd28d542f89373567de8a4090702c7917395798adfc01929d02e69dbb2"}
Jul 06 21:22:10.253145 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:10.253070    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-qlw9t" podStartSLOduration=10.790502211 podStartE2EDuration="13.253050171s" totalImagesPullingTime="2.46254796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:10.25208988 +0000 UTC m=+38.873672222" watchObservedRunningTime="2026-07-06 21:22:10.253050171 +0000 UTC m=+38.874632493"
Jul 06 21:22:10.498292 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:10.497595    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:10.498292 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:10.497956    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:10.498292 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:10.498011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:10.498292 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.498093    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 21:22:10.498292 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.498157    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:14.498138192 +0000 UTC m=+43.119720500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : secret "router-metrics-certs-default" not found
Jul 06 21:22:10.498292 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.498177    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 21:22:10.498292 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.498226    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls podName:ae2fb022-38c9-4af0-bdc3-177c32fc1da5 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:14.498213323 +0000 UTC m=+43.119795618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-qtnvm" (UID: "ae2fb022-38c9-4af0-bdc3-177c32fc1da5") : secret "samples-operator-tls" not found
Jul 06 21:22:10.498292 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.498285    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:14.498264606 +0000 UTC m=+43.119846918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : configmap references non-existent config key: service-ca.crt
Jul 06 21:22:10.598920 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:10.598880    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:10.599096 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:10.598947    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:10.599096 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.599060    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:10.599096 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.599068    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:10.599096 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.599091    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784fb85f99-j9gth: secret "image-registry-tls" not found
Jul 06 21:22:10.599265 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.599127    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls podName:2729e991-d331-4162-b6ce-5b8130722c90 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:14.599108412 +0000 UTC m=+43.220690711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mfdvq" (UID: "2729e991-d331-4162-b6ce-5b8130722c90") : secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:10.599265 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.599147    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls podName:8877a576-935c-4e31-9f4a-da3429986f86 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:14.599136905 +0000 UTC m=+43.220719204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls") pod "image-registry-784fb85f99-j9gth" (UID: "8877a576-935c-4e31-9f4a-da3429986f86") : secret "image-registry-tls" not found
Jul 06 21:22:10.700078 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:10.700044    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:10.700248 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.700199    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:10.700297 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:10.700260    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls podName:1080bc03-6fa6-4840-ba3f-4be61a48ea4a nodeName:}" failed. No retries permitted until 2026-07-06 21:22:14.700244936 +0000 UTC m=+43.321827231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls") pod "dns-default-qw8q4" (UID: "1080bc03-6fa6-4840-ba3f-4be61a48ea4a") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:14.529771 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:14.529724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:14.530277 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:14.529858    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:14.530277 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:14.529891    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:14.530277 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.529909    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 21:22:14.530277 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.529989    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.529968553 +0000 UTC m=+51.151550850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : secret "router-metrics-certs-default" not found
Jul 06 21:22:14.530277 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.530035    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 21:22:14.530277 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.530087    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.53006521 +0000 UTC m=+51.151647509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : configmap references non-existent config key: service-ca.crt
Jul 06 21:22:14.530277 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.530113    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls podName:ae2fb022-38c9-4af0-bdc3-177c32fc1da5 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.530102005 +0000 UTC m=+51.151684300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-qtnvm" (UID: "ae2fb022-38c9-4af0-bdc3-177c32fc1da5") : secret "samples-operator-tls" not found
Jul 06 21:22:14.631109 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:14.631071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:14.631296 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:14.631147    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:14.631296 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.631245    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:14.631296 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.631269    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784fb85f99-j9gth: secret "image-registry-tls" not found
Jul 06 21:22:14.631296 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.631289    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:14.631508 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.631349    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls podName:8877a576-935c-4e31-9f4a-da3429986f86 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.63132861 +0000 UTC m=+51.252910906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls") pod "image-registry-784fb85f99-j9gth" (UID: "8877a576-935c-4e31-9f4a-da3429986f86") : secret "image-registry-tls" not found
Jul 06 21:22:14.631508 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.631368    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls podName:2729e991-d331-4162-b6ce-5b8130722c90 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.631359446 +0000 UTC m=+51.252941749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mfdvq" (UID: "2729e991-d331-4162-b6ce-5b8130722c90") : secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:14.732350 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:14.732301    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:14.732531 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.732472    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:14.732578 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:14.732535    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls podName:1080bc03-6fa6-4840-ba3f-4be61a48ea4a nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.732517074 +0000 UTC m=+51.354099385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls") pod "dns-default-qw8q4" (UID: "1080bc03-6fa6-4840-ba3f-4be61a48ea4a") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:18.252592 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.252547    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq" event={"ID":"fc0071b9-679d-4b58-9e36-2d01620c2e37","Type":"ContainerStarted","Data":"ffb942704bbd23b3b2748082311cca7a4473e8d047205e0f470c0bd2e79e0664"}
Jul 06 21:22:18.254539 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.254509    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/0.log"
Jul 06 21:22:18.254664 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.254553    2554 generic.go:356] "Generic (PLEG): container finished" podID="e316c648-a5ec-4935-8dae-4b5dc5d02975" containerID="1cd0405ee85e6aa5adc8b2608ff669f80e74a19dfa4ac619255ce5acc1ce16d4" exitCode=255
Jul 06 21:22:18.254664 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.254647    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2thlb" event={"ID":"e316c648-a5ec-4935-8dae-4b5dc5d02975","Type":"ContainerDied","Data":"1cd0405ee85e6aa5adc8b2608ff669f80e74a19dfa4ac619255ce5acc1ce16d4"}
Jul 06 21:22:18.254837 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.254819    2554 scope.go:117] "RemoveContainer" containerID="1cd0405ee85e6aa5adc8b2608ff669f80e74a19dfa4ac619255ce5acc1ce16d4"
Jul 06 21:22:18.256521 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.256496    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5" event={"ID":"3142fb0d-2203-4835-b135-550232ba736b","Type":"ContainerStarted","Data":"7186db82b8e2c1366567cca96e4b796f5094e1bd38f9f3e16a54182ce5a827ff"}
Jul 06 21:22:18.258254 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.258229    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6t952" event={"ID":"8afdce3a-fde5-4d11-895a-9abea3702aa7","Type":"ContainerStarted","Data":"59829dcf0174e97865a1923f7f5bdeacb5fe7a23cbf73c8faa5949ebbe30b459"}
Jul 06 21:22:18.261587 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.261564    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e0b5fbc-e414-4f2f-bccd-42fba0c9f387" containerID="a59337a80865c485fa8d78822b1ce89448a41e343ebffbea3b85383f15198fac" exitCode=0
Jul 06 21:22:18.261706 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.261651    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" event={"ID":"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387","Type":"ContainerDied","Data":"a59337a80865c485fa8d78822b1ce89448a41e343ebffbea3b85383f15198fac"}
Jul 06 21:22:18.263744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.263720    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98" event={"ID":"42944ada-62d1-4750-b0e5-65642b3115e9","Type":"ContainerStarted","Data":"6b14c3720dedc52e9f3ffa014fe995c0348389d76af69642601cece452d10a2d"}
Jul 06 21:22:18.265485 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.265416    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j" event={"ID":"e0f35886-27bf-4fef-99f9-cae10a51a743","Type":"ContainerStarted","Data":"de14ef31b7e4564fdf0e93387d710b1fa1194b1474c1281dfb705d74d0d3a30d"}
Jul 06 21:22:18.272735 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.272684    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-n6skq" podStartSLOduration=5.41135971 podStartE2EDuration="15.272667592s" totalImagesPullingTime="9.861307882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:18.271712802 +0000 UTC m=+46.893295136" watchObservedRunningTime="2026-07-06 21:22:18.272667592 +0000 UTC m=+46.894249914"
Jul 06 21:22:18.295185 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.295133    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j" podStartSLOduration=8.349097272 podStartE2EDuration="18.295115325s" totalImagesPullingTime="9.946018053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:18.292702661 +0000 UTC m=+46.914285004" watchObservedRunningTime="2026-07-06 21:22:18.295115325 +0000 UTC m=+46.916697643"
Jul 06 21:22:18.351807 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.351750    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5" podStartSLOduration=18.436628861 podStartE2EDuration="28.351728588s" totalImagesPullingTime="9.915099727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:18.350235031 +0000 UTC m=+46.971817372" watchObservedRunningTime="2026-07-06 21:22:18.351728588 +0000 UTC m=+46.973310906"
Jul 06 21:22:18.407252 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.403668    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6t952" podStartSLOduration=2.539346999 podStartE2EDuration="12.403644526s" totalImagesPullingTime="9.864297527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:18.396985026 +0000 UTC m=+47.018567362" watchObservedRunningTime="2026-07-06 21:22:18.403644526 +0000 UTC m=+47.025226846"
Jul 06 21:22:18.426613 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.426557    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98" podStartSLOduration=8.528635416 podStartE2EDuration="18.426536644s" totalImagesPullingTime="9.897901228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:18.424676098 +0000 UTC m=+47.046258415" watchObservedRunningTime="2026-07-06 21:22:18.426536644 +0000 UTC m=+47.048118962"
Jul 06 21:22:18.680003 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.679962    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fmgzk"]
Jul 06 21:22:18.697227 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.697202    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.701174 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.701144    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-69gp7\""
Jul 06 21:22:18.701776 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.701748    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 21:22:18.702005 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.701991    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 21:22:18.703528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.703457    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fmgzk"]
Jul 06 21:22:18.767632 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.767590    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-data-volume\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.767828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.767647    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.767828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.767798    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-crio-socket\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.767938 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.767826    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22jmw\" (UniqueName: \"kubernetes.io/projected/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-api-access-22jmw\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.767938 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.767878    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.869371 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.869286    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-data-volume\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.869371 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.869336    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.869571 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:18.869474    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:18.869571 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:18.869542    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:19.369522373 +0000 UTC m=+47.991104674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:18.869658 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.869631    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-crio-socket\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.869696 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.869662    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22jmw\" (UniqueName: \"kubernetes.io/projected/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-api-access-22jmw\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.869750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.869717    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.869806 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.869659    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-data-volume\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.869806 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:18.869798    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 21:22:18.869910 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.869824    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-crio-socket\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:18.869910 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:18.869837    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:19.369826292 +0000 UTC m=+47.991408592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : configmap "kube-rbac-proxy" not found
Jul 06 21:22:18.880308 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:18.880272    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22jmw\" (UniqueName: \"kubernetes.io/projected/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-api-access-22jmw\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:19.269880 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.269852    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:22:19.270265 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.270250    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/0.log"
Jul 06 21:22:19.270328 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.270283    2554 generic.go:356] "Generic (PLEG): container finished" podID="e316c648-a5ec-4935-8dae-4b5dc5d02975" containerID="2313f81b0b4a7c0569772e37e7386f1a87d1109e28b6a84a00b5e78ecfeae374" exitCode=255
Jul 06 21:22:19.270387 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.270364    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2thlb" event={"ID":"e316c648-a5ec-4935-8dae-4b5dc5d02975","Type":"ContainerDied","Data":"2313f81b0b4a7c0569772e37e7386f1a87d1109e28b6a84a00b5e78ecfeae374"}
Jul 06 21:22:19.270498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.270426    2554 scope.go:117] "RemoveContainer" containerID="1cd0405ee85e6aa5adc8b2608ff669f80e74a19dfa4ac619255ce5acc1ce16d4"
Jul 06 21:22:19.270692 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.270671    2554 scope.go:117] "RemoveContainer" containerID="2313f81b0b4a7c0569772e37e7386f1a87d1109e28b6a84a00b5e78ecfeae374"
Jul 06 21:22:19.270868 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:19.270846    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2thlb_openshift-console-operator(e316c648-a5ec-4935-8dae-4b5dc5d02975)\"" pod="openshift-console-operator/console-operator-68b757fb67-2thlb" podUID="e316c648-a5ec-4935-8dae-4b5dc5d02975"
Jul 06 21:22:19.273571 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.273551    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e0b5fbc-e414-4f2f-bccd-42fba0c9f387" containerID="9e556f1cac1f60ee9b3bc5df5c1a9fedfc7086d79536bce2ca90ac8d26b1fd68" exitCode=0
Jul 06 21:22:19.273662 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.273647    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" event={"ID":"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387","Type":"ContainerDied","Data":"9e556f1cac1f60ee9b3bc5df5c1a9fedfc7086d79536bce2ca90ac8d26b1fd68"}
Jul 06 21:22:19.373964 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.373929    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:19.374737 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:19.374638    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 21:22:19.374737 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:19.374689    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:19.374737 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:19.374716    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:20.374696906 +0000 UTC m=+48.996279216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : configmap "kube-rbac-proxy" not found
Jul 06 21:22:19.375004 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:19.374905    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:19.375004 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:19.374959    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:20.374941859 +0000 UTC m=+48.996524171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:20.279056 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:20.279031    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:22:20.279542 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:20.279425    2554 scope.go:117] "RemoveContainer" containerID="2313f81b0b4a7c0569772e37e7386f1a87d1109e28b6a84a00b5e78ecfeae374"
Jul 06 21:22:20.279666 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:20.279640    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2thlb_openshift-console-operator(e316c648-a5ec-4935-8dae-4b5dc5d02975)\"" pod="openshift-console-operator/console-operator-68b757fb67-2thlb" podUID="e316c648-a5ec-4935-8dae-4b5dc5d02975"
Jul 06 21:22:20.282535 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:20.282512    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" event={"ID":"5e0b5fbc-e414-4f2f-bccd-42fba0c9f387","Type":"ContainerStarted","Data":"181f413e03f3eaf5155b171df5b79e423e155ee45aec7701d097fa2037b29799"}
Jul 06 21:22:20.325483 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:20.325423    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bzk4f" podStartSLOduration=8.318234 podStartE2EDuration="48.325403191s" totalImagesPullingTime="40.007169191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:20.323326826 +0000 UTC m=+48.944909154" watchObservedRunningTime="2026-07-06 21:22:20.325403191 +0000 UTC m=+48.946985507"
Jul 06 21:22:20.383171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:20.383123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:20.383329 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:20.383213    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:20.383329 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:20.383231    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 21:22:20.383329 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:20.383309    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:20.383475 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:20.383311    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.383292697 +0000 UTC m=+51.004874994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : configmap "kube-rbac-proxy" not found
Jul 06 21:22:20.383475 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:20.383366    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.383355291 +0000 UTC m=+51.004937585 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:20.879236 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:20.879204    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z966s_a8dc5d9b-cafa-44e0-9031-cf12c0632135/dns-node-resolver/0.log"
Jul 06 21:22:21.881579 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:21.881550    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tzktv_d320d61c-9702-4005-845e-1f9143567533/node-ca/0.log"
Jul 06 21:22:22.279971 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.279942    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t952_8afdce3a-fde5-4d11-895a-9abea3702aa7/serve-healthcheck-canary/0.log"
Jul 06 21:22:22.403481 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.403447    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:22.403645 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.403502    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:22.403645 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.403580    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 21:22:22.403645 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.403605    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:22.403742 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.403651    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:26.403636536 +0000 UTC m=+55.025218835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : configmap "kube-rbac-proxy" not found
Jul 06 21:22:22.403742 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.403668    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:26.403661754 +0000 UTC m=+55.025244049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:22.605330 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.605240    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:22.605330 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.605318    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:22.605561 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.605337    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:22.605561 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.605382    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 21:22:22.605561 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.605423    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 21:22:22.605561 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.605467    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:38.605452323 +0000 UTC m=+67.227034631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : secret "router-metrics-certs-default" not found
Jul 06 21:22:22.605561 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.605483    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls podName:ae2fb022-38c9-4af0-bdc3-177c32fc1da5 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:38.605477019 +0000 UTC m=+67.227059314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-qtnvm" (UID: "ae2fb022-38c9-4af0-bdc3-177c32fc1da5") : secret "samples-operator-tls" not found
Jul 06 21:22:22.605561 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.605494    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle podName:3dafa9ce-5b81-4115-8e1a-60c04ca1581c nodeName:}" failed. No retries permitted until 2026-07-06 21:22:38.605488929 +0000 UTC m=+67.227071224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle") pod "router-default-c76c95d9c-x72n7" (UID: "3dafa9ce-5b81-4115-8e1a-60c04ca1581c") : configmap references non-existent config key: service-ca.crt
Jul 06 21:22:22.705854 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.705823    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:22.706009 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.705878    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:22.706009 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.705981    2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:22.706009 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.705997    2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784fb85f99-j9gth: secret "image-registry-tls" not found
Jul 06 21:22:22.706124 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.706032    2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:22.706124 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.706047    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls podName:8877a576-935c-4e31-9f4a-da3429986f86 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:38.706031607 +0000 UTC m=+67.327613920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls") pod "image-registry-784fb85f99-j9gth" (UID: "8877a576-935c-4e31-9f4a-da3429986f86") : secret "image-registry-tls" not found
Jul 06 21:22:22.706124 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.706079    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls podName:2729e991-d331-4162-b6ce-5b8130722c90 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:38.706067431 +0000 UTC m=+67.327649726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-mfdvq" (UID: "2729e991-d331-4162-b6ce-5b8130722c90") : secret "cluster-monitoring-operator-tls" not found
Jul 06 21:22:22.807051 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:22.807023    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:22.807217 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.807172    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:22.807258 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:22.807231    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls podName:1080bc03-6fa6-4840-ba3f-4be61a48ea4a nodeName:}" failed. No retries permitted until 2026-07-06 21:22:38.80721768 +0000 UTC m=+67.428799975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls") pod "dns-default-qw8q4" (UID: "1080bc03-6fa6-4840-ba3f-4be61a48ea4a") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:26.440070 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:26.440033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:26.440606 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:26.440086    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:26.440606 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:26.440172    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:26.440606 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:26.440230    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls podName:aa4e6fde-f2f3-49c4-936a-bcc49a65bf85 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:34.440217636 +0000 UTC m=+63.061799931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fmgzk" (UID: "aa4e6fde-f2f3-49c4-936a-bcc49a65bf85") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:26.440717 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:26.440619    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:27.132924 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:27.132873    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:27.133108 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:27.132945    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:27.133278 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:27.133267    2554 scope.go:117] "RemoveContainer" containerID="2313f81b0b4a7c0569772e37e7386f1a87d1109e28b6a84a00b5e78ecfeae374"
Jul 06 21:22:27.133455 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:27.133415    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-2thlb_openshift-console-operator(e316c648-a5ec-4935-8dae-4b5dc5d02975)\"" pod="openshift-console-operator/console-operator-68b757fb67-2thlb" podUID="e316c648-a5ec-4935-8dae-4b5dc5d02975"
Jul 06 21:22:32.178418 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:32.178392    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thgth"
Jul 06 21:22:34.512857 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:34.512817    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:34.515083 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:34.515061    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa4e6fde-f2f3-49c4-936a-bcc49a65bf85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fmgzk\" (UID: \"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85\") " pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:34.612798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:34.612767    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-69gp7\""
Jul 06 21:22:34.620080 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:34.620049    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fmgzk"
Jul 06 21:22:34.747567 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:34.747544    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fmgzk"]
Jul 06 21:22:34.749461 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:34.749414    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4e6fde_f2f3_49c4_936a_bcc49a65bf85.slice/crio-7c401ed3348bfc48dfc70c0f3b05d4a1bb3b0077dfaf66bdb1fa5a0c914b131c WatchSource:0}: Error finding container 7c401ed3348bfc48dfc70c0f3b05d4a1bb3b0077dfaf66bdb1fa5a0c914b131c: Status 404 returned error can't find the container with id 7c401ed3348bfc48dfc70c0f3b05d4a1bb3b0077dfaf66bdb1fa5a0c914b131c
Jul 06 21:22:35.338446 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:35.338378    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmgzk" event={"ID":"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85","Type":"ContainerStarted","Data":"7c401ed3348bfc48dfc70c0f3b05d4a1bb3b0077dfaf66bdb1fa5a0c914b131c"}
Jul 06 21:22:37.642255 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.642218    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:22:37.645289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.645263    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 21:22:37.654849 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.654825    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d35cde2-d4f1-4831-bc6e-0db34876af88-metrics-certs\") pod \"network-metrics-daemon-slj8s\" (UID: \"4d35cde2-d4f1-4831-bc6e-0db34876af88\") " pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:22:37.742707 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.742673    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:37.742888 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.742767    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:22:37.745507 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.745477    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqtrw\" (UniqueName: \"kubernetes.io/projected/e2f78910-86f6-4cb7-b93d-2e618fbe80fe-kube-api-access-vqtrw\") pod \"network-check-target-h2bwk\" (UID: \"e2f78910-86f6-4cb7-b93d-2e618fbe80fe\") " pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:37.745850 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.745831    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 21:22:37.755591 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.755568    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7975b17c-b872-4395-a032-094e41b8ac03-original-pull-secret\") pod \"global-pull-secret-syncer-447vd\" (UID: \"7975b17c-b872-4395-a032-094e41b8ac03\") " pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:22:37.907094 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.907017    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-447vd"
Jul 06 21:22:37.916806 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.916776    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m4jxb\""
Jul 06 21:22:37.922111 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.922091    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lhqbc\""
Jul 06 21:22:37.924969 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.924949    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-slj8s"
Jul 06 21:22:37.930446 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:37.930418    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:38.577375 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.577346    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-447vd"]
Jul 06 21:22:38.580935 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:38.580910    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7975b17c_b872_4395_a032_094e41b8ac03.slice/crio-340080e384799a4850bdd53d47cd30324397d9d3fe939d3b2c474a5f5ddd213c WatchSource:0}: Error finding container 340080e384799a4850bdd53d47cd30324397d9d3fe939d3b2c474a5f5ddd213c: Status 404 returned error can't find the container with id 340080e384799a4850bdd53d47cd30324397d9d3fe939d3b2c474a5f5ddd213c
Jul 06 21:22:38.651053 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.651006    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:38.651528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.651095    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:38.651528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.651132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:38.654628 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.652875    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-service-ca-bundle\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:38.655353 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.655328    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3dafa9ce-5b81-4115-8e1a-60c04ca1581c-metrics-certs\") pod \"router-default-c76c95d9c-x72n7\" (UID: \"3dafa9ce-5b81-4115-8e1a-60c04ca1581c\") " pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:38.656149 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.656129    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae2fb022-38c9-4af0-bdc3-177c32fc1da5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-qtnvm\" (UID: \"ae2fb022-38c9-4af0-bdc3-177c32fc1da5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:38.751875 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.751850    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:38.752025 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.751890    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:38.754234 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.754203    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2729e991-d331-4162-b6ce-5b8130722c90-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-mfdvq\" (UID: \"2729e991-d331-4162-b6ce-5b8130722c90\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:38.754370 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.754328    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"image-registry-784fb85f99-j9gth\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") " pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:38.806299 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.806262    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h2bwk"]
Jul 06 21:22:38.809243 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.809221    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-slj8s"]
Jul 06 21:22:38.811065 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:38.811037    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f78910_86f6_4cb7_b93d_2e618fbe80fe.slice/crio-95faeca8420f9ad344712bab3dd9183265edc0c53778afd237bf8c9918129522 WatchSource:0}: Error finding container 95faeca8420f9ad344712bab3dd9183265edc0c53778afd237bf8c9918129522: Status 404 returned error can't find the container with id 95faeca8420f9ad344712bab3dd9183265edc0c53778afd237bf8c9918129522
Jul 06 21:22:38.811741 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:38.811712    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d35cde2_d4f1_4831_bc6e_0db34876af88.slice/crio-21f726b57052c3d5b840f7c3e31beaaf516220586e8db33ce15a357e5aa732a0 WatchSource:0}: Error finding container 21f726b57052c3d5b840f7c3e31beaaf516220586e8db33ce15a357e5aa732a0: Status 404 returned error can't find the container with id 21f726b57052c3d5b840f7c3e31beaaf516220586e8db33ce15a357e5aa732a0
Jul 06 21:22:38.837912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.837895    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l8xwz\""
Jul 06 21:22:38.846145 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.846123    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:38.848726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.848708    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h8sk2\""
Jul 06 21:22:38.852974 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.852610    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:38.855302 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.855280    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1080bc03-6fa6-4840-ba3f-4be61a48ea4a-metrics-tls\") pod \"dns-default-qw8q4\" (UID: \"1080bc03-6fa6-4840-ba3f-4be61a48ea4a\") " pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:38.857231 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.857068    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"
Jul 06 21:22:38.922138 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.921385    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kq6tm\""
Jul 06 21:22:38.928887 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.928171    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:38.951641 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.951606    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zrhww\""
Jul 06 21:22:38.959214 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.959146    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"
Jul 06 21:22:38.979323 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.979296    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fg2d\""
Jul 06 21:22:38.985292 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:38.985262    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:39.009196 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.009027    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm"]
Jul 06 21:22:39.033461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.031186    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c76c95d9c-x72n7"]
Jul 06 21:22:39.044995 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:39.044940    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dafa9ce_5b81_4115_8e1a_60c04ca1581c.slice/crio-67366cec96f6b9c832bc4e6bf4c026822ee89074439bd78870b9764b3a44184f WatchSource:0}: Error finding container 67366cec96f6b9c832bc4e6bf4c026822ee89074439bd78870b9764b3a44184f: Status 404 returned error can't find the container with id 67366cec96f6b9c832bc4e6bf4c026822ee89074439bd78870b9764b3a44184f
Jul 06 21:22:39.117466 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.117132    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-784fb85f99-j9gth"]
Jul 06 21:22:39.137674 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.137544    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq"]
Jul 06 21:22:39.165808 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.165703    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qw8q4"]
Jul 06 21:22:39.193215 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:39.193183    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8877a576_935c_4e31_9f4a_da3429986f86.slice/crio-f4c43e427fcde75bdeb3d7f80937592121cf02e3c5eaf8f7ac327dc85b6dae94 WatchSource:0}: Error finding container f4c43e427fcde75bdeb3d7f80937592121cf02e3c5eaf8f7ac327dc85b6dae94: Status 404 returned error can't find the container with id f4c43e427fcde75bdeb3d7f80937592121cf02e3c5eaf8f7ac327dc85b6dae94
Jul 06 21:22:39.193862 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:39.193835    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2729e991_d331_4162_b6ce_5b8130722c90.slice/crio-8760fe44ae11d3fa7332dca0bad1a29023186f975831c3baed4fd065aca3e24b WatchSource:0}: Error finding container 8760fe44ae11d3fa7332dca0bad1a29023186f975831c3baed4fd065aca3e24b: Status 404 returned error can't find the container with id 8760fe44ae11d3fa7332dca0bad1a29023186f975831c3baed4fd065aca3e24b
Jul 06 21:22:39.194475 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:39.194452    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1080bc03_6fa6_4840_ba3f_4be61a48ea4a.slice/crio-9381b829468079ec22a9986431d914ae0650749964ce8c12b330ae2eb3474058 WatchSource:0}: Error finding container 9381b829468079ec22a9986431d914ae0650749964ce8c12b330ae2eb3474058: Status 404 returned error can't find the container with id 9381b829468079ec22a9986431d914ae0650749964ce8c12b330ae2eb3474058
Jul 06 21:22:39.353023 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.352951    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq" event={"ID":"2729e991-d331-4162-b6ce-5b8130722c90","Type":"ContainerStarted","Data":"8760fe44ae11d3fa7332dca0bad1a29023186f975831c3baed4fd065aca3e24b"}
Jul 06 21:22:39.354404 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.354351    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-447vd" event={"ID":"7975b17c-b872-4395-a032-094e41b8ac03","Type":"ContainerStarted","Data":"340080e384799a4850bdd53d47cd30324397d9d3fe939d3b2c474a5f5ddd213c"}
Jul 06 21:22:39.355737 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.355694    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qw8q4" event={"ID":"1080bc03-6fa6-4840-ba3f-4be61a48ea4a","Type":"ContainerStarted","Data":"9381b829468079ec22a9986431d914ae0650749964ce8c12b330ae2eb3474058"}
Jul 06 21:22:39.357350 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.357328    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c76c95d9c-x72n7" event={"ID":"3dafa9ce-5b81-4115-8e1a-60c04ca1581c","Type":"ContainerStarted","Data":"40b2f6ab1ab0aa4efb77268f3f2e73587a11b41e354dc3d2190ed2f2f04d9d6c"}
Jul 06 21:22:39.357479 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.357369    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c76c95d9c-x72n7" event={"ID":"3dafa9ce-5b81-4115-8e1a-60c04ca1581c","Type":"ContainerStarted","Data":"67366cec96f6b9c832bc4e6bf4c026822ee89074439bd78870b9764b3a44184f"}
Jul 06 21:22:39.359041 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.359017    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slj8s" event={"ID":"4d35cde2-d4f1-4831-bc6e-0db34876af88","Type":"ContainerStarted","Data":"21f726b57052c3d5b840f7c3e31beaaf516220586e8db33ce15a357e5aa732a0"}
Jul 06 21:22:39.360232 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.360209    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm" event={"ID":"ae2fb022-38c9-4af0-bdc3-177c32fc1da5","Type":"ContainerStarted","Data":"eb970a8f520703f95d5d470019ea857eb2002013e7db9eab07c2882a216ca63b"}
Jul 06 21:22:39.362577 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.362556    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmgzk" event={"ID":"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85","Type":"ContainerStarted","Data":"f46e5137aa6aaf9a30530e002da477cfff8c1f3216565ecfc152dc0c5b79e150"}
Jul 06 21:22:39.362746 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.362726    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmgzk" event={"ID":"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85","Type":"ContainerStarted","Data":"43309e807e53b0c95bed6bdac81519cec4ede1d2c87910057a9a4258559f2b72"}
Jul 06 21:22:39.364512 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.364488    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784fb85f99-j9gth" event={"ID":"8877a576-935c-4e31-9f4a-da3429986f86","Type":"ContainerStarted","Data":"a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0"}
Jul 06 21:22:39.364601 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.364532    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784fb85f99-j9gth" event={"ID":"8877a576-935c-4e31-9f4a-da3429986f86","Type":"ContainerStarted","Data":"f4c43e427fcde75bdeb3d7f80937592121cf02e3c5eaf8f7ac327dc85b6dae94"}
Jul 06 21:22:39.364748 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.364722    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:22:39.367151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.367084    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2bwk" event={"ID":"e2f78910-86f6-4cb7-b93d-2e618fbe80fe","Type":"ContainerStarted","Data":"c5361addcec9307acfead32a0152b58c73db1bf7604cc4a5c5106f37236f964e"}
Jul 06 21:22:39.367151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.367125    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h2bwk" event={"ID":"e2f78910-86f6-4cb7-b93d-2e618fbe80fe","Type":"ContainerStarted","Data":"95faeca8420f9ad344712bab3dd9183265edc0c53778afd237bf8c9918129522"}
Jul 06 21:22:39.367354 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.367332    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:22:39.381581 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.381530    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c76c95d9c-x72n7" podStartSLOduration=49.38151511 podStartE2EDuration="49.38151511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:39.380023201 +0000 UTC m=+68.001605538" watchObservedRunningTime="2026-07-06 21:22:39.38151511 +0000 UTC m=+68.003097428"
Jul 06 21:22:39.403375 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.403315    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-784fb85f99-j9gth" podStartSLOduration=66.403294728 podStartE2EDuration="1m6.403294728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:39.401930876 +0000 UTC m=+68.023513193" watchObservedRunningTime="2026-07-06 21:22:39.403294728 +0000 UTC m=+68.024877047"
Jul 06 21:22:39.425535 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.425480    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h2bwk" podStartSLOduration=67.425460333 podStartE2EDuration="1m7.425460333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:39.423563976 +0000 UTC m=+68.045146318" watchObservedRunningTime="2026-07-06 21:22:39.425460333 +0000 UTC m=+68.047042650"
Jul 06 21:22:39.847051 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.846970    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:39.849973 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.849755    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:39.981262 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:39.980862    2554 scope.go:117] "RemoveContainer" containerID="2313f81b0b4a7c0569772e37e7386f1a87d1109e28b6a84a00b5e78ecfeae374"
Jul 06 21:22:40.377844 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:40.377709    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slj8s" event={"ID":"4d35cde2-d4f1-4831-bc6e-0db34876af88","Type":"ContainerStarted","Data":"218ccf29c4d6d40144209657d0e09f74aa84ef43a072b875845e5c4ac1ee2b33"}
Jul 06 21:22:40.384086 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:40.384013    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:22:40.386846 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:40.384758    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-2thlb" event={"ID":"e316c648-a5ec-4935-8dae-4b5dc5d02975","Type":"ContainerStarted","Data":"6451c3c6053dd51ecc28a0e3ab9622a0b04b6a43a24a537e258e185a920f3c61"}
Jul 06 21:22:40.386846 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:40.386526    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:40.386846 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:40.386561    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:40.391967 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:40.391924    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c76c95d9c-x72n7"
Jul 06 21:22:40.433459 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:40.433353    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-2thlb" podStartSLOduration=32.55752974 podStartE2EDuration="42.433319609s" totalImagesPullingTime="9.875789869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:40.407106412 +0000 UTC m=+69.028688728" watchObservedRunningTime="2026-07-06 21:22:40.433319609 +0000 UTC m=+69.054901927"
Jul 06 21:22:41.348409 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:41.348372    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-2thlb"
Jul 06 21:22:41.392671 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:41.392564    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-slj8s" event={"ID":"4d35cde2-d4f1-4831-bc6e-0db34876af88","Type":"ContainerStarted","Data":"b299d8d903948041ff212850e0fc9fe0f7e18537b32cf69d2f9c5b69fa7bb15e"}
Jul 06 21:22:41.414739 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:41.414674    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-slj8s" podStartSLOduration=68.124707992 podStartE2EDuration="1m9.41465309s" totalImagesPullingTime="1.289945098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:41.412819198 +0000 UTC m=+70.034401516" watchObservedRunningTime="2026-07-06 21:22:41.41465309 +0000 UTC m=+70.036235411"
Jul 06 21:22:46.418790 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.418744    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq" event={"ID":"2729e991-d331-4162-b6ce-5b8130722c90","Type":"ContainerStarted","Data":"1b4d475b62ee7a69db1581312767d08fc16d2855e6c12f1fc83e4850ae746e59"}
Jul 06 21:22:46.420221 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.420193    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-447vd" event={"ID":"7975b17c-b872-4395-a032-094e41b8ac03","Type":"ContainerStarted","Data":"2e5848caa9bd1967ce0078a24468db3cf42b2756f5d6acc5b67f8dd387d5278e"}
Jul 06 21:22:46.421839 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.421814    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qw8q4" event={"ID":"1080bc03-6fa6-4840-ba3f-4be61a48ea4a","Type":"ContainerStarted","Data":"181ef4dfaa883c0bf14c22df0474f28bca120b233e5ddb8ced3b123acd8e7922"}
Jul 06 21:22:46.421955 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.421900    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qw8q4" event={"ID":"1080bc03-6fa6-4840-ba3f-4be61a48ea4a","Type":"ContainerStarted","Data":"ffd86754006dce7907e836c43fc3daf7b10a9d9ea948bc1a68fb544221589fbd"}
Jul 06 21:22:46.421955 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.421936    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:46.424629 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.424195    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm" event={"ID":"ae2fb022-38c9-4af0-bdc3-177c32fc1da5","Type":"ContainerStarted","Data":"9f39b8d826baca641e097aef69a9017b835ea50b440622d5947a29dba2a00276"}
Jul 06 21:22:46.424629 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.424247    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm" event={"ID":"ae2fb022-38c9-4af0-bdc3-177c32fc1da5","Type":"ContainerStarted","Data":"7818bf1578b815f6d50ea7f980362964433d42013de0478d3cc14bf1c0aa0ff6"}
Jul 06 21:22:46.428009 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.427981    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fmgzk" event={"ID":"aa4e6fde-f2f3-49c4-936a-bcc49a65bf85","Type":"ContainerStarted","Data":"cc9d0752faacd646081d8c3f91cad5d7ff21ad4393f23d6b1e11e20f4070feeb"}
Jul 06 21:22:46.439834 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.439793    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-mfdvq" podStartSLOduration=50.330347908 podStartE2EDuration="56.439781705s" totalImagesPullingTime="6.109433797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.438272884 +0000 UTC m=+75.059855201" watchObservedRunningTime="2026-07-06 21:22:46.439781705 +0000 UTC m=+75.061364076"
Jul 06 21:22:46.462888 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.462840    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-qtnvm" podStartSLOduration=44.234851702 podStartE2EDuration="50.462824996s" totalImagesPullingTime="6.227973294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.461536201 +0000 UTC m=+75.083118540" watchObservedRunningTime="2026-07-06 21:22:46.462824996 +0000 UTC m=+75.084407313"
Jul 06 21:22:46.477374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.477335    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-447vd" podStartSLOduration=66.460085852 podStartE2EDuration="1m13.477321504s" totalImagesPullingTime="7.017235652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.476618019 +0000 UTC m=+75.098200335" watchObservedRunningTime="2026-07-06 21:22:46.477321504 +0000 UTC m=+75.098903855"
Jul 06 21:22:46.500228 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.500187    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qw8q4" podStartSLOduration=34.393071795 podStartE2EDuration="40.500172254s" totalImagesPullingTime="6.107100459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.499245286 +0000 UTC m=+75.120827602" watchObservedRunningTime="2026-07-06 21:22:46.500172254 +0000 UTC m=+75.121754570"
Jul 06 21:22:46.527481 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:46.527424    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fmgzk" podStartSLOduration=18.098601255 podStartE2EDuration="28.52740904s" totalImagesPullingTime="10.428807785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:22:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.525863415 +0000 UTC m=+75.147445731" watchObservedRunningTime="2026-07-06 21:22:46.52740904 +0000 UTC m=+75.148991391"
Jul 06 21:22:51.108312 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.108280    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"]
Jul 06 21:22:51.141116 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.141080    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"]
Jul 06 21:22:51.141256 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.141196    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.143787 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.143765    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 21:22:51.144726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.144705    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kzxpx\""
Jul 06 21:22:51.144726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.144722    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 21:22:51.144726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.144722    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 21:22:51.159547 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.159521    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2f45\" (UniqueName: \"kubernetes.io/projected/7b8c61c0-9c76-4368-afc5-a72442107435-kube-api-access-m2f45\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.159653 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.159549    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.159653 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.159597    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b8c61c0-9c76-4368-afc5-a72442107435-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.159653 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.159633    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.260735 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.260696    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b8c61c0-9c76-4368-afc5-a72442107435-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.260735 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.260730    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.260981 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.260764    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2f45\" (UniqueName: \"kubernetes.io/projected/7b8c61c0-9c76-4368-afc5-a72442107435-kube-api-access-m2f45\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.260981 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.260784    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.260981 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:51.260868    2554 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 21:22:51.260981 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:51.260941    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-tls podName:7b8c61c0-9c76-4368-afc5-a72442107435 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:51.760923669 +0000 UTC m=+80.382505964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-d9kn2" (UID: "7b8c61c0-9c76-4368-afc5-a72442107435") : secret "prometheus-operator-tls" not found
Jul 06 21:22:51.261518 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.261497    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b8c61c0-9c76-4368-afc5-a72442107435-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.263190 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.263173    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.270818 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.270793    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2f45\" (UniqueName: \"kubernetes.io/projected/7b8c61c0-9c76-4368-afc5-a72442107435-kube-api-access-m2f45\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.763667 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.763627    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:51.765882 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:51.765862    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7b8c61c0-9c76-4368-afc5-a72442107435-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-d9kn2\" (UID: \"7b8c61c0-9c76-4368-afc5-a72442107435\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:52.050592 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:52.050511    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"
Jul 06 21:22:52.185463 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:52.185423    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2"]
Jul 06 21:22:52.187801 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:52.187775    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8c61c0_9c76_4368_afc5_a72442107435.slice/crio-58ddeafd76224d67713e8f2f742535dcf8954d47f55b3fc0edc2b9ecd8c806c5 WatchSource:0}: Error finding container 58ddeafd76224d67713e8f2f742535dcf8954d47f55b3fc0edc2b9ecd8c806c5: Status 404 returned error can't find the container with id 58ddeafd76224d67713e8f2f742535dcf8954d47f55b3fc0edc2b9ecd8c806c5
Jul 06 21:22:52.449976 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:52.449896    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2" event={"ID":"7b8c61c0-9c76-4368-afc5-a72442107435","Type":"ContainerStarted","Data":"58ddeafd76224d67713e8f2f742535dcf8954d47f55b3fc0edc2b9ecd8c806c5"}
Jul 06 21:22:54.459257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:54.459218    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2" event={"ID":"7b8c61c0-9c76-4368-afc5-a72442107435","Type":"ContainerStarted","Data":"4460f86a01d81902d91b41b9537981de2af27ae22710e0df267f30969638cbc7"}
Jul 06 21:22:54.459638 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:54.459269    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2" event={"ID":"7b8c61c0-9c76-4368-afc5-a72442107435","Type":"ContainerStarted","Data":"a5e77a1eb57312a576ffaf10b9ea791b08f2f03180444637b0d6dee4b4e29c1d"}
Jul 06 21:22:54.477272 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:54.477228    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9kn2" podStartSLOduration=2.142217972 podStartE2EDuration="3.477209685s" totalImagesPullingTime="1.334991713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:54.47651047 +0000 UTC m=+83.098092802" watchObservedRunningTime="2026-07-06 21:22:54.477209685 +0000 UTC m=+83.098792006"
Jul 06 21:22:56.434623 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.434587    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qw8q4"
Jul 06 21:22:56.559067 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.559031    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tzkxq"]
Jul 06 21:22:56.562128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.562107    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.566930 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.566901    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 21:22:56.567059 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.567008    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 21:22:56.567160 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.567136    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 21:22:56.567468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.567449    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zzc4v\""
Jul 06 21:22:56.589712 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.589687    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"]
Jul 06 21:22:56.591743 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.591726    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.598055 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.598030    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 21:22:56.598055 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.598047    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 21:22:56.598458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.598423    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6tkb9\""
Jul 06 21:22:56.598541 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.598525    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 21:22:56.601981 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.601964    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.602031 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.601991    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zb6j\" (UniqueName: \"kubernetes.io/projected/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-api-access-6zb6j\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.602031 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602012    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.602104 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602036    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.602104 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602074    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-textfile\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.602168 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602102    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-metrics-client-ca\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.602226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602208    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.602263 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602241    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-tls\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.602292 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602267    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.602324 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602292    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-sys\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.602356 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602326    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.602388 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602367    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.602388 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602384    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-root\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.602469 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-wtmp\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.602469 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.602424    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrzkw\" (UniqueName: \"kubernetes.io/projected/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-kube-api-access-jrzkw\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.653809 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.653772    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"]
Jul 06 21:22:56.703475 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.703382    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.703475 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.703413    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zb6j\" (UniqueName: \"kubernetes.io/projected/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-api-access-6zb6j\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.703475 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.703459    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.703709 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.703479    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.703709 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.703494    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-textfile\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.703709 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.703518    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-metrics-client-ca\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.703709 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.703553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.704314 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704284    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-textfile\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704662    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-tls\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704722    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704753    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-sys\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704827    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704898    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704924    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-root\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704943    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704948    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-metrics-client-ca\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704960    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-wtmp\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.704985    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrzkw\" (UniqueName: \"kubernetes.io/projected/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-kube-api-access-jrzkw\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.705019    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.705077    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-root\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.705160    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-wtmp\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.705190    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-sys\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.705524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.705225    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.706287 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.705647    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.706482 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.706457    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.706658 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.706641    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.707489 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.707471    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-tls\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.708153 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.708127    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.733993 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.733952    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrzkw\" (UniqueName: \"kubernetes.io/projected/1817e7c7-d772-4dac-9d4f-b8c399f6b8dc-kube-api-access-jrzkw\") pod \"node-exporter-tzkxq\" (UID: \"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc\") " pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.744781 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.744760    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zb6j\" (UniqueName: \"kubernetes.io/projected/dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025-kube-api-access-6zb6j\") pod \"kube-state-metrics-7c9dbb8b7d-wjfss\" (UID: \"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:56.872730 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.872696    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tzkxq"
Jul 06 21:22:56.900286 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:56.900264    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"
Jul 06 21:22:57.044205 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:57.044173    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe5dcf1_4e60_4fbe_978b_fdb67fc9e025.slice/crio-d3724cb34389062ff89cd66fb9598cce7fe837936e5b442615ec4061e1e660df WatchSource:0}: Error finding container d3724cb34389062ff89cd66fb9598cce7fe837936e5b442615ec4061e1e660df: Status 404 returned error can't find the container with id d3724cb34389062ff89cd66fb9598cce7fe837936e5b442615ec4061e1e660df
Jul 06 21:22:57.046469 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.046424    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss"]
Jul 06 21:22:57.471864 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.471828    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss" event={"ID":"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025","Type":"ContainerStarted","Data":"d3724cb34389062ff89cd66fb9598cce7fe837936e5b442615ec4061e1e660df"}
Jul 06 21:22:57.473172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.473144    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzkxq" event={"ID":"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc","Type":"ContainerStarted","Data":"314918f0ff5e80a3f0a60b5df3a23fe059b6dad5725164c9422fd788f5a34f8b"}
Jul 06 21:22:57.544853 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.544133    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:22:57.547127 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.547089    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.549638 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.549601    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 21:22:57.550337 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.550297    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 21:22:57.550473 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.550306    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 21:22:57.550473 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.550353    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 21:22:57.550597 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.550509    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 21:22:57.551053 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.551032    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 21:22:57.551153 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.551077    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 21:22:57.551153 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.551145    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-spc4z\""
Jul 06 21:22:57.551284 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.551264    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 21:22:57.551773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.551745    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 21:22:57.569554 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.569527    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:22:57.612821 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.612789    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.612992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.612843    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.612992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.612880    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.612992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.612923    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.612992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.612947    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.612992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.612967    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.613559 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.613002    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.613559 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.613034    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.613559 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.613076    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-config-out\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.613559 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.613101    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.613559 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.613130    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-config-volume\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.613559 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.613156    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhr8n\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-kube-api-access-dhr8n\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.613559 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.613183    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-web-config\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.714699 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714660    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.714861 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714713    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.714861 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714770    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.714861 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714806    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.714861 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714851    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-config-out\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.715119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714875    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.715119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714900    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-config-volume\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.715119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714929    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhr8n\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-kube-api-access-dhr8n\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.715119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714959    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-web-config\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.715119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.714995    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.715119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.715026    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.715119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.715057    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.715119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.715113    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.716816 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.715522    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.716816 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.715830    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.716816 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:22:57.716668    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle podName:61a4c404-5417-4723-a1a6-c05053fad816 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:58.216643761 +0000 UTC m=+86.838226069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "61a4c404-5417-4723-a1a6-c05053fad816") : configmap references non-existent config key: ca-bundle.crt
Jul 06 21:22:57.721723 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.721663    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.725181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.724875    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.725181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.725108    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-config-out\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.726137 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.725743    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.726137 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.726097    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.726295 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.726213    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-web-config\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.726405 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.726383    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-config-volume\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.726493 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.726467    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.727403 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.727368    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:57.733916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:57.733877    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhr8n\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-kube-api-access-dhr8n\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:58.220536 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.220482    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:58.221499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.221425    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:58.458835 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.458807    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:22:58.483093 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.482974    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss" event={"ID":"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025","Type":"ContainerStarted","Data":"bc7dc4f08ea57d9092b39a535597011b597c3d10a97ddb7ef74c222260832c54"}
Jul 06 21:22:58.483093 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.483049    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss" event={"ID":"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025","Type":"ContainerStarted","Data":"cdea99b99e08bc9bd6165f04b536299919150187e7ea206fc603d93f82032859"}
Jul 06 21:22:58.488823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.488085    2554 generic.go:356] "Generic (PLEG): container finished" podID="1817e7c7-d772-4dac-9d4f-b8c399f6b8dc" containerID="2bc0b492ddcff4808bd331ec46c256ddd6c1b3c6ffd1438166d0e976b0100c32" exitCode=0
Jul 06 21:22:58.488823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.488153    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzkxq" event={"ID":"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc","Type":"ContainerDied","Data":"2bc0b492ddcff4808bd331ec46c256ddd6c1b3c6ffd1438166d0e976b0100c32"}
Jul 06 21:22:58.716574 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:22:58.716541    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a4c404_5417_4723_a1a6_c05053fad816.slice/crio-9b9805118c7eebb2038fe4b2f1de7a51f1710631a9d48e40daf3ae09bcf2ded8 WatchSource:0}: Error finding container 9b9805118c7eebb2038fe4b2f1de7a51f1710631a9d48e40daf3ae09bcf2ded8: Status 404 returned error can't find the container with id 9b9805118c7eebb2038fe4b2f1de7a51f1710631a9d48e40daf3ae09bcf2ded8
Jul 06 21:22:58.720039 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.718836    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:22:58.933779 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.933679    2554 patch_prober.go:28] interesting pod/image-registry-784fb85f99-j9gth container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 21:22:58.933779 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:58.933738    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-784fb85f99-j9gth" podUID="8877a576-935c-4e31-9f4a-da3429986f86" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 21:22:59.494986 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:59.494924    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss" event={"ID":"dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025","Type":"ContainerStarted","Data":"cf605ff107cec97200636739c3c7d20444b25a30ccf3551ce3c403947ecb1cce"}
Jul 06 21:22:59.496383 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:59.496359    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerStarted","Data":"9b9805118c7eebb2038fe4b2f1de7a51f1710631a9d48e40daf3ae09bcf2ded8"}
Jul 06 21:22:59.498884 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:59.498854    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzkxq" event={"ID":"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc","Type":"ContainerStarted","Data":"9c8b9c15349e3358c81a578466fc2064a8acb017a831564c3fd454e8aae6ecae"}
Jul 06 21:22:59.498992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:59.498903    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzkxq" event={"ID":"1817e7c7-d772-4dac-9d4f-b8c399f6b8dc","Type":"ContainerStarted","Data":"51c3bdf32df79ac79282ffced80b16e175e5bf7213e3149d8b7779da37d0790f"}
Jul 06 21:22:59.517887 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:59.517841    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wjfss" podStartSLOduration=2.218653986 podStartE2EDuration="3.517822694s" totalImagesPullingTime="1.299168708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:59.515902261 +0000 UTC m=+88.137484623" watchObservedRunningTime="2026-07-06 21:22:59.517822694 +0000 UTC m=+88.139405008"
Jul 06 21:22:59.537767 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:22:59.537724    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tzkxq" podStartSLOduration=2.410028659 podStartE2EDuration="3.537710299s" totalImagesPullingTime="1.053511641s" totalInitContainerRuntime="74.169999ms" isStatefulPod=true podCreationTimestamp="2026-07-06 21:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:59.536580126 +0000 UTC m=+88.158162442" watchObservedRunningTime="2026-07-06 21:22:59.537710299 +0000 UTC m=+88.159292615"
Jul 06 21:23:00.389840 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:00.389749    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:23:00.503768 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:00.503736    2554 generic.go:356] "Generic (PLEG): container finished" podID="61a4c404-5417-4723-a1a6-c05053fad816" containerID="9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b" exitCode=0
Jul 06 21:23:00.504123 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:00.503822    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerDied","Data":"9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b"}
Jul 06 21:23:03.519749 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:03.519718    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerStarted","Data":"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2"}
Jul 06 21:23:03.520114 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:03.519783    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerStarted","Data":"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d"}
Jul 06 21:23:03.520114 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:03.519808    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerStarted","Data":"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc"}
Jul 06 21:23:03.520114 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:03.519832    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerStarted","Data":"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53"}
Jul 06 21:23:03.520114 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:03.519857    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerStarted","Data":"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a"}
Jul 06 21:23:04.527099 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:04.527064    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerStarted","Data":"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f"}
Jul 06 21:23:04.563336 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:04.563284    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.7246301280000003 podStartE2EDuration="7.563265196s" totalImagesPullingTime="4.821585314s" totalInitContainerRuntime="17.049754ms" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:23:04.56085781 +0000 UTC m=+93.182440128" watchObservedRunningTime="2026-07-06 21:23:04.563265196 +0000 UTC m=+93.184847527"
Jul 06 21:23:07.714085 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:07.714046    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-784fb85f99-j9gth"]
Jul 06 21:23:10.389516 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:10.389459    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h2bwk"
Jul 06 21:23:32.737092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:32.737051    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-784fb85f99-j9gth" podUID="8877a576-935c-4e31-9f4a-da3429986f86" containerName="registry" containerID="cri-o://a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0" gracePeriod=30
Jul 06 21:23:32.977877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:32.977856    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:23:33.127578 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.127543    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-image-registry-private-configuration\") pod \"8877a576-935c-4e31-9f4a-da3429986f86\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") "
Jul 06 21:23:33.127578 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.127581    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-trusted-ca\") pod \"8877a576-935c-4e31-9f4a-da3429986f86\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") "
Jul 06 21:23:33.127832 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.127606    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd627\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-kube-api-access-sd627\") pod \"8877a576-935c-4e31-9f4a-da3429986f86\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") "
Jul 06 21:23:33.127832 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.127629    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") pod \"8877a576-935c-4e31-9f4a-da3429986f86\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") "
Jul 06 21:23:33.127832 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.127737    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-bound-sa-token\") pod \"8877a576-935c-4e31-9f4a-da3429986f86\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") "
Jul 06 21:23:33.127832 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.127778    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-installation-pull-secrets\") pod \"8877a576-935c-4e31-9f4a-da3429986f86\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") "
Jul 06 21:23:33.127832 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.127818    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-registry-certificates\") pod \"8877a576-935c-4e31-9f4a-da3429986f86\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") "
Jul 06 21:23:33.128081 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.127918    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8877a576-935c-4e31-9f4a-da3429986f86-ca-trust-extracted\") pod \"8877a576-935c-4e31-9f4a-da3429986f86\" (UID: \"8877a576-935c-4e31-9f4a-da3429986f86\") "
Jul 06 21:23:33.128150 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.128085    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8877a576-935c-4e31-9f4a-da3429986f86" (UID: "8877a576-935c-4e31-9f4a-da3429986f86"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:33.128199 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.128179    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8877a576-935c-4e31-9f4a-da3429986f86" (UID: "8877a576-935c-4e31-9f4a-da3429986f86"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:33.128336 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.128224    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-trusted-ca\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:23:33.130317 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.130251    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8877a576-935c-4e31-9f4a-da3429986f86" (UID: "8877a576-935c-4e31-9f4a-da3429986f86"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:33.130471 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.130418    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-kube-api-access-sd627" (OuterVolumeSpecName: "kube-api-access-sd627") pod "8877a576-935c-4e31-9f4a-da3429986f86" (UID: "8877a576-935c-4e31-9f4a-da3429986f86"). InnerVolumeSpecName "kube-api-access-sd627". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:33.130566 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.130537    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8877a576-935c-4e31-9f4a-da3429986f86" (UID: "8877a576-935c-4e31-9f4a-da3429986f86"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:33.130566 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.130544    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8877a576-935c-4e31-9f4a-da3429986f86" (UID: "8877a576-935c-4e31-9f4a-da3429986f86"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:33.130761 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.130580    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8877a576-935c-4e31-9f4a-da3429986f86" (UID: "8877a576-935c-4e31-9f4a-da3429986f86"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:33.136107 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.136085    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8877a576-935c-4e31-9f4a-da3429986f86-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8877a576-935c-4e31-9f4a-da3429986f86" (UID: "8877a576-935c-4e31-9f4a-da3429986f86"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:23:33.229009 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.228973    2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8877a576-935c-4e31-9f4a-da3429986f86-ca-trust-extracted\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:23:33.229009 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.229004    2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-image-registry-private-configuration\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:23:33.229009 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.229015    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd627\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-kube-api-access-sd627\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:23:33.229232 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.229025    2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-registry-tls\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:23:33.229232 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.229034    2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8877a576-935c-4e31-9f4a-da3429986f86-bound-sa-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:23:33.229232 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.229042    2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8877a576-935c-4e31-9f4a-da3429986f86-installation-pull-secrets\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:23:33.229232 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.229051    2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8877a576-935c-4e31-9f4a-da3429986f86-registry-certificates\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:23:33.644212 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.644176    2554 generic.go:356] "Generic (PLEG): container finished" podID="8877a576-935c-4e31-9f4a-da3429986f86" containerID="a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0" exitCode=0
Jul 06 21:23:33.644376 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.644219    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784fb85f99-j9gth"
Jul 06 21:23:33.644376 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.644266    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784fb85f99-j9gth" event={"ID":"8877a576-935c-4e31-9f4a-da3429986f86","Type":"ContainerDied","Data":"a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0"}
Jul 06 21:23:33.644376 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.644313    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784fb85f99-j9gth" event={"ID":"8877a576-935c-4e31-9f4a-da3429986f86","Type":"ContainerDied","Data":"f4c43e427fcde75bdeb3d7f80937592121cf02e3c5eaf8f7ac327dc85b6dae94"}
Jul 06 21:23:33.644376 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.644333    2554 scope.go:117] "RemoveContainer" containerID="a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0"
Jul 06 21:23:33.652700 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.652677    2554 scope.go:117] "RemoveContainer" containerID="a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0"
Jul 06 21:23:33.652955 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:23:33.652937    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0\": container with ID starting with a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0 not found: ID does not exist" containerID="a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0"
Jul 06 21:23:33.653002 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.652966    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0"} err="failed to get container status \"a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0\": rpc error: code = NotFound desc = could not find container \"a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0\": container with ID starting with a5d900d2349c449bd36048be0e8444733d42b6169e0a37355a958d0d0c17c3b0 not found: ID does not exist"
Jul 06 21:23:33.668128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.668106    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-784fb85f99-j9gth"]
Jul 06 21:23:33.671246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.671227    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-784fb85f99-j9gth"]
Jul 06 21:23:33.985060 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:33.984983    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8877a576-935c-4e31-9f4a-da3429986f86" path="/var/lib/kubelet/pods/8877a576-935c-4e31-9f4a-da3429986f86/volumes"
Jul 06 21:23:38.664878 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:38.664794    2554 generic.go:356] "Generic (PLEG): container finished" podID="42944ada-62d1-4750-b0e5-65642b3115e9" containerID="6b14c3720dedc52e9f3ffa014fe995c0348389d76af69642601cece452d10a2d" exitCode=0
Jul 06 21:23:38.664878 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:38.664866    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98" event={"ID":"42944ada-62d1-4750-b0e5-65642b3115e9","Type":"ContainerDied","Data":"6b14c3720dedc52e9f3ffa014fe995c0348389d76af69642601cece452d10a2d"}
Jul 06 21:23:38.665394 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:38.665184    2554 scope.go:117] "RemoveContainer" containerID="6b14c3720dedc52e9f3ffa014fe995c0348389d76af69642601cece452d10a2d"
Jul 06 21:23:39.676418 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:39.676385    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-78c98" event={"ID":"42944ada-62d1-4750-b0e5-65642b3115e9","Type":"ContainerStarted","Data":"438a78b4476e18730c8251ccdc58894f810a5f846713ddb9640aff9c68c0df0a"}
Jul 06 21:23:43.693728 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:43.693694    2554 generic.go:356] "Generic (PLEG): container finished" podID="e0f35886-27bf-4fef-99f9-cae10a51a743" containerID="de14ef31b7e4564fdf0e93387d710b1fa1194b1474c1281dfb705d74d0d3a30d" exitCode=0
Jul 06 21:23:43.694102 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:43.693755    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j" event={"ID":"e0f35886-27bf-4fef-99f9-cae10a51a743","Type":"ContainerDied","Data":"de14ef31b7e4564fdf0e93387d710b1fa1194b1474c1281dfb705d74d0d3a30d"}
Jul 06 21:23:43.694144 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:43.694099    2554 scope.go:117] "RemoveContainer" containerID="de14ef31b7e4564fdf0e93387d710b1fa1194b1474c1281dfb705d74d0d3a30d"
Jul 06 21:23:44.698911 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:44.698880    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-lcr7j" event={"ID":"e0f35886-27bf-4fef-99f9-cae10a51a743","Type":"ContainerStarted","Data":"c0f8f271f88b0f6ee86551ae76043951f7955af624d07a7e54acff0e9b8bd5ca"}
Jul 06 21:23:53.734031 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:53.733984    2554 generic.go:356] "Generic (PLEG): container finished" podID="3142fb0d-2203-4835-b135-550232ba736b" containerID="7186db82b8e2c1366567cca96e4b796f5094e1bd38f9f3e16a54182ce5a827ff" exitCode=0
Jul 06 21:23:53.734415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:53.734054    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5" event={"ID":"3142fb0d-2203-4835-b135-550232ba736b","Type":"ContainerDied","Data":"7186db82b8e2c1366567cca96e4b796f5094e1bd38f9f3e16a54182ce5a827ff"}
Jul 06 21:23:53.734488 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:53.734417    2554 scope.go:117] "RemoveContainer" containerID="7186db82b8e2c1366567cca96e4b796f5094e1bd38f9f3e16a54182ce5a827ff"
Jul 06 21:23:54.739669 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:23:54.739634    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rlzt5" event={"ID":"3142fb0d-2203-4835-b135-550232ba736b","Type":"ContainerStarted","Data":"15948dc5da2a5445e47d2d1e96268e56525346c96d6e15bf5f94b61e57c0a095"}
Jul 06 21:24:17.258498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.258464    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:24:17.258926 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.258745    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="alertmanager" containerID="cri-o://cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a" gracePeriod=120
Jul 06 21:24:17.258926 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.258826    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy-metric" containerID="cri-o://dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2" gracePeriod=120
Jul 06 21:24:17.258926 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.258843    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="prom-label-proxy" containerID="cri-o://90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f" gracePeriod=120
Jul 06 21:24:17.258926 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.258872    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy-web" containerID="cri-o://05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc" gracePeriod=120
Jul 06 21:24:17.259115 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.258906    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="config-reloader" containerID="cri-o://7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53" gracePeriod=120
Jul 06 21:24:17.259115 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.258939    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy" containerID="cri-o://4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d" gracePeriod=120
Jul 06 21:24:17.834125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.834090    2554 generic.go:356] "Generic (PLEG): container finished" podID="61a4c404-5417-4723-a1a6-c05053fad816" containerID="90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f" exitCode=0
Jul 06 21:24:17.834125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.834117    2554 generic.go:356] "Generic (PLEG): container finished" podID="61a4c404-5417-4723-a1a6-c05053fad816" containerID="4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d" exitCode=0
Jul 06 21:24:17.834125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.834125    2554 generic.go:356] "Generic (PLEG): container finished" podID="61a4c404-5417-4723-a1a6-c05053fad816" containerID="7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53" exitCode=0
Jul 06 21:24:17.834125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.834133    2554 generic.go:356] "Generic (PLEG): container finished" podID="61a4c404-5417-4723-a1a6-c05053fad816" containerID="cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a" exitCode=0
Jul 06 21:24:17.834379 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.834162    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerDied","Data":"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f"}
Jul 06 21:24:17.834379 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.834223    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerDied","Data":"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d"}
Jul 06 21:24:17.834379 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.834249    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerDied","Data":"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53"}
Jul 06 21:24:17.834379 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:17.834274    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerDied","Data":"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a"}
Jul 06 21:24:18.505599 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.505575    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:18.606152 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606072    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-main-tls\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606152 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606108    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-config-out\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606152 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606128    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-web\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606157    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606188    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-metric\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606206    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-cluster-tls-config\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606226    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-main-db\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606270    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhr8n\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-kube-api-access-dhr8n\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606295    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-metrics-client-ca\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606319    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-tls-assets\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606368    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606400    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-config-volume\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606886 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606472    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-web-config\") pod \"61a4c404-5417-4723-a1a6-c05053fad816\" (UID: \"61a4c404-5417-4723-a1a6-c05053fad816\") "
Jul 06 21:24:18.606886 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606690    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:24:18.606886 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.606858    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:24:18.607065 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.607044    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:24:18.609263 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.609069    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:24:18.609474 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.609448    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-config-out" (OuterVolumeSpecName: "config-out") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:24:18.609572 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.609493    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:24:18.609733 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.609700    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:24:18.609840 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.609800    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-kube-api-access-dhr8n" (OuterVolumeSpecName: "kube-api-access-dhr8n") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "kube-api-access-dhr8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:24:18.610110 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.610082    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:24:18.610110 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.610107    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-config-volume" (OuterVolumeSpecName: "config-volume") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:24:18.611020 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.611001    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:24:18.615022 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.614846    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:24:18.619773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.619751    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-web-config" (OuterVolumeSpecName: "web-config") pod "61a4c404-5417-4723-a1a6-c05053fad816" (UID: "61a4c404-5417-4723-a1a6-c05053fad816"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:24:18.707244 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707212    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707244 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707240    2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-config-volume\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707244 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707251    2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-web-config\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707261    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-main-tls\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707269    2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-config-out\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707278    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707287    2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707295    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707303    2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61a4c404-5417-4723-a1a6-c05053fad816-cluster-tls-config\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707312    2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61a4c404-5417-4723-a1a6-c05053fad816-alertmanager-main-db\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707320    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhr8n\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-kube-api-access-dhr8n\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707329    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61a4c404-5417-4723-a1a6-c05053fad816-metrics-client-ca\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.707458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.707337    2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61a4c404-5417-4723-a1a6-c05053fad816-tls-assets\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:24:18.841771 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.841742    2554 generic.go:356] "Generic (PLEG): container finished" podID="61a4c404-5417-4723-a1a6-c05053fad816" containerID="dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2" exitCode=0
Jul 06 21:24:18.841771 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.841765    2554 generic.go:356] "Generic (PLEG): container finished" podID="61a4c404-5417-4723-a1a6-c05053fad816" containerID="05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc" exitCode=0
Jul 06 21:24:18.841951 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.841822    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:18.841951 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.841822    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerDied","Data":"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2"}
Jul 06 21:24:18.841951 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.841894    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerDied","Data":"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc"}
Jul 06 21:24:18.841951 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.841924    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61a4c404-5417-4723-a1a6-c05053fad816","Type":"ContainerDied","Data":"9b9805118c7eebb2038fe4b2f1de7a51f1710631a9d48e40daf3ae09bcf2ded8"}
Jul 06 21:24:18.842075 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.841966    2554 scope.go:117] "RemoveContainer" containerID="90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f"
Jul 06 21:24:18.850065 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.849904    2554 scope.go:117] "RemoveContainer" containerID="dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2"
Jul 06 21:24:18.857203 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.857186    2554 scope.go:117] "RemoveContainer" containerID="4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d"
Jul 06 21:24:18.867221 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.867197    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:24:18.869710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.869691    2554 scope.go:117] "RemoveContainer" containerID="05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc"
Jul 06 21:24:18.874884 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.874860    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:24:18.877031 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.877015    2554 scope.go:117] "RemoveContainer" containerID="7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53"
Jul 06 21:24:18.884125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.884104    2554 scope.go:117] "RemoveContainer" containerID="cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a"
Jul 06 21:24:18.891498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.891479    2554 scope.go:117] "RemoveContainer" containerID="9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b"
Jul 06 21:24:18.900118 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.900092    2554 scope.go:117] "RemoveContainer" containerID="90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f"
Jul 06 21:24:18.900620 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:24:18.900583    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f\": container with ID starting with 90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f not found: ID does not exist" containerID="90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f"
Jul 06 21:24:18.900713 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.900631    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f"} err="failed to get container status \"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f\": rpc error: code = NotFound desc = could not find container \"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f\": container with ID starting with 90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f not found: ID does not exist"
Jul 06 21:24:18.900713 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.900657    2554 scope.go:117] "RemoveContainer" containerID="dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2"
Jul 06 21:24:18.900935 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:24:18.900917    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2\": container with ID starting with dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2 not found: ID does not exist" containerID="dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2"
Jul 06 21:24:18.900975 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.900941    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2"} err="failed to get container status \"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2\": rpc error: code = NotFound desc = could not find container \"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2\": container with ID starting with dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2 not found: ID does not exist"
Jul 06 21:24:18.900975 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.900958    2554 scope.go:117] "RemoveContainer" containerID="4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d"
Jul 06 21:24:18.901198 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:24:18.901182    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d\": container with ID starting with 4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d not found: ID does not exist" containerID="4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d"
Jul 06 21:24:18.901244 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.901203    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d"} err="failed to get container status \"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d\": rpc error: code = NotFound desc = could not find container \"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d\": container with ID starting with 4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d not found: ID does not exist"
Jul 06 21:24:18.901244 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.901217    2554 scope.go:117] "RemoveContainer" containerID="05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc"
Jul 06 21:24:18.901474 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:24:18.901460    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc\": container with ID starting with 05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc not found: ID does not exist" containerID="05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc"
Jul 06 21:24:18.901525 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.901477    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc"} err="failed to get container status \"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc\": rpc error: code = NotFound desc = could not find container \"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc\": container with ID starting with 05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc not found: ID does not exist"
Jul 06 21:24:18.901525 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.901488    2554 scope.go:117] "RemoveContainer" containerID="7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53"
Jul 06 21:24:18.901726 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:24:18.901709    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53\": container with ID starting with 7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53 not found: ID does not exist" containerID="7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53"
Jul 06 21:24:18.901769 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.901730    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53"} err="failed to get container status \"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53\": rpc error: code = NotFound desc = could not find container \"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53\": container with ID starting with 7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53 not found: ID does not exist"
Jul 06 21:24:18.901769 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.901742    2554 scope.go:117] "RemoveContainer" containerID="cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a"
Jul 06 21:24:18.901963 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:24:18.901946    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a\": container with ID starting with cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a not found: ID does not exist" containerID="cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a"
Jul 06 21:24:18.902004 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.901968    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a"} err="failed to get container status \"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a\": rpc error: code = NotFound desc = could not find container \"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a\": container with ID starting with cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a not found: ID does not exist"
Jul 06 21:24:18.902004 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.901980    2554 scope.go:117] "RemoveContainer" containerID="9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b"
Jul 06 21:24:18.902184 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:24:18.902168    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b\": container with ID starting with 9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b not found: ID does not exist" containerID="9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b"
Jul 06 21:24:18.902225 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902187    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b"} err="failed to get container status \"9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b\": rpc error: code = NotFound desc = could not find container \"9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b\": container with ID starting with 9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b not found: ID does not exist"
Jul 06 21:24:18.902225 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902199    2554 scope.go:117] "RemoveContainer" containerID="90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f"
Jul 06 21:24:18.902420 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902403    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f"} err="failed to get container status \"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f\": rpc error: code = NotFound desc = could not find container \"90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f\": container with ID starting with 90271a14cc1d1927e2cd0f6b5922b1853c7c536fd302cef4f77f44bd9e7d086f not found: ID does not exist"
Jul 06 21:24:18.902473 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902420    2554 scope.go:117] "RemoveContainer" containerID="dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2"
Jul 06 21:24:18.902638 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902623    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2"} err="failed to get container status \"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2\": rpc error: code = NotFound desc = could not find container \"dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2\": container with ID starting with dac9c9cb5779dabebc4e9d5551a916db538f613515a3e801c0b0ac65adce03f2 not found: ID does not exist"
Jul 06 21:24:18.902685 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902640    2554 scope.go:117] "RemoveContainer" containerID="4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d"
Jul 06 21:24:18.902823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902810    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d"} err="failed to get container status \"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d\": rpc error: code = NotFound desc = could not find container \"4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d\": container with ID starting with 4cffadf72179393e668dcc800e50a27a6aea0ae494020d7f650132e373d7744d not found: ID does not exist"
Jul 06 21:24:18.902862 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902824    2554 scope.go:117] "RemoveContainer" containerID="05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc"
Jul 06 21:24:18.903000 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.902985    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc"} err="failed to get container status \"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc\": rpc error: code = NotFound desc = could not find container \"05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc\": container with ID starting with 05cb07acd187a96a3d59a5ff3f36f1b1c872635dd75081140fde09361ce5d1fc not found: ID does not exist"
Jul 06 21:24:18.903039 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.903000    2554 scope.go:117] "RemoveContainer" containerID="7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53"
Jul 06 21:24:18.903169 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.903155    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53"} err="failed to get container status \"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53\": rpc error: code = NotFound desc = could not find container \"7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53\": container with ID starting with 7f8ee4211c3b301aec9b4368e0e41d5e3809588e52ea7735d634932836aadb53 not found: ID does not exist"
Jul 06 21:24:18.903209 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.903169    2554 scope.go:117] "RemoveContainer" containerID="cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a"
Jul 06 21:24:18.903340 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.903325    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a"} err="failed to get container status \"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a\": rpc error: code = NotFound desc = could not find container \"cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a\": container with ID starting with cd0b199775d5ec602c65cf033d54e4a6efae3abbba63d5b135bc76001873765a not found: ID does not exist"
Jul 06 21:24:18.903382 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.903340    2554 scope.go:117] "RemoveContainer" containerID="9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b"
Jul 06 21:24:18.903572 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.903550    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b"} err="failed to get container status \"9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b\": rpc error: code = NotFound desc = could not find container \"9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b\": container with ID starting with 9d2c3570b1f32caeb765b377d7d787aa468308e35e71f51f9239522d9831c67b not found: ID does not exist"
Jul 06 21:24:18.910717 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.910693    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:24:18.911053 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911037    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="alertmanager"
Jul 06 21:24:18.911128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911056    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="alertmanager"
Jul 06 21:24:18.911128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911078    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8877a576-935c-4e31-9f4a-da3429986f86" containerName="registry"
Jul 06 21:24:18.911128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911087    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8877a576-935c-4e31-9f4a-da3429986f86" containerName="registry"
Jul 06 21:24:18.911128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911098    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy-web"
Jul 06 21:24:18.911128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911107    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy-web"
Jul 06 21:24:18.911128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911118    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy"
Jul 06 21:24:18.911128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911126    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911146    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy-metric"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911154    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy-metric"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911166    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="init-config-reloader"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911174    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="init-config-reloader"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911184    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="config-reloader"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911192    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="config-reloader"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911207    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="prom-label-proxy"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911216    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="prom-label-proxy"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911295    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8877a576-935c-4e31-9f4a-da3429986f86" containerName="registry"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911307    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911316    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="prom-label-proxy"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911325    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="config-reloader"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911337    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy-web"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911347    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="alertmanager"
Jul 06 21:24:18.911468 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.911355    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="61a4c404-5417-4723-a1a6-c05053fad816" containerName="kube-rbac-proxy-metric"
Jul 06 21:24:18.916732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.916713    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:18.919587 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.919568    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-spc4z\""
Jul 06 21:24:18.919660 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.919568    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 21:24:18.921388 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.921372    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 21:24:18.921506 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.921422    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 21:24:18.921506 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.921476    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 21:24:18.921678 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.921513    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 21:24:18.921757 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.921721    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 21:24:18.922400 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.922382    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 21:24:18.922501 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.922484    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 21:24:18.927957 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.927941    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 21:24:18.938844 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:18.938818    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:24:19.009577 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009545    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkb2r\" (UniqueName: \"kubernetes.io/projected/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-kube-api-access-vkb2r\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.009577 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009579    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.009823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009605    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.009823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009624    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-web-config\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.009823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009681    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.009823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009772    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-config-out\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.009823 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009808    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.010052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009862    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.010052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009892    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.010052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009932    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.010052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009958    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.010052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.009986    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.010216 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.010052    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.110992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.110902    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.110992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.110948    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.110992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.110974    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111294 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111206    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111294 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111247    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkb2r\" (UniqueName: \"kubernetes.io/projected/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-kube-api-access-vkb2r\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111294 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111301    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111333    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111367    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-web-config\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111402    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111459    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-config-out\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111482    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111759 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111530    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.111759 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.111556    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.112167 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.112058    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.114148 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.113901    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.114148 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.114083    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.114148 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.114085    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.114367 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.114175    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.114427 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.114363    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-web-config\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.114427 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.114387    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.114682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.114662    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.114756 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.114737    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.115545 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.115519    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.116098 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.116079    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-config-out\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.120168 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.120151    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkb2r\" (UniqueName: \"kubernetes.io/projected/31287881-e9e1-48e2-8a1b-fc32a31ad3c5-kube-api-access-vkb2r\") pod \"alertmanager-main-0\" (UID: \"31287881-e9e1-48e2-8a1b-fc32a31ad3c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.227217 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.227185    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 21:24:19.367890 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.367865    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 21:24:19.370447 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:24:19.370401    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31287881_e9e1_48e2_8a1b_fc32a31ad3c5.slice/crio-9a635a9883a1c8c3c5b71948f3b49f34a9a4207aa0014f73ace6fdb7c301e4ca WatchSource:0}: Error finding container 9a635a9883a1c8c3c5b71948f3b49f34a9a4207aa0014f73ace6fdb7c301e4ca: Status 404 returned error can't find the container with id 9a635a9883a1c8c3c5b71948f3b49f34a9a4207aa0014f73ace6fdb7c301e4ca
Jul 06 21:24:19.847999 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.847964    2554 generic.go:356] "Generic (PLEG): container finished" podID="31287881-e9e1-48e2-8a1b-fc32a31ad3c5" containerID="a35aa6418e658ca9733aae1c5a5cbc7ce99cbc97469a962f8858090f55d8e234" exitCode=0
Jul 06 21:24:19.848369 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.848031    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31287881-e9e1-48e2-8a1b-fc32a31ad3c5","Type":"ContainerDied","Data":"a35aa6418e658ca9733aae1c5a5cbc7ce99cbc97469a962f8858090f55d8e234"}
Jul 06 21:24:19.848369 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.848099    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31287881-e9e1-48e2-8a1b-fc32a31ad3c5","Type":"ContainerStarted","Data":"9a635a9883a1c8c3c5b71948f3b49f34a9a4207aa0014f73ace6fdb7c301e4ca"}
Jul 06 21:24:19.986862 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:19.986805    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61a4c404-5417-4723-a1a6-c05053fad816" path="/var/lib/kubelet/pods/61a4c404-5417-4723-a1a6-c05053fad816/volumes"
Jul 06 21:24:20.860360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:20.860323    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31287881-e9e1-48e2-8a1b-fc32a31ad3c5","Type":"ContainerStarted","Data":"e23e1fee2a2954ff2bbf2821888ced49e5d116d9728c92802b69742ea962cc92"}
Jul 06 21:24:20.860820 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:20.860421    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31287881-e9e1-48e2-8a1b-fc32a31ad3c5","Type":"ContainerStarted","Data":"d6ef48b1354932c82f383449dcd071054aa977b4ca0504efba74d14b52019e3e"}
Jul 06 21:24:20.860820 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:20.860477    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31287881-e9e1-48e2-8a1b-fc32a31ad3c5","Type":"ContainerStarted","Data":"d92f50ccfc79b639e3b8a5dc13c4a6777d543631d538a498ea4453de2c26cf58"}
Jul 06 21:24:20.860820 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:20.860504    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31287881-e9e1-48e2-8a1b-fc32a31ad3c5","Type":"ContainerStarted","Data":"5ced4143995930dc228683ec46987c2d4b57927c23d131ecd6585ebdb080dcec"}
Jul 06 21:24:20.860820 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:20.860528    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31287881-e9e1-48e2-8a1b-fc32a31ad3c5","Type":"ContainerStarted","Data":"9a485116b0700c9e1c8aed116a3efd8251f16813e25589ce366d5cbaa9fcf583"}
Jul 06 21:24:20.860820 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:20.860563    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31287881-e9e1-48e2-8a1b-fc32a31ad3c5","Type":"ContainerStarted","Data":"2ecb8bdca9fb096a0a9ed28aeeedb6b647d2bd2f989a78544c4acf0f711dcd47"}
Jul 06 21:24:20.897041 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:24:20.896990    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.877922612 podStartE2EDuration="2.896974253s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.051641ms" isStatefulPod=false podCreationTimestamp="2026-07-06 21:24:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:24:20.894051798 +0000 UTC m=+169.515634114" watchObservedRunningTime="2026-07-06 21:24:20.896974253 +0000 UTC m=+169.518556563"
Jul 06 21:25:02.007470 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.007422    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"]
Jul 06 21:25:02.010812 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.010796    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.014990 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.014951    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 21:25:02.014990 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.014954    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 21:25:02.015849 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.015835    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rrpw2\""
Jul 06 21:25:02.023755 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.023732    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"]
Jul 06 21:25:02.063015 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.062983    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.063172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.063053    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mdns\" (UniqueName: \"kubernetes.io/projected/3221e129-71de-4a70-89d7-9fae2bc9da4e-kube-api-access-7mdns\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.063248 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.063226    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.164402 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.164362    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.164598 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.164457    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mdns\" (UniqueName: \"kubernetes.io/projected/3221e129-71de-4a70-89d7-9fae2bc9da4e-kube-api-access-7mdns\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.164598 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.164512    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.164774 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.164754    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.164808 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.164794    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.173738 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.173708    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mdns\" (UniqueName: \"kubernetes.io/projected/3221e129-71de-4a70-89d7-9fae2bc9da4e-kube-api-access-7mdns\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.319505 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.319420    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:02.458871 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:02.458847    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"]
Jul 06 21:25:02.461271 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:25:02.461245    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3221e129_71de_4a70_89d7_9fae2bc9da4e.slice/crio-f31eccd4b5fc73b3859ef44ff876c00e0eb91c413add925305cae01bf8b445a9 WatchSource:0}: Error finding container f31eccd4b5fc73b3859ef44ff876c00e0eb91c413add925305cae01bf8b445a9: Status 404 returned error can't find the container with id f31eccd4b5fc73b3859ef44ff876c00e0eb91c413add925305cae01bf8b445a9
Jul 06 21:25:03.028086 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:03.028051    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj" event={"ID":"3221e129-71de-4a70-89d7-9fae2bc9da4e","Type":"ContainerStarted","Data":"f31eccd4b5fc73b3859ef44ff876c00e0eb91c413add925305cae01bf8b445a9"}
Jul 06 21:25:10.059724 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:10.059626    2554 generic.go:356] "Generic (PLEG): container finished" podID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerID="c175f20481ba6ef623d261f7aacd8f6b9c9ce3a082a6d63a1d78c0564541ae8e" exitCode=0
Jul 06 21:25:10.059724 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:10.059695    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj" event={"ID":"3221e129-71de-4a70-89d7-9fae2bc9da4e","Type":"ContainerDied","Data":"c175f20481ba6ef623d261f7aacd8f6b9c9ce3a082a6d63a1d78c0564541ae8e"}
Jul 06 21:25:13.076185 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:13.076149    2554 generic.go:356] "Generic (PLEG): container finished" podID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerID="714d5cbaaf371954ce3f9accb30f57dd125af408b115408132516e5024f1db55" exitCode=0
Jul 06 21:25:13.076185 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:13.076187    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj" event={"ID":"3221e129-71de-4a70-89d7-9fae2bc9da4e","Type":"ContainerDied","Data":"714d5cbaaf371954ce3f9accb30f57dd125af408b115408132516e5024f1db55"}
Jul 06 21:25:21.118141 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:21.118049    2554 generic.go:356] "Generic (PLEG): container finished" podID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerID="fef5954134bad56252d1bdee08ddd425256ddf239d2a418c12574eb789d2cda9" exitCode=0
Jul 06 21:25:21.118141 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:21.118107    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj" event={"ID":"3221e129-71de-4a70-89d7-9fae2bc9da4e","Type":"ContainerDied","Data":"fef5954134bad56252d1bdee08ddd425256ddf239d2a418c12574eb789d2cda9"}
Jul 06 21:25:22.246593 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.246565    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:22.336414 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.336380    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-bundle\") pod \"3221e129-71de-4a70-89d7-9fae2bc9da4e\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") "
Jul 06 21:25:22.336603 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.336468    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-util\") pod \"3221e129-71de-4a70-89d7-9fae2bc9da4e\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") "
Jul 06 21:25:22.336603 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.336527    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mdns\" (UniqueName: \"kubernetes.io/projected/3221e129-71de-4a70-89d7-9fae2bc9da4e-kube-api-access-7mdns\") pod \"3221e129-71de-4a70-89d7-9fae2bc9da4e\" (UID: \"3221e129-71de-4a70-89d7-9fae2bc9da4e\") "
Jul 06 21:25:22.337095 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.337072    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-bundle" (OuterVolumeSpecName: "bundle") pod "3221e129-71de-4a70-89d7-9fae2bc9da4e" (UID: "3221e129-71de-4a70-89d7-9fae2bc9da4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:25:22.338720 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.338695    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3221e129-71de-4a70-89d7-9fae2bc9da4e-kube-api-access-7mdns" (OuterVolumeSpecName: "kube-api-access-7mdns") pod "3221e129-71de-4a70-89d7-9fae2bc9da4e" (UID: "3221e129-71de-4a70-89d7-9fae2bc9da4e"). InnerVolumeSpecName "kube-api-access-7mdns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:25:22.340988 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.340963    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-util" (OuterVolumeSpecName: "util") pod "3221e129-71de-4a70-89d7-9fae2bc9da4e" (UID: "3221e129-71de-4a70-89d7-9fae2bc9da4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:25:22.437262 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.437173    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-util\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:22.437262 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.437231    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mdns\" (UniqueName: \"kubernetes.io/projected/3221e129-71de-4a70-89d7-9fae2bc9da4e-kube-api-access-7mdns\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:22.437262 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:22.437241    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3221e129-71de-4a70-89d7-9fae2bc9da4e-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:23.127854 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:23.127818    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj" event={"ID":"3221e129-71de-4a70-89d7-9fae2bc9da4e","Type":"ContainerDied","Data":"f31eccd4b5fc73b3859ef44ff876c00e0eb91c413add925305cae01bf8b445a9"}
Jul 06 21:25:23.128025 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:23.127865    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f31eccd4b5fc73b3859ef44ff876c00e0eb91c413add925305cae01bf8b445a9"
Jul 06 21:25:23.128025 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:23.127863    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540d5skj"
Jul 06 21:25:35.113250 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.113215    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"]
Jul 06 21:25:35.113732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.113532    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerName="extract"
Jul 06 21:25:35.113732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.113543    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerName="extract"
Jul 06 21:25:35.113732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.113565    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerName="util"
Jul 06 21:25:35.113732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.113570    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerName="util"
Jul 06 21:25:35.113732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.113577    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerName="pull"
Jul 06 21:25:35.113732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.113582    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerName="pull"
Jul 06 21:25:35.113732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.113633    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3221e129-71de-4a70-89d7-9fae2bc9da4e" containerName="extract"
Jul 06 21:25:35.117629 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.117606    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.118542 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.118516    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5gbn5"]
Jul 06 21:25:35.120384 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.120364    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:35.123866 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:25:35.123825    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" podUID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.124308 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.124174    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 21:25:35.124762 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.124747    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 21:25:35.127457 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.127424    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rrpw2\""
Jul 06 21:25:35.128178 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:25:35.128157    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 06 21:25:35.129051 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:25:35.129018    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-133-11.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-133-11.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 06 21:25:35.136682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.136660    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"]
Jul 06 21:25:35.139974 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.139953    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5gbn5"]
Jul 06 21:25:35.246010 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.245977    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4lbc\" (UniqueName: \"kubernetes.io/projected/20a04547-c690-4c43-9a9f-2605d0e7b4b4-kube-api-access-v4lbc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.246167 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.246021    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.246167 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.246045    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.246167 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.246093    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74qjs\" (UniqueName: \"kubernetes.io/projected/cb7a2869-a6a0-4761-9a3f-bc64ff10d19e-kube-api-access-74qjs\") pod \"cert-manager-webhook-6486ffd997-5gbn5\" (UID: \"cb7a2869-a6a0-4761-9a3f-bc64ff10d19e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:35.246167 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.246117    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb7a2869-a6a0-4761-9a3f-bc64ff10d19e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5gbn5\" (UID: \"cb7a2869-a6a0-4761-9a3f-bc64ff10d19e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:35.347404 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.347373    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb7a2869-a6a0-4761-9a3f-bc64ff10d19e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5gbn5\" (UID: \"cb7a2869-a6a0-4761-9a3f-bc64ff10d19e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:35.347614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.347464    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4lbc\" (UniqueName: \"kubernetes.io/projected/20a04547-c690-4c43-9a9f-2605d0e7b4b4-kube-api-access-v4lbc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.347614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.347498    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.347614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.347526    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.347614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.347565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74qjs\" (UniqueName: \"kubernetes.io/projected/cb7a2869-a6a0-4761-9a3f-bc64ff10d19e-kube-api-access-74qjs\") pod \"cert-manager-webhook-6486ffd997-5gbn5\" (UID: \"cb7a2869-a6a0-4761-9a3f-bc64ff10d19e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:35.348012 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.347985    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.348079 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.347992    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.371408 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.371338    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4lbc\" (UniqueName: \"kubernetes.io/projected/20a04547-c690-4c43-9a9f-2605d0e7b4b4-kube-api-access-v4lbc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.375608 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.375585    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb7a2869-a6a0-4761-9a3f-bc64ff10d19e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5gbn5\" (UID: \"cb7a2869-a6a0-4761-9a3f-bc64ff10d19e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:35.427711 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.427681    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:35.565871 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:35.565849    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"]
Jul 06 21:25:35.568379 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:25:35.568350    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a04547_c690_4c43_9a9f_2605d0e7b4b4.slice/crio-6fc90fd305ca54cfdf2994982250a2b18bc41affe55f1bfea8c356f3b18bac54 WatchSource:0}: Error finding container 6fc90fd305ca54cfdf2994982250a2b18bc41affe55f1bfea8c356f3b18bac54: Status 404 returned error can't find the container with id 6fc90fd305ca54cfdf2994982250a2b18bc41affe55f1bfea8c356f3b18bac54
Jul 06 21:25:36.177570 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:36.177533    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 21:25:36.179083 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:36.179060    2554 generic.go:356] "Generic (PLEG): container finished" podID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerID="6ff0f132575a74321e894c20a176595bb55f6736bd7f2c8934ee7543c1f1bd19" exitCode=0
Jul 06 21:25:36.179200 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:36.179115    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq" event={"ID":"20a04547-c690-4c43-9a9f-2605d0e7b4b4","Type":"ContainerDied","Data":"6ff0f132575a74321e894c20a176595bb55f6736bd7f2c8934ee7543c1f1bd19"}
Jul 06 21:25:36.179200 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:36.179151    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq" event={"ID":"20a04547-c690-4c43-9a9f-2605d0e7b4b4","Type":"ContainerStarted","Data":"6fc90fd305ca54cfdf2994982250a2b18bc41affe55f1bfea8c356f3b18bac54"}
Jul 06 21:25:36.339588 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:36.339561    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 21:25:36.345511 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:36.345494    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74qjs\" (UniqueName: \"kubernetes.io/projected/cb7a2869-a6a0-4761-9a3f-bc64ff10d19e-kube-api-access-74qjs\") pod \"cert-manager-webhook-6486ffd997-5gbn5\" (UID: \"cb7a2869-a6a0-4761-9a3f-bc64ff10d19e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:36.643852 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:36.643813    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:36.775572 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:36.775550    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5gbn5"]
Jul 06 21:25:36.778211 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:25:36.778186    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb7a2869_a6a0_4761_9a3f_bc64ff10d19e.slice/crio-4d91ec10773c0798b68b69016acf0b0be56f484e465b9fe7af2fa20dc9a021e2 WatchSource:0}: Error finding container 4d91ec10773c0798b68b69016acf0b0be56f484e465b9fe7af2fa20dc9a021e2: Status 404 returned error can't find the container with id 4d91ec10773c0798b68b69016acf0b0be56f484e465b9fe7af2fa20dc9a021e2
Jul 06 21:25:37.185136 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:37.185104    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5" event={"ID":"cb7a2869-a6a0-4761-9a3f-bc64ff10d19e","Type":"ContainerStarted","Data":"4d91ec10773c0798b68b69016acf0b0be56f484e465b9fe7af2fa20dc9a021e2"}
Jul 06 21:25:39.196571 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:39.196531    2554 generic.go:356] "Generic (PLEG): container finished" podID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerID="341a21b83c2a6d9617a5ae443bace8a3da547b02db0e5d9360acec98427f766d" exitCode=0
Jul 06 21:25:39.197002 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:39.196574    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq" event={"ID":"20a04547-c690-4c43-9a9f-2605d0e7b4b4","Type":"ContainerDied","Data":"341a21b83c2a6d9617a5ae443bace8a3da547b02db0e5d9360acec98427f766d"}
Jul 06 21:25:40.203349 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:40.203316    2554 generic.go:356] "Generic (PLEG): container finished" podID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerID="ff61c7f2af9f5ba6b13f9cfc1a4b3da77e248af82607adcc031c7a5e0df7a0a9" exitCode=0
Jul 06 21:25:40.203784 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:40.203397    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq" event={"ID":"20a04547-c690-4c43-9a9f-2605d0e7b4b4","Type":"ContainerDied","Data":"ff61c7f2af9f5ba6b13f9cfc1a4b3da77e248af82607adcc031c7a5e0df7a0a9"}
Jul 06 21:25:41.210180 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.210147    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5" event={"ID":"cb7a2869-a6a0-4761-9a3f-bc64ff10d19e","Type":"ContainerStarted","Data":"9683c22457c42f1d1f5805063a37a0513475fbd9c3dd150bd65a8d63c4217ae2"}
Jul 06 21:25:41.210637 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.210247    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:41.232585 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.232505    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5" podStartSLOduration=2.719207814 podStartE2EDuration="6.232487777s" totalImagesPullingTime="3.513279963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:25:41.230810565 +0000 UTC m=+249.852392882" watchObservedRunningTime="2026-07-06 21:25:41.232487777 +0000 UTC m=+249.854070094"
Jul 06 21:25:41.332557 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.332532    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:41.502235 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.502205    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-util\") pod \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") "
Jul 06 21:25:41.502385 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.502263    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4lbc\" (UniqueName: \"kubernetes.io/projected/20a04547-c690-4c43-9a9f-2605d0e7b4b4-kube-api-access-v4lbc\") pod \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") "
Jul 06 21:25:41.502385 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.502283    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-bundle\") pod \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\" (UID: \"20a04547-c690-4c43-9a9f-2605d0e7b4b4\") "
Jul 06 21:25:41.502694 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.502669    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-bundle" (OuterVolumeSpecName: "bundle") pod "20a04547-c690-4c43-9a9f-2605d0e7b4b4" (UID: "20a04547-c690-4c43-9a9f-2605d0e7b4b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:25:41.504374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.504347    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a04547-c690-4c43-9a9f-2605d0e7b4b4-kube-api-access-v4lbc" (OuterVolumeSpecName: "kube-api-access-v4lbc") pod "20a04547-c690-4c43-9a9f-2605d0e7b4b4" (UID: "20a04547-c690-4c43-9a9f-2605d0e7b4b4"). InnerVolumeSpecName "kube-api-access-v4lbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:25:41.506950 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.506926    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-util" (OuterVolumeSpecName: "util") pod "20a04547-c690-4c43-9a9f-2605d0e7b4b4" (UID: "20a04547-c690-4c43-9a9f-2605d0e7b4b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:25:41.602956 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.602924    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-util\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:41.602956 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.602952    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4lbc\" (UniqueName: \"kubernetes.io/projected/20a04547-c690-4c43-9a9f-2605d0e7b4b4-kube-api-access-v4lbc\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:41.603170 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:41.602966    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20a04547-c690-4c43-9a9f-2605d0e7b4b4-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:42.216925 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:42.216900    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq"
Jul 06 21:25:42.217289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:42.216932    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnxtvq" event={"ID":"20a04547-c690-4c43-9a9f-2605d0e7b4b4","Type":"ContainerDied","Data":"6fc90fd305ca54cfdf2994982250a2b18bc41affe55f1bfea8c356f3b18bac54"}
Jul 06 21:25:42.217289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:42.216974    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fc90fd305ca54cfdf2994982250a2b18bc41affe55f1bfea8c356f3b18bac54"
Jul 06 21:25:47.219817 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.219786    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5gbn5"
Jul 06 21:25:47.720347 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.720314    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"]
Jul 06 21:25:47.720653 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.720641    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerName="extract"
Jul 06 21:25:47.720710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.720664    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerName="extract"
Jul 06 21:25:47.720710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.720682    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerName="pull"
Jul 06 21:25:47.720710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.720687    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerName="pull"
Jul 06 21:25:47.720710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.720694    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerName="util"
Jul 06 21:25:47.720710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.720699    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerName="util"
Jul 06 21:25:47.720880 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.720752    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="20a04547-c690-4c43-9a9f-2605d0e7b4b4" containerName="extract"
Jul 06 21:25:47.722676 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.722662    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"
Jul 06 21:25:47.725316 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.725294    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:25:47.726326 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.726307    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 21:25:47.726420 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.726332    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mblzh\""
Jul 06 21:25:47.734113 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.734092    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"]
Jul 06 21:25:47.751665 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.751623    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507fefc2-02cd-4976-9708-23fa0efc50d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mtvw8\" (UID: \"507fefc2-02cd-4976-9708-23fa0efc50d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"
Jul 06 21:25:47.751801 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.751723    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdsp7\" (UniqueName: \"kubernetes.io/projected/507fefc2-02cd-4976-9708-23fa0efc50d5-kube-api-access-kdsp7\") pod \"openshift-lws-operator-fd8ccff4c-mtvw8\" (UID: \"507fefc2-02cd-4976-9708-23fa0efc50d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"
Jul 06 21:25:47.852359 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.852327    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdsp7\" (UniqueName: \"kubernetes.io/projected/507fefc2-02cd-4976-9708-23fa0efc50d5-kube-api-access-kdsp7\") pod \"openshift-lws-operator-fd8ccff4c-mtvw8\" (UID: \"507fefc2-02cd-4976-9708-23fa0efc50d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"
Jul 06 21:25:47.852572 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.852405    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507fefc2-02cd-4976-9708-23fa0efc50d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mtvw8\" (UID: \"507fefc2-02cd-4976-9708-23fa0efc50d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"
Jul 06 21:25:47.852844 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.852825    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507fefc2-02cd-4976-9708-23fa0efc50d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mtvw8\" (UID: \"507fefc2-02cd-4976-9708-23fa0efc50d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"
Jul 06 21:25:47.863638 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:47.863615    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdsp7\" (UniqueName: \"kubernetes.io/projected/507fefc2-02cd-4976-9708-23fa0efc50d5-kube-api-access-kdsp7\") pod \"openshift-lws-operator-fd8ccff4c-mtvw8\" (UID: \"507fefc2-02cd-4976-9708-23fa0efc50d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"
Jul 06 21:25:48.031973 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:48.031942    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"
Jul 06 21:25:48.153397 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:48.153367    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8"]
Jul 06 21:25:48.156990 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:25:48.156968    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod507fefc2_02cd_4976_9708_23fa0efc50d5.slice/crio-c312c0700d72a084efd158a3646d793da6ace04ea8397c96c96c7ebae26a24a7 WatchSource:0}: Error finding container c312c0700d72a084efd158a3646d793da6ace04ea8397c96c96c7ebae26a24a7: Status 404 returned error can't find the container with id c312c0700d72a084efd158a3646d793da6ace04ea8397c96c96c7ebae26a24a7
Jul 06 21:25:48.241473 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:48.241422    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8" event={"ID":"507fefc2-02cd-4976-9708-23fa0efc50d5","Type":"ContainerStarted","Data":"c312c0700d72a084efd158a3646d793da6ace04ea8397c96c96c7ebae26a24a7"}
Jul 06 21:25:50.252487 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:50.252452    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8" event={"ID":"507fefc2-02cd-4976-9708-23fa0efc50d5","Type":"ContainerStarted","Data":"2690c1f2ce17b7572bde6d4b7147c92b2e82023b8ddd35eff9ee80e88a0a43e0"}
Jul 06 21:25:50.270873 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:50.270823    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mtvw8" podStartSLOduration=1.2735035670000001 podStartE2EDuration="3.270807821s" totalImagesPullingTime="1.997304254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:25:50.269257709 +0000 UTC m=+258.890840024" watchObservedRunningTime="2026-07-06 21:25:50.270807821 +0000 UTC m=+258.892390138"
Jul 06 21:25:52.960537 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.960506    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"]
Jul 06 21:25:52.963978 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.963956    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:52.966962 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.966941    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 06 21:25:52.967889 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.967871    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 06 21:25:52.967986 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.967891    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rrpw2\""
Jul 06 21:25:52.978677 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.978047    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"]
Jul 06 21:25:52.999189 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.999152    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:52.999360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.999248    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:52.999360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:52.999308    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz87j\" (UniqueName: \"kubernetes.io/projected/ece47dcc-1e87-446b-911b-13633481ae5d-kube-api-access-wz87j\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:53.100074 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:53.099988    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:53.100074 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:53.100060    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:53.100276 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:53.100104    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz87j\" (UniqueName: \"kubernetes.io/projected/ece47dcc-1e87-446b-911b-13633481ae5d-kube-api-access-wz87j\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:53.100403 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:53.100369    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:53.100477 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:53.100397    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:53.110410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:53.110386    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz87j\" (UniqueName: \"kubernetes.io/projected/ece47dcc-1e87-446b-911b-13633481ae5d-kube-api-access-wz87j\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:53.273804 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:53.273776    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:53.424601 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:53.424489    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"]
Jul 06 21:25:53.426644 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:25:53.426616    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece47dcc_1e87_446b_911b_13633481ae5d.slice/crio-f31304e17a61ddfbe31f302f2951a27ab1bdaddfe0c6cf79203def2f615aedbf WatchSource:0}: Error finding container f31304e17a61ddfbe31f302f2951a27ab1bdaddfe0c6cf79203def2f615aedbf: Status 404 returned error can't find the container with id f31304e17a61ddfbe31f302f2951a27ab1bdaddfe0c6cf79203def2f615aedbf
Jul 06 21:25:54.271550 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:54.271517    2554 generic.go:356] "Generic (PLEG): container finished" podID="ece47dcc-1e87-446b-911b-13633481ae5d" containerID="f2edc2baacf09275bb891a3a5f69d5d33a327bb541945de956386435fc124613" exitCode=0
Jul 06 21:25:54.271970 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:54.271595    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw" event={"ID":"ece47dcc-1e87-446b-911b-13633481ae5d","Type":"ContainerDied","Data":"f2edc2baacf09275bb891a3a5f69d5d33a327bb541945de956386435fc124613"}
Jul 06 21:25:54.271970 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:54.271641    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw" event={"ID":"ece47dcc-1e87-446b-911b-13633481ae5d","Type":"ContainerStarted","Data":"f31304e17a61ddfbe31f302f2951a27ab1bdaddfe0c6cf79203def2f615aedbf"}
Jul 06 21:25:56.282415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:56.282382    2554 generic.go:356] "Generic (PLEG): container finished" podID="ece47dcc-1e87-446b-911b-13633481ae5d" containerID="1a8a639c99fd43292e6eeb498ebe3e842add16c544501ee6e69a5da36974a096" exitCode=0
Jul 06 21:25:56.282956 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:56.282477    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw" event={"ID":"ece47dcc-1e87-446b-911b-13633481ae5d","Type":"ContainerDied","Data":"1a8a639c99fd43292e6eeb498ebe3e842add16c544501ee6e69a5da36974a096"}
Jul 06 21:25:57.288531 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:57.288499    2554 generic.go:356] "Generic (PLEG): container finished" podID="ece47dcc-1e87-446b-911b-13633481ae5d" containerID="350049d33f7a84dfaddc0138e5fc2763846ccc03928e67018f9b98d3c1a61469" exitCode=0
Jul 06 21:25:57.288911 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:57.288586    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw" event={"ID":"ece47dcc-1e87-446b-911b-13633481ae5d","Type":"ContainerDied","Data":"350049d33f7a84dfaddc0138e5fc2763846ccc03928e67018f9b98d3c1a61469"}
Jul 06 21:25:58.429020 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.428997    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:58.547392 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.547308    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz87j\" (UniqueName: \"kubernetes.io/projected/ece47dcc-1e87-446b-911b-13633481ae5d-kube-api-access-wz87j\") pod \"ece47dcc-1e87-446b-911b-13633481ae5d\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") "
Jul 06 21:25:58.547392 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.547345    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-util\") pod \"ece47dcc-1e87-446b-911b-13633481ae5d\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") "
Jul 06 21:25:58.547392 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.547372    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-bundle\") pod \"ece47dcc-1e87-446b-911b-13633481ae5d\" (UID: \"ece47dcc-1e87-446b-911b-13633481ae5d\") "
Jul 06 21:25:58.548128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.548101    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-bundle" (OuterVolumeSpecName: "bundle") pod "ece47dcc-1e87-446b-911b-13633481ae5d" (UID: "ece47dcc-1e87-446b-911b-13633481ae5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:25:58.549370 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.549339    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ece47dcc-1e87-446b-911b-13633481ae5d-kube-api-access-wz87j" (OuterVolumeSpecName: "kube-api-access-wz87j") pod "ece47dcc-1e87-446b-911b-13633481ae5d" (UID: "ece47dcc-1e87-446b-911b-13633481ae5d"). InnerVolumeSpecName "kube-api-access-wz87j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:25:58.552910 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.552876    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-util" (OuterVolumeSpecName: "util") pod "ece47dcc-1e87-446b-911b-13633481ae5d" (UID: "ece47dcc-1e87-446b-911b-13633481ae5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:25:58.648076 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.648039    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz87j\" (UniqueName: \"kubernetes.io/projected/ece47dcc-1e87-446b-911b-13633481ae5d-kube-api-access-wz87j\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:58.648076 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.648068    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-util\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:58.648076 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:58.648080    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ece47dcc-1e87-446b-911b-13633481ae5d-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:25:59.299231 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:59.299187    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw" event={"ID":"ece47dcc-1e87-446b-911b-13633481ae5d","Type":"ContainerDied","Data":"f31304e17a61ddfbe31f302f2951a27ab1bdaddfe0c6cf79203def2f615aedbf"}
Jul 06 21:25:59.299231 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:59.299217    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affhlpw"
Jul 06 21:25:59.299445 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:25:59.299242    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f31304e17a61ddfbe31f302f2951a27ab1bdaddfe0c6cf79203def2f615aedbf"
Jul 06 21:26:09.965400 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.965351    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"]
Jul 06 21:26:09.966048 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.965882    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece47dcc-1e87-446b-911b-13633481ae5d" containerName="util"
Jul 06 21:26:09.966048 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.965902    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece47dcc-1e87-446b-911b-13633481ae5d" containerName="util"
Jul 06 21:26:09.966048 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.965913    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece47dcc-1e87-446b-911b-13633481ae5d" containerName="extract"
Jul 06 21:26:09.966048 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.965921    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece47dcc-1e87-446b-911b-13633481ae5d" containerName="extract"
Jul 06 21:26:09.966048 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.965935    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ece47dcc-1e87-446b-911b-13633481ae5d" containerName="pull"
Jul 06 21:26:09.966048 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.965943    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ece47dcc-1e87-446b-911b-13633481ae5d" containerName="pull"
Jul 06 21:26:09.966048 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.966027    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ece47dcc-1e87-446b-911b-13633481ae5d" containerName="extract"
Jul 06 21:26:09.968943 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.968920    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:09.972187 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.972163    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 21:26:09.972479 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.972455    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 21:26:09.972607 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.972485    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qmkl2\""
Jul 06 21:26:09.972607 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.972459    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 21:26:09.972607 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.972573    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 21:26:09.992895 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:09.992871    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"]
Jul 06 21:26:10.049129 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.049094    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntjw\" (UniqueName: \"kubernetes.io/projected/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-kube-api-access-rntjw\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.049293 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.049134    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-manifests\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.049293 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.049230    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.049374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.049311    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-webhook-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.049374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.049352    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-tmp\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.150014 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.149981    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.150197 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.150036    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-webhook-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.150197 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.150063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-tmp\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.150197 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.150092    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntjw\" (UniqueName: \"kubernetes.io/projected/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-kube-api-access-rntjw\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.150197 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.150114    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-manifests\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.150613 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.150578    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-manifests\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.152405 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.152371    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-tmp\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.152526 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.152509    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.152610 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.152593    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-webhook-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.169914 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.169879    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntjw\" (UniqueName: \"kubernetes.io/projected/22eb9d8a-e03d-4cf5-823e-e04468a7fbcc-kube-api-access-rntjw\") pod \"opendatahub-operator-controller-manager-757974bfb6-5hmjf\" (UID: \"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.280419 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.280381    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:10.421682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:10.421632    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"]
Jul 06 21:26:10.425674 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:26:10.425649    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22eb9d8a_e03d_4cf5_823e_e04468a7fbcc.slice/crio-19a914b492d867fbe9fc5e27d350f54328c82917b3490c2b871d4c91e6aa7e87 WatchSource:0}: Error finding container 19a914b492d867fbe9fc5e27d350f54328c82917b3490c2b871d4c91e6aa7e87: Status 404 returned error can't find the container with id 19a914b492d867fbe9fc5e27d350f54328c82917b3490c2b871d4c91e6aa7e87
Jul 06 21:26:11.356672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:11.356638    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf" event={"ID":"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc","Type":"ContainerStarted","Data":"19a914b492d867fbe9fc5e27d350f54328c82917b3490c2b871d4c91e6aa7e87"}
Jul 06 21:26:14.374687 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:14.374647    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf" event={"ID":"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc","Type":"ContainerStarted","Data":"b03c92da936ff4c00104dc4b1d9a4643a50ff2dc0828ca9d05d70f3a1b083682"}
Jul 06 21:26:15.381063 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:15.381035    2554 generic.go:356] "Generic (PLEG): container finished" podID="22eb9d8a-e03d-4cf5-823e-e04468a7fbcc" containerID="b03c92da936ff4c00104dc4b1d9a4643a50ff2dc0828ca9d05d70f3a1b083682" exitCode=0
Jul 06 21:26:15.381462 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:15.381101    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf" event={"ID":"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc","Type":"ContainerDied","Data":"b03c92da936ff4c00104dc4b1d9a4643a50ff2dc0828ca9d05d70f3a1b083682"}
Jul 06 21:26:16.387761 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:16.387728    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf" event={"ID":"22eb9d8a-e03d-4cf5-823e-e04468a7fbcc","Type":"ContainerStarted","Data":"3f400fbea8145af71aec6d982a231b0fb91cc1a59464608d56bd9d32f0a64d2d"}
Jul 06 21:26:16.388240 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:16.387800    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:16.412268 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:16.412219    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf" podStartSLOduration=2.73008649 podStartE2EDuration="7.412205841s" totalImagesPullingTime="3.672042744s" totalInitContainerRuntime="1.010076607s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:16.41071059 +0000 UTC m=+285.032292927" watchObservedRunningTime="2026-07-06 21:26:16.412205841 +0000 UTC m=+285.033788157"
Jul 06 21:26:27.394579 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:27.394542    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-5hmjf"
Jul 06 21:26:30.954980 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:30.954943    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"]
Jul 06 21:26:30.960346 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:30.960316    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:30.965360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:30.965336    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-54jkl\""
Jul 06 21:26:30.966267 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:30.966243    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 21:26:30.966384 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:30.966265    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 21:26:30.980419 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:30.980390    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"]
Jul 06 21:26:31.031014 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.030983    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d54b7152-2e32-4180-90eb-8f0ec19f2235-tls-certs\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.031014 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.031017    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s8w2\" (UniqueName: \"kubernetes.io/projected/d54b7152-2e32-4180-90eb-8f0ec19f2235-kube-api-access-9s8w2\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.031212 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.031038    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54b7152-2e32-4180-90eb-8f0ec19f2235-tmp\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.131915 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.131887    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d54b7152-2e32-4180-90eb-8f0ec19f2235-tls-certs\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.132099 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.131919    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s8w2\" (UniqueName: \"kubernetes.io/projected/d54b7152-2e32-4180-90eb-8f0ec19f2235-kube-api-access-9s8w2\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.132099 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.131943    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54b7152-2e32-4180-90eb-8f0ec19f2235-tmp\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.134138 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.134103    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d54b7152-2e32-4180-90eb-8f0ec19f2235-tmp\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.134254 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.134226    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d54b7152-2e32-4180-90eb-8f0ec19f2235-tls-certs\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.140985 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.140961    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s8w2\" (UniqueName: \"kubernetes.io/projected/d54b7152-2e32-4180-90eb-8f0ec19f2235-kube-api-access-9s8w2\") pod \"kube-auth-proxy-5b4d5f5648-s957n\" (UID: \"d54b7152-2e32-4180-90eb-8f0ec19f2235\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.270807 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.270771    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"
Jul 06 21:26:31.409308 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.409283    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n"]
Jul 06 21:26:31.412505 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:26:31.412475    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54b7152_2e32_4180_90eb_8f0ec19f2235.slice/crio-ca55769e7f5e527f201f4f388806e1227889d49a656bcf1ab9536ff1046404d8 WatchSource:0}: Error finding container ca55769e7f5e527f201f4f388806e1227889d49a656bcf1ab9536ff1046404d8: Status 404 returned error can't find the container with id ca55769e7f5e527f201f4f388806e1227889d49a656bcf1ab9536ff1046404d8
Jul 06 21:26:31.458427 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.458385    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n" event={"ID":"d54b7152-2e32-4180-90eb-8f0ec19f2235","Type":"ContainerStarted","Data":"ca55769e7f5e527f201f4f388806e1227889d49a656bcf1ab9536ff1046404d8"}
Jul 06 21:26:31.795732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.795707    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:26:31.797574 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.797549    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:26:31.807779 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.807759    2554 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 21:26:31.844516 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.844488    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x2n2t"]
Jul 06 21:26:31.849600 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.849577    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:31.859139 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.859114    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 21:26:31.874381 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.874353    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x2n2t"]
Jul 06 21:26:31.936710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.936543    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdmvl\" (UniqueName: \"kubernetes.io/projected/8c3e61e9-3c43-4cd6-8398-dac7fea93405-kube-api-access-rdmvl\") pod \"model-serving-api-54d89bd5fc-x2n2t\" (UID: \"8c3e61e9-3c43-4cd6-8398-dac7fea93405\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:31.936710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:31.936622    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c3e61e9-3c43-4cd6-8398-dac7fea93405-tls-certs\") pod \"model-serving-api-54d89bd5fc-x2n2t\" (UID: \"8c3e61e9-3c43-4cd6-8398-dac7fea93405\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:32.037421 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:32.037390    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c3e61e9-3c43-4cd6-8398-dac7fea93405-tls-certs\") pod \"model-serving-api-54d89bd5fc-x2n2t\" (UID: \"8c3e61e9-3c43-4cd6-8398-dac7fea93405\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:32.037607 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:32.037469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdmvl\" (UniqueName: \"kubernetes.io/projected/8c3e61e9-3c43-4cd6-8398-dac7fea93405-kube-api-access-rdmvl\") pod \"model-serving-api-54d89bd5fc-x2n2t\" (UID: \"8c3e61e9-3c43-4cd6-8398-dac7fea93405\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:32.039750 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:32.039724    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c3e61e9-3c43-4cd6-8398-dac7fea93405-tls-certs\") pod \"model-serving-api-54d89bd5fc-x2n2t\" (UID: \"8c3e61e9-3c43-4cd6-8398-dac7fea93405\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:32.045893 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:32.045836    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdmvl\" (UniqueName: \"kubernetes.io/projected/8c3e61e9-3c43-4cd6-8398-dac7fea93405-kube-api-access-rdmvl\") pod \"model-serving-api-54d89bd5fc-x2n2t\" (UID: \"8c3e61e9-3c43-4cd6-8398-dac7fea93405\") " pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:32.161977 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:32.161946    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:32.348994 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:32.348875    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x2n2t"]
Jul 06 21:26:32.465983 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:32.465946    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t" event={"ID":"8c3e61e9-3c43-4cd6-8398-dac7fea93405","Type":"ContainerStarted","Data":"14d8d20ae7f14878a1997bffa71b7b48fffac0a63c5f37e7a5631eb24aabbb7f"}
Jul 06 21:26:34.909144 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:34.909122    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 21:26:35.489956 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:35.489915    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n" event={"ID":"d54b7152-2e32-4180-90eb-8f0ec19f2235","Type":"ContainerStarted","Data":"6b3b52eec150c2a176bf531425870e22b3a148d4624ea57192b238eac8fbc29c"}
Jul 06 21:26:35.491635 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:35.491608    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t" event={"ID":"8c3e61e9-3c43-4cd6-8398-dac7fea93405","Type":"ContainerStarted","Data":"0250ef6c11ddedea97f13bbb918d5232e4652e4873c0a8dc4915d7f0076682d8"}
Jul 06 21:26:35.491773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:35.491682    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:35.509987 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:35.509928    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-s957n" podStartSLOduration=2.01794724 podStartE2EDuration="5.50991056s" totalImagesPullingTime="3.49196332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:35.50856945 +0000 UTC m=+304.130151790" watchObservedRunningTime="2026-07-06 21:26:35.50991056 +0000 UTC m=+304.131492897"
Jul 06 21:26:35.526118 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:35.526068    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t" podStartSLOduration=1.980772569 podStartE2EDuration="4.526055974s" totalImagesPullingTime="2.545283405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:35.525017438 +0000 UTC m=+304.146599800" watchObservedRunningTime="2026-07-06 21:26:35.526055974 +0000 UTC m=+304.147638291"
Jul 06 21:26:38.402913 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.402882    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"]
Jul 06 21:26:38.406494 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.406470    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.410256 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.410233    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qc9x2\""
Jul 06 21:26:38.410374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.410236    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 21:26:38.420302 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.420276    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"]
Jul 06 21:26:38.497415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497376    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.497622 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497422    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.497622 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497468    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.497622 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497509    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.497622 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497571    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpff6\" (UniqueName: \"kubernetes.io/projected/43e4b537-ee3c-403a-b38a-8da243a1ff5d-kube-api-access-hpff6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.497841 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497626    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.497841 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497644    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.497841 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497674    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.497841 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.497703    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598156 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598124    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598156 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598157    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598396 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598181    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598396 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598312    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598396 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598365    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598597 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598448    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598597 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598493    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpff6\" (UniqueName: \"kubernetes.io/projected/43e4b537-ee3c-403a-b38a-8da243a1ff5d-kube-api-access-hpff6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598597 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598569    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598741 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598648    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598741 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598685    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598741 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598716    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598884 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598793    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.598947 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.598909    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.599556 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.599533    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.600801 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.600781    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.601058 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.601041    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.620762 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.620741    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpff6\" (UniqueName: \"kubernetes.io/projected/43e4b537-ee3c-403a-b38a-8da243a1ff5d-kube-api-access-hpff6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.624587 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.624563    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43e4b537-ee3c-403a-b38a-8da243a1ff5d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678z7tnn\" (UID: \"43e4b537-ee3c-403a-b38a-8da243a1ff5d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.716521 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.716416    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:38.863008 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.862980    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"]
Jul 06 21:26:38.865416 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:26:38.865369    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e4b537_ee3c_403a_b38a_8da243a1ff5d.slice/crio-0a5c571f05628fc44b5ad0cdad652b5e71ce55d6af22563c084990bdedf3a010 WatchSource:0}: Error finding container 0a5c571f05628fc44b5ad0cdad652b5e71ce55d6af22563c084990bdedf3a010: Status 404 returned error can't find the container with id 0a5c571f05628fc44b5ad0cdad652b5e71ce55d6af22563c084990bdedf3a010
Jul 06 21:26:38.867717 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.867700    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 21:26:38.956781 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.956748    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"]
Jul 06 21:26:38.965411 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.965385    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:38.969628 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.969574    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qchm7\""
Jul 06 21:26:38.969888 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.969867    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 21:26:38.970181 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.970137    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 21:26:38.970298 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.970142    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 21:26:38.973608 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:38.973582    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"]
Jul 06 21:26:39.001615 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.001584    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13ffe78d-5de6-4c5a-9860-efa9bb25c904-manager-config\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.001744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.001638    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ffe78d-5de6-4c5a-9860-efa9bb25c904-cert\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.001744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.001716    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcszb\" (UniqueName: \"kubernetes.io/projected/13ffe78d-5de6-4c5a-9860-efa9bb25c904-kube-api-access-hcszb\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.001820 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.001745    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13ffe78d-5de6-4c5a-9860-efa9bb25c904-metrics-cert\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.103164 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.103124    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcszb\" (UniqueName: \"kubernetes.io/projected/13ffe78d-5de6-4c5a-9860-efa9bb25c904-kube-api-access-hcszb\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.103315 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.103179    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13ffe78d-5de6-4c5a-9860-efa9bb25c904-metrics-cert\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.103315 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.103233    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13ffe78d-5de6-4c5a-9860-efa9bb25c904-manager-config\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.103315 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.103305    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ffe78d-5de6-4c5a-9860-efa9bb25c904-cert\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.104001 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.103971    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/13ffe78d-5de6-4c5a-9860-efa9bb25c904-manager-config\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.105718 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.105691    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/13ffe78d-5de6-4c5a-9860-efa9bb25c904-metrics-cert\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.105811 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.105732    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ffe78d-5de6-4c5a-9860-efa9bb25c904-cert\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.118109 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.118084    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcszb\" (UniqueName: \"kubernetes.io/projected/13ffe78d-5de6-4c5a-9860-efa9bb25c904-kube-api-access-hcszb\") pod \"lws-controller-manager-d694bd4f8-b58xq\" (UID: \"13ffe78d-5de6-4c5a-9860-efa9bb25c904\") " pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.277321 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.277291    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:39.415603 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.415578    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"]
Jul 06 21:26:39.417169 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:26:39.417147    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ffe78d_5de6_4c5a_9860_efa9bb25c904.slice/crio-3283870c28bb243886fb3998a0acf696beec8066cc725dbb2abd9a767303a1ed WatchSource:0}: Error finding container 3283870c28bb243886fb3998a0acf696beec8066cc725dbb2abd9a767303a1ed: Status 404 returned error can't find the container with id 3283870c28bb243886fb3998a0acf696beec8066cc725dbb2abd9a767303a1ed
Jul 06 21:26:39.514746 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.514704    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq" event={"ID":"13ffe78d-5de6-4c5a-9860-efa9bb25c904","Type":"ContainerStarted","Data":"3283870c28bb243886fb3998a0acf696beec8066cc725dbb2abd9a767303a1ed"}
Jul 06 21:26:39.516017 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:39.515993    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn" event={"ID":"43e4b537-ee3c-403a-b38a-8da243a1ff5d","Type":"ContainerStarted","Data":"0a5c571f05628fc44b5ad0cdad652b5e71ce55d6af22563c084990bdedf3a010"}
Jul 06 21:26:41.530319 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:41.530280    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq" event={"ID":"13ffe78d-5de6-4c5a-9860-efa9bb25c904","Type":"ContainerStarted","Data":"b8ddac1559df67d33933341c5197adb9800e5986715562d890b61877ac76aaf3"}
Jul 06 21:26:41.530832 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:41.530371    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:26:41.558307 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:41.558248    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq" podStartSLOduration=1.6178292920000001 podStartE2EDuration="3.558230929s" totalImagesPullingTime="1.940401637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:41.55584724 +0000 UTC m=+310.177429558" watchObservedRunningTime="2026-07-06 21:26:41.558230929 +0000 UTC m=+310.179813245"
Jul 06 21:26:42.508711 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:42.508669    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:26:42.508799 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:42.508761    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:26:42.508836 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:42.508804    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:26:43.542625 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:43.542585    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn" event={"ID":"43e4b537-ee3c-403a-b38a-8da243a1ff5d","Type":"ContainerStarted","Data":"3e94729190e92b8635ccd021fa85afb48a766c22d3213506849849b65ffb7f52"}
Jul 06 21:26:43.566569 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:43.566508    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn" podStartSLOduration=1.925981733 podStartE2EDuration="5.566491238s" totalImagesPullingTime="3.640509505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:43.565025898 +0000 UTC m=+312.186608231" watchObservedRunningTime="2026-07-06 21:26:43.566491238 +0000 UTC m=+312.188073554"
Jul 06 21:26:43.716826 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:43.716792    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:43.721575 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:43.721553    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:44.548365 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:44.548340    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:44.549372 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:44.549354    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678z7tnn"
Jul 06 21:26:46.501210 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:46.501181    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-x2n2t"
Jul 06 21:26:52.537630 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:26:52.537596    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d694bd4f8-b58xq"
Jul 06 21:27:44.157731 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.157645    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"]
Jul 06 21:27:44.160817 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.160794    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.170914 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.170897    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 21:27:44.171228 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.171214    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 21:27:44.171962 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.171949    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zkjzz\""
Jul 06 21:27:44.184325 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.184298    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"]
Jul 06 21:27:44.274226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.274187    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6wll\" (UniqueName: \"kubernetes.io/projected/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-kube-api-access-p6wll\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.274400 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.274241    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.274400 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.274358    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.375746 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.375712    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.375916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.375768    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6wll\" (UniqueName: \"kubernetes.io/projected/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-kube-api-access-p6wll\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.375916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.375801    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.376117 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.376097    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.376159 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.376131    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.385858 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.385834    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6wll\" (UniqueName: \"kubernetes.io/projected/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-kube-api-access-p6wll\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.469624 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.469547    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:44.618807 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.618772    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"]
Jul 06 21:27:44.623458 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:27:44.623405    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4bdcad_e9e8_49f9_9259_363ef154bc7d.slice/crio-d9a6f773675371404527380ed1e5f947181e6b3c8cc61a6c547f733498894ca6 WatchSource:0}: Error finding container d9a6f773675371404527380ed1e5f947181e6b3c8cc61a6c547f733498894ca6: Status 404 returned error can't find the container with id d9a6f773675371404527380ed1e5f947181e6b3c8cc61a6c547f733498894ca6
Jul 06 21:27:44.770563 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.770530    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"]
Jul 06 21:27:44.773509 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.773488    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.786052 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.786029    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"]
Jul 06 21:27:44.834336 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.834308    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerID="c5f2681030afe84a5164b090ae92b34329fc2dd47166b9cf386978ec24d2ed59" exitCode=0
Jul 06 21:27:44.834506 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.834417    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz" event={"ID":"7a4bdcad-e9e8-49f9-9259-363ef154bc7d","Type":"ContainerDied","Data":"c5f2681030afe84a5164b090ae92b34329fc2dd47166b9cf386978ec24d2ed59"}
Jul 06 21:27:44.834506 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.834478    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz" event={"ID":"7a4bdcad-e9e8-49f9-9259-363ef154bc7d","Type":"ContainerStarted","Data":"d9a6f773675371404527380ed1e5f947181e6b3c8cc61a6c547f733498894ca6"}
Jul 06 21:27:44.879712 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.879679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.879873 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.879727    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v65l6\" (UniqueName: \"kubernetes.io/projected/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-kube-api-access-v65l6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.879873 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.879756    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.980779 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.980693    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.980946 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.980784    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.980946 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.980823    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v65l6\" (UniqueName: \"kubernetes.io/projected/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-kube-api-access-v65l6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.981074 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.981053    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.981187 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.981170    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:44.990993 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:44.990961    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v65l6\" (UniqueName: \"kubernetes.io/projected/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-kube-api-access-v65l6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:45.084502 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.084466    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:45.223218 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.223181    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"]
Jul 06 21:27:45.228997 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:27:45.228966    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0a9925_7bcd_446b_89d1_ab4e4b1083ef.slice/crio-9c15b6c21978e82b61d9cb9afa769e582ef2c055cdabe37d00ab2b53108b712f WatchSource:0}: Error finding container 9c15b6c21978e82b61d9cb9afa769e582ef2c055cdabe37d00ab2b53108b712f: Status 404 returned error can't find the container with id 9c15b6c21978e82b61d9cb9afa769e582ef2c055cdabe37d00ab2b53108b712f
Jul 06 21:27:45.352486 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.352457    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"]
Jul 06 21:27:45.355928 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.355906    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.370012 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.369984    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"]
Jul 06 21:27:45.486222 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.486144    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.486383 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.486256    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.486383 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.486286    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlw4x\" (UniqueName: \"kubernetes.io/projected/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-kube-api-access-nlw4x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.587515 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.587479    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.587515 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.587518    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlw4x\" (UniqueName: \"kubernetes.io/projected/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-kube-api-access-nlw4x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.587805 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.587575    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.587871 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.587837    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.587940 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.587914    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.602229 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.602197    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlw4x\" (UniqueName: \"kubernetes.io/projected/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-kube-api-access-nlw4x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.705907 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.705877    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:45.840767 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.840738    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerID="6cc9858450765630751d94b26531a11922e10b1abcb5f2c1308ff42668d8e51a" exitCode=0
Jul 06 21:27:45.840926 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.840814    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz" event={"ID":"7a4bdcad-e9e8-49f9-9259-363ef154bc7d","Type":"ContainerDied","Data":"6cc9858450765630751d94b26531a11922e10b1abcb5f2c1308ff42668d8e51a"}
Jul 06 21:27:45.842247 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.842226    2554 generic.go:356] "Generic (PLEG): container finished" podID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerID="b9a7de81d293165a30ca8b7c9bd704c31b1a63e384f97c528cb4ab00aa43fe00" exitCode=0
Jul 06 21:27:45.842353 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.842290    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9" event={"ID":"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef","Type":"ContainerDied","Data":"b9a7de81d293165a30ca8b7c9bd704c31b1a63e384f97c528cb4ab00aa43fe00"}
Jul 06 21:27:45.842353 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.842326    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9" event={"ID":"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef","Type":"ContainerStarted","Data":"9c15b6c21978e82b61d9cb9afa769e582ef2c055cdabe37d00ab2b53108b712f"}
Jul 06 21:27:45.861692 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.861671    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"]
Jul 06 21:27:45.867520 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:27:45.867495    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3ff1fc_e8fe_4e73_973b_0fcf26f83311.slice/crio-c7f2ca4d146ab1a934aba7cb44c51de1364d935dd6a7101086e5df2612fb4646 WatchSource:0}: Error finding container c7f2ca4d146ab1a934aba7cb44c51de1364d935dd6a7101086e5df2612fb4646: Status 404 returned error can't find the container with id c7f2ca4d146ab1a934aba7cb44c51de1364d935dd6a7101086e5df2612fb4646
Jul 06 21:27:45.990551 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.990505    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"]
Jul 06 21:27:45.993908 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:45.993887    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.009541 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.009485    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"]
Jul 06 21:27:46.092998 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.092964    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg7d9\" (UniqueName: \"kubernetes.io/projected/bb73feda-e515-40db-b206-c238644abe03-kube-api-access-tg7d9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.093143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.093006    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.093143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.093059    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.193724 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.193679    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg7d9\" (UniqueName: \"kubernetes.io/projected/bb73feda-e515-40db-b206-c238644abe03-kube-api-access-tg7d9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.193921 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.193736    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.193921 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.193769    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.194156 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.194136    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.194216 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.194156    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.203707 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.203682    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg7d9\" (UniqueName: \"kubernetes.io/projected/bb73feda-e515-40db-b206-c238644abe03-kube-api-access-tg7d9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.368267 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.368161    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:46.508353 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.508331    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"]
Jul 06 21:27:46.510725 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:27:46.510702    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb73feda_e515_40db_b206_c238644abe03.slice/crio-89cd1d47ecef6aac0a62b55d9f83a8bd4156525e4d95c0bae1fc0aeba194385e WatchSource:0}: Error finding container 89cd1d47ecef6aac0a62b55d9f83a8bd4156525e4d95c0bae1fc0aeba194385e: Status 404 returned error can't find the container with id 89cd1d47ecef6aac0a62b55d9f83a8bd4156525e4d95c0bae1fc0aeba194385e
Jul 06 21:27:46.849604 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.849562    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerID="d81ae7e725da8a5c889ed71351453a574c8098c9399eb04986706d62924ba9a1" exitCode=0
Jul 06 21:27:46.849798 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.849644    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz" event={"ID":"7a4bdcad-e9e8-49f9-9259-363ef154bc7d","Type":"ContainerDied","Data":"d81ae7e725da8a5c889ed71351453a574c8098c9399eb04986706d62924ba9a1"}
Jul 06 21:27:46.851348 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.851326    2554 generic.go:356] "Generic (PLEG): container finished" podID="bb73feda-e515-40db-b206-c238644abe03" containerID="a1f93fd080a6c61c508e6bb7ffd827c766ba9fa79c2e94f3126376b7cc7bf4a3" exitCode=0
Jul 06 21:27:46.851471 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.851409    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g" event={"ID":"bb73feda-e515-40db-b206-c238644abe03","Type":"ContainerDied","Data":"a1f93fd080a6c61c508e6bb7ffd827c766ba9fa79c2e94f3126376b7cc7bf4a3"}
Jul 06 21:27:46.851544 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.851473    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g" event={"ID":"bb73feda-e515-40db-b206-c238644abe03","Type":"ContainerStarted","Data":"89cd1d47ecef6aac0a62b55d9f83a8bd4156525e4d95c0bae1fc0aeba194385e"}
Jul 06 21:27:46.853034 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.853018    2554 generic.go:356] "Generic (PLEG): container finished" podID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerID="c16380d138db3f3a7bcbcc555e4c322dafc45b5188a09cee38374018fd2a213a" exitCode=0
Jul 06 21:27:46.853116 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.853043    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx" event={"ID":"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311","Type":"ContainerDied","Data":"c16380d138db3f3a7bcbcc555e4c322dafc45b5188a09cee38374018fd2a213a"}
Jul 06 21:27:46.853116 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:46.853071    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx" event={"ID":"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311","Type":"ContainerStarted","Data":"c7f2ca4d146ab1a934aba7cb44c51de1364d935dd6a7101086e5df2612fb4646"}
Jul 06 21:27:47.860349 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:47.860315    2554 generic.go:356] "Generic (PLEG): container finished" podID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerID="051dd45833fc4313e004401a3b7a1b3d62d8710b0ca47751ff362107c9323f4d" exitCode=0
Jul 06 21:27:47.860772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:47.860393    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx" event={"ID":"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311","Type":"ContainerDied","Data":"051dd45833fc4313e004401a3b7a1b3d62d8710b0ca47751ff362107c9323f4d"}
Jul 06 21:27:47.862327 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:47.862302    2554 generic.go:356] "Generic (PLEG): container finished" podID="bb73feda-e515-40db-b206-c238644abe03" containerID="87cbe8593bd99beecff93030defe2cdf55f21c4f7e92322abe570efdfe103fdc" exitCode=0
Jul 06 21:27:47.862420 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:47.862359    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g" event={"ID":"bb73feda-e515-40db-b206-c238644abe03","Type":"ContainerDied","Data":"87cbe8593bd99beecff93030defe2cdf55f21c4f7e92322abe570efdfe103fdc"}
Jul 06 21:27:47.864262 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:47.864239    2554 generic.go:356] "Generic (PLEG): container finished" podID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerID="a9972ecb4602da06adc84ff5d84469aa05c77804cde6755d0a0c2072464a954b" exitCode=0
Jul 06 21:27:47.864332 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:47.864308    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9" event={"ID":"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef","Type":"ContainerDied","Data":"a9972ecb4602da06adc84ff5d84469aa05c77804cde6755d0a0c2072464a954b"}
Jul 06 21:27:48.010030 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.010003    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:48.110363 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.110334    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-util\") pod \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") "
Jul 06 21:27:48.110495 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.110408    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6wll\" (UniqueName: \"kubernetes.io/projected/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-kube-api-access-p6wll\") pod \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") "
Jul 06 21:27:48.110495 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.110467    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-bundle\") pod \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\" (UID: \"7a4bdcad-e9e8-49f9-9259-363ef154bc7d\") "
Jul 06 21:27:48.110923 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.110889    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-bundle" (OuterVolumeSpecName: "bundle") pod "7a4bdcad-e9e8-49f9-9259-363ef154bc7d" (UID: "7a4bdcad-e9e8-49f9-9259-363ef154bc7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:27:48.112619 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.112595    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-kube-api-access-p6wll" (OuterVolumeSpecName: "kube-api-access-p6wll") pod "7a4bdcad-e9e8-49f9-9259-363ef154bc7d" (UID: "7a4bdcad-e9e8-49f9-9259-363ef154bc7d"). InnerVolumeSpecName "kube-api-access-p6wll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:27:48.115652 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.115615    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-util" (OuterVolumeSpecName: "util") pod "7a4bdcad-e9e8-49f9-9259-363ef154bc7d" (UID: "7a4bdcad-e9e8-49f9-9259-363ef154bc7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:27:48.211257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.211174    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6wll\" (UniqueName: \"kubernetes.io/projected/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-kube-api-access-p6wll\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:48.211257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.211201    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:48.211257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.211211    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a4bdcad-e9e8-49f9-9259-363ef154bc7d-util\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:48.872749 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.872719    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz"
Jul 06 21:27:48.873152 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.872718    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz" event={"ID":"7a4bdcad-e9e8-49f9-9259-363ef154bc7d","Type":"ContainerDied","Data":"d9a6f773675371404527380ed1e5f947181e6b3c8cc61a6c547f733498894ca6"}
Jul 06 21:27:48.873152 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.872853    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9a6f773675371404527380ed1e5f947181e6b3c8cc61a6c547f733498894ca6"
Jul 06 21:27:48.875136 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.875108    2554 generic.go:356] "Generic (PLEG): container finished" podID="bb73feda-e515-40db-b206-c238644abe03" containerID="b88c51643f4c6ce7b19d966b2df4c4cdafbcd695e14855671a9ac5362932500c" exitCode=0
Jul 06 21:27:48.875247 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.875198    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g" event={"ID":"bb73feda-e515-40db-b206-c238644abe03","Type":"ContainerDied","Data":"b88c51643f4c6ce7b19d966b2df4c4cdafbcd695e14855671a9ac5362932500c"}
Jul 06 21:27:48.877557 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.877530    2554 generic.go:356] "Generic (PLEG): container finished" podID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerID="fee88dd9d7fb882904487b9ef4fce313e80817fa6b9a1d8e89f55f3421bf9ea7" exitCode=0
Jul 06 21:27:48.877658 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.877623    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9" event={"ID":"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef","Type":"ContainerDied","Data":"fee88dd9d7fb882904487b9ef4fce313e80817fa6b9a1d8e89f55f3421bf9ea7"}
Jul 06 21:27:48.880213 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.880192    2554 generic.go:356] "Generic (PLEG): container finished" podID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerID="9665fe446b9f5b51d9bff6290e0eced62990299aedfbb075fbbc2a73e3198be2" exitCode=0
Jul 06 21:27:48.880313 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:48.880223    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx" event={"ID":"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311","Type":"ContainerDied","Data":"9665fe446b9f5b51d9bff6290e0eced62990299aedfbb075fbbc2a73e3198be2"}
Jul 06 21:27:50.039669 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.039643    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:50.082701 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.082678    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:27:50.085747 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.085725    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:50.130261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.130232    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-bundle\") pod \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") "
Jul 06 21:27:50.130392 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.130327    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v65l6\" (UniqueName: \"kubernetes.io/projected/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-kube-api-access-v65l6\") pod \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") "
Jul 06 21:27:50.130392 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.130356    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-util\") pod \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\" (UID: \"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef\") "
Jul 06 21:27:50.130866 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.130841    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-bundle" (OuterVolumeSpecName: "bundle") pod "2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" (UID: "2f0a9925-7bcd-446b-89d1-ab4e4b1083ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:27:50.132392 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.132370    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-kube-api-access-v65l6" (OuterVolumeSpecName: "kube-api-access-v65l6") pod "2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" (UID: "2f0a9925-7bcd-446b-89d1-ab4e4b1083ef"). InnerVolumeSpecName "kube-api-access-v65l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:27:50.139557 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.139524    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-util" (OuterVolumeSpecName: "util") pod "2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" (UID: "2f0a9925-7bcd-446b-89d1-ab4e4b1083ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:27:50.231521 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.231485    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg7d9\" (UniqueName: \"kubernetes.io/projected/bb73feda-e515-40db-b206-c238644abe03-kube-api-access-tg7d9\") pod \"bb73feda-e515-40db-b206-c238644abe03\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") "
Jul 06 21:27:50.231693 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.231534    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlw4x\" (UniqueName: \"kubernetes.io/projected/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-kube-api-access-nlw4x\") pod \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") "
Jul 06 21:27:50.231693 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.231599    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-bundle\") pod \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") "
Jul 06 21:27:50.231693 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.231630    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-util\") pod \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\" (UID: \"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311\") "
Jul 06 21:27:50.231795 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.231762    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-bundle\") pod \"bb73feda-e515-40db-b206-c238644abe03\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") "
Jul 06 21:27:50.231858 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.231843    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-util\") pod \"bb73feda-e515-40db-b206-c238644abe03\" (UID: \"bb73feda-e515-40db-b206-c238644abe03\") "
Jul 06 21:27:50.232108 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.232088    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v65l6\" (UniqueName: \"kubernetes.io/projected/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-kube-api-access-v65l6\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.232108 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.232108    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-util\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.232288 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.232121    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f0a9925-7bcd-446b-89d1-ab4e4b1083ef-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.232398 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.232368    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-bundle" (OuterVolumeSpecName: "bundle") pod "cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" (UID: "cf3ff1fc-e8fe-4e73-973b-0fcf26f83311"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:27:50.232530 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.232505    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-bundle" (OuterVolumeSpecName: "bundle") pod "bb73feda-e515-40db-b206-c238644abe03" (UID: "bb73feda-e515-40db-b206-c238644abe03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:27:50.234069 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.234039    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-kube-api-access-nlw4x" (OuterVolumeSpecName: "kube-api-access-nlw4x") pod "cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" (UID: "cf3ff1fc-e8fe-4e73-973b-0fcf26f83311"). InnerVolumeSpecName "kube-api-access-nlw4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:27:50.234194 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.234097    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb73feda-e515-40db-b206-c238644abe03-kube-api-access-tg7d9" (OuterVolumeSpecName: "kube-api-access-tg7d9") pod "bb73feda-e515-40db-b206-c238644abe03" (UID: "bb73feda-e515-40db-b206-c238644abe03"). InnerVolumeSpecName "kube-api-access-tg7d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:27:50.237424 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.237376    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-util" (OuterVolumeSpecName: "util") pod "bb73feda-e515-40db-b206-c238644abe03" (UID: "bb73feda-e515-40db-b206-c238644abe03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:27:50.237860 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.237842    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-util" (OuterVolumeSpecName: "util") pod "cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" (UID: "cf3ff1fc-e8fe-4e73-973b-0fcf26f83311"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:27:50.333143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.333110    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.333143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.333138    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-util\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.333143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.333147    2554 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-bundle\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.333143 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.333154    2554 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb73feda-e515-40db-b206-c238644abe03-util\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.333384 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.333163    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg7d9\" (UniqueName: \"kubernetes.io/projected/bb73feda-e515-40db-b206-c238644abe03-kube-api-access-tg7d9\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.333384 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.333174    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlw4x\" (UniqueName: \"kubernetes.io/projected/cf3ff1fc-e8fe-4e73-973b-0fcf26f83311-kube-api-access-nlw4x\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:27:50.893671 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.893645    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g"
Jul 06 21:27:50.893838 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.893642    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g" event={"ID":"bb73feda-e515-40db-b206-c238644abe03","Type":"ContainerDied","Data":"89cd1d47ecef6aac0a62b55d9f83a8bd4156525e4d95c0bae1fc0aeba194385e"}
Jul 06 21:27:50.893838 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.893804    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89cd1d47ecef6aac0a62b55d9f83a8bd4156525e4d95c0bae1fc0aeba194385e"
Jul 06 21:27:50.895644 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.895628    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9"
Jul 06 21:27:50.895759 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.895664    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9" event={"ID":"2f0a9925-7bcd-446b-89d1-ab4e4b1083ef","Type":"ContainerDied","Data":"9c15b6c21978e82b61d9cb9afa769e582ef2c055cdabe37d00ab2b53108b712f"}
Jul 06 21:27:50.895759 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.895709    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c15b6c21978e82b61d9cb9afa769e582ef2c055cdabe37d00ab2b53108b712f"
Jul 06 21:27:50.897667 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.897647    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx" event={"ID":"cf3ff1fc-e8fe-4e73-973b-0fcf26f83311","Type":"ContainerDied","Data":"c7f2ca4d146ab1a934aba7cb44c51de1364d935dd6a7101086e5df2612fb4646"}
Jul 06 21:27:50.897778 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.897678    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7f2ca4d146ab1a934aba7cb44c51de1364d935dd6a7101086e5df2612fb4646"
Jul 06 21:27:50.897778 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:27:50.897688    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx"
Jul 06 21:29:12.425528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425493    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-v6f44"]
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425816    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerName="extract"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425827    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerName="extract"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425839    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerName="util"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425845    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerName="util"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425850    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb73feda-e515-40db-b206-c238644abe03" containerName="util"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425856    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb73feda-e515-40db-b206-c238644abe03" containerName="util"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425863    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerName="pull"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425867    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerName="pull"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425875    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb73feda-e515-40db-b206-c238644abe03" containerName="pull"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425880    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb73feda-e515-40db-b206-c238644abe03" containerName="pull"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425887    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerName="pull"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425892    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerName="pull"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425900    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerName="pull"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425905    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerName="pull"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425911    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerName="extract"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425916    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerName="extract"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425924    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerName="extract"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425929    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerName="extract"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425939    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb73feda-e515-40db-b206-c238644abe03" containerName="extract"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425945    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb73feda-e515-40db-b206-c238644abe03" containerName="extract"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425950    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerName="util"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425955    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerName="util"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425960    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerName="util"
Jul 06 21:29:12.425958 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.425965    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerName="util"
Jul 06 21:29:12.426773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.426013    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb73feda-e515-40db-b206-c238644abe03" containerName="extract"
Jul 06 21:29:12.426773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.426020    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf3ff1fc-e8fe-4e73-973b-0fcf26f83311" containerName="extract"
Jul 06 21:29:12.426773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.426027    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0a9925-7bcd-446b-89d1-ab4e4b1083ef" containerName="extract"
Jul 06 21:29:12.426773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.426034    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4bdcad-e9e8-49f9-9259-363ef154bc7d" containerName="extract"
Jul 06 21:29:12.428968 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.428953    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v6f44"
Jul 06 21:29:12.433620 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.433597    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bb54d\""
Jul 06 21:29:12.433763 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.433621    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 21:29:12.434892 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.434869    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 21:29:12.437586 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.437567    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-v6f44"]
Jul 06 21:29:12.559729 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.559696    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9spg9\" (UniqueName: \"kubernetes.io/projected/77db04e0-d19d-4336-99b6-4c3cb8c35285-kube-api-access-9spg9\") pod \"authorino-58cd955675-v6f44\" (UID: \"77db04e0-d19d-4336-99b6-4c3cb8c35285\") " pod="kuadrant-system/authorino-58cd955675-v6f44"
Jul 06 21:29:12.660664 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.660632    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9spg9\" (UniqueName: \"kubernetes.io/projected/77db04e0-d19d-4336-99b6-4c3cb8c35285-kube-api-access-9spg9\") pod \"authorino-58cd955675-v6f44\" (UID: \"77db04e0-d19d-4336-99b6-4c3cb8c35285\") " pod="kuadrant-system/authorino-58cd955675-v6f44"
Jul 06 21:29:12.669227 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.669202    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9spg9\" (UniqueName: \"kubernetes.io/projected/77db04e0-d19d-4336-99b6-4c3cb8c35285-kube-api-access-9spg9\") pod \"authorino-58cd955675-v6f44\" (UID: \"77db04e0-d19d-4336-99b6-4c3cb8c35285\") " pod="kuadrant-system/authorino-58cd955675-v6f44"
Jul 06 21:29:12.737743 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.737668    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5wls8"]
Jul 06 21:29:12.738398 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.738376    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v6f44"
Jul 06 21:29:12.741736 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.741721    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5wls8"
Jul 06 21:29:12.750631 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.750610    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5wls8"]
Jul 06 21:29:12.863179 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.863149    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72jqr\" (UniqueName: \"kubernetes.io/projected/6e465904-89b9-4cf5-854a-7bd8dc7583b0-kube-api-access-72jqr\") pod \"authorino-75d556bd77-5wls8\" (UID: \"6e465904-89b9-4cf5-854a-7bd8dc7583b0\") " pod="kuadrant-system/authorino-75d556bd77-5wls8"
Jul 06 21:29:12.878674 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.878642    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-v6f44"]
Jul 06 21:29:12.887075 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:29:12.887051    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77db04e0_d19d_4336_99b6_4c3cb8c35285.slice/crio-3ea06a8b46d29365e97ed5f36ce257e62f8e636565e471659b27c6247be9ac85 WatchSource:0}: Error finding container 3ea06a8b46d29365e97ed5f36ce257e62f8e636565e471659b27c6247be9ac85: Status 404 returned error can't find the container with id 3ea06a8b46d29365e97ed5f36ce257e62f8e636565e471659b27c6247be9ac85
Jul 06 21:29:12.963706 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.963677    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72jqr\" (UniqueName: \"kubernetes.io/projected/6e465904-89b9-4cf5-854a-7bd8dc7583b0-kube-api-access-72jqr\") pod \"authorino-75d556bd77-5wls8\" (UID: \"6e465904-89b9-4cf5-854a-7bd8dc7583b0\") " pod="kuadrant-system/authorino-75d556bd77-5wls8"
Jul 06 21:29:12.976556 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:12.976521    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72jqr\" (UniqueName: \"kubernetes.io/projected/6e465904-89b9-4cf5-854a-7bd8dc7583b0-kube-api-access-72jqr\") pod \"authorino-75d556bd77-5wls8\" (UID: \"6e465904-89b9-4cf5-854a-7bd8dc7583b0\") " pod="kuadrant-system/authorino-75d556bd77-5wls8"
Jul 06 21:29:13.069343 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:13.069311    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5wls8"
Jul 06 21:29:13.201720 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:13.201691    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5wls8"]
Jul 06 21:29:13.317301 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:13.317267    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v6f44" event={"ID":"77db04e0-d19d-4336-99b6-4c3cb8c35285","Type":"ContainerStarted","Data":"3ea06a8b46d29365e97ed5f36ce257e62f8e636565e471659b27c6247be9ac85"}
Jul 06 21:29:13.318361 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:13.318339    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5wls8" event={"ID":"6e465904-89b9-4cf5-854a-7bd8dc7583b0","Type":"ContainerStarted","Data":"64d6e93aed7c404fca244d142a8dcbf182998a8e0f8e6109f33d5b917f2c9547"}
Jul 06 21:29:17.343553 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:17.343519    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v6f44" event={"ID":"77db04e0-d19d-4336-99b6-4c3cb8c35285","Type":"ContainerStarted","Data":"a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684"}
Jul 06 21:29:17.344919 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:17.344897    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5wls8" event={"ID":"6e465904-89b9-4cf5-854a-7bd8dc7583b0","Type":"ContainerStarted","Data":"c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a"}
Jul 06 21:29:17.364974 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:17.364931    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-v6f44" podStartSLOduration=1.9623803880000001 podStartE2EDuration="5.364916336s" totalImagesPullingTime="3.402535948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:29:17.36431183 +0000 UTC m=+465.985894147" watchObservedRunningTime="2026-07-06 21:29:17.364916336 +0000 UTC m=+465.986498653"
Jul 06 21:29:17.387385 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:17.387335    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5wls8" podStartSLOduration=2.290582717 podStartE2EDuration="5.387320272s" totalImagesPullingTime="3.096737555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:29:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:29:17.386051896 +0000 UTC m=+466.007634214" watchObservedRunningTime="2026-07-06 21:29:17.387320272 +0000 UTC m=+466.008902589"
Jul 06 21:29:17.428334 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:17.428300    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-v6f44"]
Jul 06 21:29:19.354641 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:19.354604    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-v6f44" podUID="77db04e0-d19d-4336-99b6-4c3cb8c35285" containerName="authorino" containerID="cri-o://a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684" gracePeriod=30
Jul 06 21:29:19.609777 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:19.609715    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v6f44"
Jul 06 21:29:19.725772 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:19.725739    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9spg9\" (UniqueName: \"kubernetes.io/projected/77db04e0-d19d-4336-99b6-4c3cb8c35285-kube-api-access-9spg9\") pod \"77db04e0-d19d-4336-99b6-4c3cb8c35285\" (UID: \"77db04e0-d19d-4336-99b6-4c3cb8c35285\") "
Jul 06 21:29:19.727781 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:19.727751    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77db04e0-d19d-4336-99b6-4c3cb8c35285-kube-api-access-9spg9" (OuterVolumeSpecName: "kube-api-access-9spg9") pod "77db04e0-d19d-4336-99b6-4c3cb8c35285" (UID: "77db04e0-d19d-4336-99b6-4c3cb8c35285"). InnerVolumeSpecName "kube-api-access-9spg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:29:19.826967 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:19.826934    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9spg9\" (UniqueName: \"kubernetes.io/projected/77db04e0-d19d-4336-99b6-4c3cb8c35285-kube-api-access-9spg9\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:29:20.360723 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.360689    2554 generic.go:356] "Generic (PLEG): container finished" podID="77db04e0-d19d-4336-99b6-4c3cb8c35285" containerID="a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684" exitCode=0
Jul 06 21:29:20.361123 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.360732    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-v6f44"
Jul 06 21:29:20.361123 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.360774    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v6f44" event={"ID":"77db04e0-d19d-4336-99b6-4c3cb8c35285","Type":"ContainerDied","Data":"a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684"}
Jul 06 21:29:20.361123 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.360813    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-v6f44" event={"ID":"77db04e0-d19d-4336-99b6-4c3cb8c35285","Type":"ContainerDied","Data":"3ea06a8b46d29365e97ed5f36ce257e62f8e636565e471659b27c6247be9ac85"}
Jul 06 21:29:20.361123 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.360828    2554 scope.go:117] "RemoveContainer" containerID="a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684"
Jul 06 21:29:20.369845 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.369820    2554 scope.go:117] "RemoveContainer" containerID="a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684"
Jul 06 21:29:20.370065 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:29:20.370046    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684\": container with ID starting with a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684 not found: ID does not exist" containerID="a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684"
Jul 06 21:29:20.370125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.370073    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684"} err="failed to get container status \"a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684\": rpc error: code = NotFound desc = could not find container \"a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684\": container with ID starting with a228802b547979388efa8f55a72860ac0d4d50d4163f14c8d9905af0d61a1684 not found: ID does not exist"
Jul 06 21:29:20.376285 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.376258    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-v6f44"]
Jul 06 21:29:20.379893 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:20.379868    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-v6f44"]
Jul 06 21:29:21.986219 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:21.986188    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77db04e0-d19d-4336-99b6-4c3cb8c35285" path="/var/lib/kubelet/pods/77db04e0-d19d-4336-99b6-4c3cb8c35285/volumes"
Jul 06 21:29:50.776152 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.776123    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w6qrl"]
Jul 06 21:29:50.776671 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.776488    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77db04e0-d19d-4336-99b6-4c3cb8c35285" containerName="authorino"
Jul 06 21:29:50.776671 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.776503    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="77db04e0-d19d-4336-99b6-4c3cb8c35285" containerName="authorino"
Jul 06 21:29:50.776671 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.776578    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="77db04e0-d19d-4336-99b6-4c3cb8c35285" containerName="authorino"
Jul 06 21:29:50.781262 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.781245    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w6qrl"
Jul 06 21:29:50.788276 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.787922    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w6qrl"]
Jul 06 21:29:50.883987 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.883949    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r24qc\" (UniqueName: \"kubernetes.io/projected/f9c0fbe4-0bd7-460e-bda9-0559205d5cf8-kube-api-access-r24qc\") pod \"authorino-5d4b67c446-w6qrl\" (UID: \"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8\") " pod="kuadrant-system/authorino-5d4b67c446-w6qrl"
Jul 06 21:29:50.985345 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.985311    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r24qc\" (UniqueName: \"kubernetes.io/projected/f9c0fbe4-0bd7-460e-bda9-0559205d5cf8-kube-api-access-r24qc\") pod \"authorino-5d4b67c446-w6qrl\" (UID: \"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8\") " pod="kuadrant-system/authorino-5d4b67c446-w6qrl"
Jul 06 21:29:50.993564 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:50.993541    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r24qc\" (UniqueName: \"kubernetes.io/projected/f9c0fbe4-0bd7-460e-bda9-0559205d5cf8-kube-api-access-r24qc\") pod \"authorino-5d4b67c446-w6qrl\" (UID: \"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8\") " pod="kuadrant-system/authorino-5d4b67c446-w6qrl"
Jul 06 21:29:51.060559 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.060475    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w6qrl"]
Jul 06 21:29:51.060773 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.060757    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w6qrl"
Jul 06 21:29:51.083572 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.083549    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86b6b594-gkwsw"]
Jul 06 21:29:51.086200 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.086182    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b6b594-gkwsw"
Jul 06 21:29:51.097655 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.097633    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86b6b594-gkwsw"]
Jul 06 21:29:51.187267 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.187233    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kvgd\" (UniqueName: \"kubernetes.io/projected/5d3e6af6-9fc3-49db-a2c6-8dbe66ded600-kube-api-access-8kvgd\") pod \"authorino-86b6b594-gkwsw\" (UID: \"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600\") " pod="kuadrant-system/authorino-86b6b594-gkwsw"
Jul 06 21:29:51.207638 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.207612    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w6qrl"]
Jul 06 21:29:51.209909 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:29:51.209881    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9c0fbe4_0bd7_460e_bda9_0559205d5cf8.slice/crio-440344e2463e1681747bdac1b36837db9b6e050c80aa40e26aae6075f8d8553d WatchSource:0}: Error finding container 440344e2463e1681747bdac1b36837db9b6e050c80aa40e26aae6075f8d8553d: Status 404 returned error can't find the container with id 440344e2463e1681747bdac1b36837db9b6e050c80aa40e26aae6075f8d8553d
Jul 06 21:29:51.287862 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.287819    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kvgd\" (UniqueName: \"kubernetes.io/projected/5d3e6af6-9fc3-49db-a2c6-8dbe66ded600-kube-api-access-8kvgd\") pod \"authorino-86b6b594-gkwsw\" (UID: \"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600\") " pod="kuadrant-system/authorino-86b6b594-gkwsw"
Jul 06 21:29:51.311994 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.311922    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kvgd\" (UniqueName: \"kubernetes.io/projected/5d3e6af6-9fc3-49db-a2c6-8dbe66ded600-kube-api-access-8kvgd\") pod \"authorino-86b6b594-gkwsw\" (UID: \"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600\") " pod="kuadrant-system/authorino-86b6b594-gkwsw"
Jul 06 21:29:51.314340 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.314310    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b6b594-gkwsw"]
Jul 06 21:29:51.314595 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.314580    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b6b594-gkwsw"
Jul 06 21:29:51.342666 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.342634    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-549d7966c8-9c4wx"]
Jul 06 21:29:51.345215 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.345200    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:29:51.348001 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.347981    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 21:29:51.357158 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.357129    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-549d7966c8-9c4wx"]
Jul 06 21:29:51.388749 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.388709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cde95054-b05a-4209-9cd3-efe73d8be849-tls-cert\") pod \"authorino-549d7966c8-9c4wx\" (UID: \"cde95054-b05a-4209-9cd3-efe73d8be849\") " pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:29:51.388893 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.388759    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sxmg\" (UniqueName: \"kubernetes.io/projected/cde95054-b05a-4209-9cd3-efe73d8be849-kube-api-access-4sxmg\") pod \"authorino-549d7966c8-9c4wx\" (UID: \"cde95054-b05a-4209-9cd3-efe73d8be849\") " pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:29:51.446809 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.446788    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b6b594-gkwsw"]
Jul 06 21:29:51.448666 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:29:51.448639    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d3e6af6_9fc3_49db_a2c6_8dbe66ded600.slice/crio-7273602f5fddb65f66d63ae6d6faad0f8108ee0c973da043eb5f21d8b24d1584 WatchSource:0}: Error finding container 7273602f5fddb65f66d63ae6d6faad0f8108ee0c973da043eb5f21d8b24d1584: Status 404 returned error can't find the container with id 7273602f5fddb65f66d63ae6d6faad0f8108ee0c973da043eb5f21d8b24d1584
Jul 06 21:29:51.489962 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.489930    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cde95054-b05a-4209-9cd3-efe73d8be849-tls-cert\") pod \"authorino-549d7966c8-9c4wx\" (UID: \"cde95054-b05a-4209-9cd3-efe73d8be849\") " pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:29:51.490109 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.489972    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sxmg\" (UniqueName: \"kubernetes.io/projected/cde95054-b05a-4209-9cd3-efe73d8be849-kube-api-access-4sxmg\") pod \"authorino-549d7966c8-9c4wx\" (UID: \"cde95054-b05a-4209-9cd3-efe73d8be849\") " pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:29:51.492327 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.492306    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cde95054-b05a-4209-9cd3-efe73d8be849-tls-cert\") pod \"authorino-549d7966c8-9c4wx\" (UID: \"cde95054-b05a-4209-9cd3-efe73d8be849\") " pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:29:51.497785 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.497765    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sxmg\" (UniqueName: \"kubernetes.io/projected/cde95054-b05a-4209-9cd3-efe73d8be849-kube-api-access-4sxmg\") pod \"authorino-549d7966c8-9c4wx\" (UID: \"cde95054-b05a-4209-9cd3-efe73d8be849\") " pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:29:51.518398 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.518366    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b6b594-gkwsw" event={"ID":"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600","Type":"ContainerStarted","Data":"7273602f5fddb65f66d63ae6d6faad0f8108ee0c973da043eb5f21d8b24d1584"}
Jul 06 21:29:51.519660 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.519636    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w6qrl" event={"ID":"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8","Type":"ContainerStarted","Data":"440344e2463e1681747bdac1b36837db9b6e050c80aa40e26aae6075f8d8553d"}
Jul 06 21:29:51.656304 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.656277    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:29:51.797189 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:51.797168    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-549d7966c8-9c4wx"]
Jul 06 21:29:51.798935 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:29:51.798911    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcde95054_b05a_4209_9cd3_efe73d8be849.slice/crio-45fa736f58f29f2772a478d65fca46a9f1870cc33193749e7f3d8b7537cf10b6 WatchSource:0}: Error finding container 45fa736f58f29f2772a478d65fca46a9f1870cc33193749e7f3d8b7537cf10b6: Status 404 returned error can't find the container with id 45fa736f58f29f2772a478d65fca46a9f1870cc33193749e7f3d8b7537cf10b6
Jul 06 21:29:52.526374 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.526343    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b6b594-gkwsw" event={"ID":"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600","Type":"ContainerStarted","Data":"ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b"}
Jul 06 21:29:52.526606 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.526377    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-86b6b594-gkwsw" podUID="5d3e6af6-9fc3-49db-a2c6-8dbe66ded600" containerName="authorino" containerID="cri-o://ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b" gracePeriod=30
Jul 06 21:29:52.528042 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.528012    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w6qrl" event={"ID":"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8","Type":"ContainerStarted","Data":"d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6"}
Jul 06 21:29:52.528042 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.528024    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-w6qrl" podUID="f9c0fbe4-0bd7-460e-bda9-0559205d5cf8" containerName="authorino" containerID="cri-o://d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6" gracePeriod=30
Jul 06 21:29:52.529720 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.529696    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549d7966c8-9c4wx" event={"ID":"cde95054-b05a-4209-9cd3-efe73d8be849","Type":"ContainerStarted","Data":"13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e"}
Jul 06 21:29:52.529811 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.529732    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549d7966c8-9c4wx" event={"ID":"cde95054-b05a-4209-9cd3-efe73d8be849","Type":"ContainerStarted","Data":"45fa736f58f29f2772a478d65fca46a9f1870cc33193749e7f3d8b7537cf10b6"}
Jul 06 21:29:52.543252 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.543211    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86b6b594-gkwsw" podStartSLOduration=1.172890075 podStartE2EDuration="1.543195964s" totalImagesPullingTime="370.305889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:29:52.541302867 +0000 UTC m=+501.162885193" watchObservedRunningTime="2026-07-06 21:29:52.543195964 +0000 UTC m=+501.164778282"
Jul 06 21:29:52.556989 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.556952    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-w6qrl" podStartSLOduration=2.187781036 podStartE2EDuration="2.556937312s" totalImagesPullingTime="369.156276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:29:52.555127456 +0000 UTC m=+501.176709774" watchObservedRunningTime="2026-07-06 21:29:52.556937312 +0000 UTC m=+501.178519627"
Jul 06 21:29:52.572090 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.572053    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-549d7966c8-9c4wx" podStartSLOduration=1.276369587 podStartE2EDuration="1.572043492s" totalImagesPullingTime="295.673905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:29:52.570655564 +0000 UTC m=+501.192237883" watchObservedRunningTime="2026-07-06 21:29:52.572043492 +0000 UTC m=+501.193625807"
Jul 06 21:29:52.597318 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.597277    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5wls8"]
Jul 06 21:29:52.597536 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.597505    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5wls8" podUID="6e465904-89b9-4cf5-854a-7bd8dc7583b0" containerName="authorino" containerID="cri-o://c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a" gracePeriod=30
Jul 06 21:29:52.761598 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.761574    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b6b594-gkwsw"
Jul 06 21:29:52.799678 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.799612    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kvgd\" (UniqueName: \"kubernetes.io/projected/5d3e6af6-9fc3-49db-a2c6-8dbe66ded600-kube-api-access-8kvgd\") pod \"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600\" (UID: \"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600\") "
Jul 06 21:29:52.801899 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.801868    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d3e6af6-9fc3-49db-a2c6-8dbe66ded600-kube-api-access-8kvgd" (OuterVolumeSpecName: "kube-api-access-8kvgd") pod "5d3e6af6-9fc3-49db-a2c6-8dbe66ded600" (UID: "5d3e6af6-9fc3-49db-a2c6-8dbe66ded600"). InnerVolumeSpecName "kube-api-access-8kvgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:29:52.848395 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.848370    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w6qrl"
Jul 06 21:29:52.856951 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.856929    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5wls8"
Jul 06 21:29:52.900478 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.900454    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r24qc\" (UniqueName: \"kubernetes.io/projected/f9c0fbe4-0bd7-460e-bda9-0559205d5cf8-kube-api-access-r24qc\") pod \"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8\" (UID: \"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8\") "
Jul 06 21:29:52.900618 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.900528    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72jqr\" (UniqueName: \"kubernetes.io/projected/6e465904-89b9-4cf5-854a-7bd8dc7583b0-kube-api-access-72jqr\") pod \"6e465904-89b9-4cf5-854a-7bd8dc7583b0\" (UID: \"6e465904-89b9-4cf5-854a-7bd8dc7583b0\") "
Jul 06 21:29:52.900745 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.900728    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kvgd\" (UniqueName: \"kubernetes.io/projected/5d3e6af6-9fc3-49db-a2c6-8dbe66ded600-kube-api-access-8kvgd\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:29:52.902485 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.902444    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9c0fbe4-0bd7-460e-bda9-0559205d5cf8-kube-api-access-r24qc" (OuterVolumeSpecName: "kube-api-access-r24qc") pod "f9c0fbe4-0bd7-460e-bda9-0559205d5cf8" (UID: "f9c0fbe4-0bd7-460e-bda9-0559205d5cf8"). InnerVolumeSpecName "kube-api-access-r24qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:29:52.902485 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:52.902455    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e465904-89b9-4cf5-854a-7bd8dc7583b0-kube-api-access-72jqr" (OuterVolumeSpecName: "kube-api-access-72jqr") pod "6e465904-89b9-4cf5-854a-7bd8dc7583b0" (UID: "6e465904-89b9-4cf5-854a-7bd8dc7583b0"). InnerVolumeSpecName "kube-api-access-72jqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:29:53.001875 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.001850    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r24qc\" (UniqueName: \"kubernetes.io/projected/f9c0fbe4-0bd7-460e-bda9-0559205d5cf8-kube-api-access-r24qc\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:29:53.001986 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.001881    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72jqr\" (UniqueName: \"kubernetes.io/projected/6e465904-89b9-4cf5-854a-7bd8dc7583b0-kube-api-access-72jqr\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:29:53.537206 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.537167    2554 generic.go:356] "Generic (PLEG): container finished" podID="6e465904-89b9-4cf5-854a-7bd8dc7583b0" containerID="c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a" exitCode=0
Jul 06 21:29:53.537378 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.537226    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5wls8"
Jul 06 21:29:53.537378 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.537261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5wls8" event={"ID":"6e465904-89b9-4cf5-854a-7bd8dc7583b0","Type":"ContainerDied","Data":"c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a"}
Jul 06 21:29:53.537378 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.537314    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5wls8" event={"ID":"6e465904-89b9-4cf5-854a-7bd8dc7583b0","Type":"ContainerDied","Data":"64d6e93aed7c404fca244d142a8dcbf182998a8e0f8e6109f33d5b917f2c9547"}
Jul 06 21:29:53.537378 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.537336    2554 scope.go:117] "RemoveContainer" containerID="c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a"
Jul 06 21:29:53.538746 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.538724    2554 generic.go:356] "Generic (PLEG): container finished" podID="5d3e6af6-9fc3-49db-a2c6-8dbe66ded600" containerID="ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b" exitCode=0
Jul 06 21:29:53.538799 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.538778    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86b6b594-gkwsw"
Jul 06 21:29:53.538843 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.538810    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b6b594-gkwsw" event={"ID":"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600","Type":"ContainerDied","Data":"ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b"}
Jul 06 21:29:53.538896 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.538843    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86b6b594-gkwsw" event={"ID":"5d3e6af6-9fc3-49db-a2c6-8dbe66ded600","Type":"ContainerDied","Data":"7273602f5fddb65f66d63ae6d6faad0f8108ee0c973da043eb5f21d8b24d1584"}
Jul 06 21:29:53.540096 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.540063    2554 generic.go:356] "Generic (PLEG): container finished" podID="f9c0fbe4-0bd7-460e-bda9-0559205d5cf8" containerID="d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6" exitCode=0
Jul 06 21:29:53.540204 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.540087    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w6qrl" event={"ID":"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8","Type":"ContainerDied","Data":"d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6"}
Jul 06 21:29:53.540204 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.540121    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w6qrl" event={"ID":"f9c0fbe4-0bd7-460e-bda9-0559205d5cf8","Type":"ContainerDied","Data":"440344e2463e1681747bdac1b36837db9b6e050c80aa40e26aae6075f8d8553d"}
Jul 06 21:29:53.540204 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.540135    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w6qrl"
Jul 06 21:29:53.548920 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.548877    2554 scope.go:117] "RemoveContainer" containerID="c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a"
Jul 06 21:29:53.549190 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:29:53.549166    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a\": container with ID starting with c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a not found: ID does not exist" containerID="c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a"
Jul 06 21:29:53.549262 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.549202    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a"} err="failed to get container status \"c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a\": rpc error: code = NotFound desc = could not find container \"c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a\": container with ID starting with c0fd3270acec853b8ae011087e6c71d95a8be6f1ced43f6fb67fcda753249e4a not found: ID does not exist"
Jul 06 21:29:53.549262 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.549227    2554 scope.go:117] "RemoveContainer" containerID="ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b"
Jul 06 21:29:53.557342 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.557327    2554 scope.go:117] "RemoveContainer" containerID="ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b"
Jul 06 21:29:53.557624 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:29:53.557607    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b\": container with ID starting with ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b not found: ID does not exist" containerID="ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b"
Jul 06 21:29:53.557682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.557631    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b"} err="failed to get container status \"ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b\": rpc error: code = NotFound desc = could not find container \"ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b\": container with ID starting with ebf6830ec0a19e46646b6403e8f5f9fe3d1ace8a56e8b0f1835ced9c479eb54b not found: ID does not exist"
Jul 06 21:29:53.557682 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.557646    2554 scope.go:117] "RemoveContainer" containerID="d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6"
Jul 06 21:29:53.565081 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.565064    2554 scope.go:117] "RemoveContainer" containerID="d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6"
Jul 06 21:29:53.565312 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:29:53.565295    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6\": container with ID starting with d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6 not found: ID does not exist" containerID="d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6"
Jul 06 21:29:53.565363 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.565318    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6"} err="failed to get container status \"d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6\": rpc error: code = NotFound desc = could not find container \"d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6\": container with ID starting with d19cdd76b4a028e691aacd96522b1dd229a28a0b511bf76ecd25fb9f07f8b7e6 not found: ID does not exist"
Jul 06 21:29:53.570100 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.570081    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86b6b594-gkwsw"]
Jul 06 21:29:53.574126 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.574106    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86b6b594-gkwsw"]
Jul 06 21:29:53.584884 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.584865    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w6qrl"]
Jul 06 21:29:53.587258 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.587239    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w6qrl"]
Jul 06 21:29:53.600915 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.600895    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5wls8"]
Jul 06 21:29:53.604312 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.604290    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5wls8"]
Jul 06 21:29:53.986581 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.986485    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d3e6af6-9fc3-49db-a2c6-8dbe66ded600" path="/var/lib/kubelet/pods/5d3e6af6-9fc3-49db-a2c6-8dbe66ded600/volumes"
Jul 06 21:29:53.987015 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.986966    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e465904-89b9-4cf5-854a-7bd8dc7583b0" path="/var/lib/kubelet/pods/6e465904-89b9-4cf5-854a-7bd8dc7583b0/volumes"
Jul 06 21:29:53.987316 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:29:53.987297    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9c0fbe4-0bd7-460e-bda9-0559205d5cf8" path="/var/lib/kubelet/pods/f9c0fbe4-0bd7-460e-bda9-0559205d5cf8/volumes"
Jul 06 21:31:04.117711 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.117674    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"]
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118019    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9c0fbe4-0bd7-460e-bda9-0559205d5cf8" containerName="authorino"
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118031    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9c0fbe4-0bd7-460e-bda9-0559205d5cf8" containerName="authorino"
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118044    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e465904-89b9-4cf5-854a-7bd8dc7583b0" containerName="authorino"
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118049    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e465904-89b9-4cf5-854a-7bd8dc7583b0" containerName="authorino"
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118063    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d3e6af6-9fc3-49db-a2c6-8dbe66ded600" containerName="authorino"
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118068    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d3e6af6-9fc3-49db-a2c6-8dbe66ded600" containerName="authorino"
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118129    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d3e6af6-9fc3-49db-a2c6-8dbe66ded600" containerName="authorino"
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118137    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9c0fbe4-0bd7-460e-bda9-0559205d5cf8" containerName="authorino"
Jul 06 21:31:04.118171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.118146    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e465904-89b9-4cf5-854a-7bd8dc7583b0" containerName="authorino"
Jul 06 21:31:04.120987 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.120971    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.123636 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.123611    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 21:31:04.124666 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.124650    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 21:31:04.124666 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.124660    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 21:31:04.124790 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.124688    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b5mbx\""
Jul 06 21:31:04.139760 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.139731    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"]
Jul 06 21:31:04.232004 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.231968    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.232171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.232019    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.232171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.232046    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtdtz\" (UniqueName: \"kubernetes.io/projected/98ee6afc-e342-46fe-b88d-ea4406eecc6c-kube-api-access-vtdtz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.232171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.232138    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.232171 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.232167    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ee6afc-e342-46fe-b88d-ea4406eecc6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.232307 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.232216    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.333597 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.333550    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.333597 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.333600    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtdtz\" (UniqueName: \"kubernetes.io/projected/98ee6afc-e342-46fe-b88d-ea4406eecc6c-kube-api-access-vtdtz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.333819 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.333632    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.333819 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.333647    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ee6afc-e342-46fe-b88d-ea4406eecc6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.333819 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.333677    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.333819 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.333705    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.334022 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.333999    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.334085 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.334035    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.334085 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.334064    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.335914 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.335895    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ee6afc-e342-46fe-b88d-ea4406eecc6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.336161 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.336143    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ee6afc-e342-46fe-b88d-ea4406eecc6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.343202 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.343182    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtdtz\" (UniqueName: \"kubernetes.io/projected/98ee6afc-e342-46fe-b88d-ea4406eecc6c-kube-api-access-vtdtz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c\" (UID: \"98ee6afc-e342-46fe-b88d-ea4406eecc6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.431186 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.431092    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:04.565627 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.565587    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"]
Jul 06 21:31:04.567670 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:31:04.567645    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ee6afc_e342_46fe_b88d_ea4406eecc6c.slice/crio-fb08286d761916d362d2ae3a7a46f437a690bda392409be43f03a1abf21ed89f WatchSource:0}: Error finding container fb08286d761916d362d2ae3a7a46f437a690bda392409be43f03a1abf21ed89f: Status 404 returned error can't find the container with id fb08286d761916d362d2ae3a7a46f437a690bda392409be43f03a1abf21ed89f
Jul 06 21:31:04.904914 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:04.904876    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c" event={"ID":"98ee6afc-e342-46fe-b88d-ea4406eecc6c","Type":"ContainerStarted","Data":"fb08286d761916d362d2ae3a7a46f437a690bda392409be43f03a1abf21ed89f"}
Jul 06 21:31:05.911524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:05.911491    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c" event={"ID":"98ee6afc-e342-46fe-b88d-ea4406eecc6c","Type":"ContainerStarted","Data":"4eb13d520d56be2f26cb7c51cc7f7c30e2b830c346e840bdde28283b044e4ee5"}
Jul 06 21:31:05.929607 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:05.929546    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c" podStartSLOduration=0.802792193 podStartE2EDuration="1.929525819s" totalImagesPullingTime="1.126733626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:31:05.928719284 +0000 UTC m=+574.550301624" watchObservedRunningTime="2026-07-06 21:31:05.929525819 +0000 UTC m=+574.551108147"
Jul 06 21:31:14.431952 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:14.431906    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:14.432426 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:14.431982    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:14.444571 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:14.444546    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:14.969193 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:14.969163    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c"
Jul 06 21:31:31.832980 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:31.832951    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:31:31.833356 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:31.832951    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:31:51.811752 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.811720    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"]
Jul 06 21:31:51.814974 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.814957    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:51.817692 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.817671    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 21:31:51.826043 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.826022    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"]
Jul 06 21:31:51.934672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.934632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjfhw\" (UniqueName: \"kubernetes.io/projected/1837d621-96ec-44d5-8d2e-7a86ed3641e5-kube-api-access-fjfhw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:51.934672 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.934674    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:51.934884 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.934706    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:51.934884 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.934739    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1837d621-96ec-44d5-8d2e-7a86ed3641e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:51.934884 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.934767    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:51.934884 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:51.934806    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036085 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036097    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036139    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjfhw\" (UniqueName: \"kubernetes.io/projected/1837d621-96ec-44d5-8d2e-7a86ed3641e5-kube-api-access-fjfhw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036164    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036193    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036213    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1837d621-96ec-44d5-8d2e-7a86ed3641e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036558 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036535    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036622 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036544    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.036622 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.036574    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.038512 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.038490    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1837d621-96ec-44d5-8d2e-7a86ed3641e5-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.038633 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.038617    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1837d621-96ec-44d5-8d2e-7a86ed3641e5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.044573 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.044557    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjfhw\" (UniqueName: \"kubernetes.io/projected/1837d621-96ec-44d5-8d2e-7a86ed3641e5-kube-api-access-fjfhw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-r8vl8\" (UID: \"1837d621-96ec-44d5-8d2e-7a86ed3641e5\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.126683 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.126586    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:31:52.258078 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.258053    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"]
Jul 06 21:31:52.259391 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:31:52.259366    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1837d621_96ec_44d5_8d2e_7a86ed3641e5.slice/crio-a69f07c0b2bdec540431231e52798ad077f1a101567d240c6369454c6e4d0c0c WatchSource:0}: Error finding container a69f07c0b2bdec540431231e52798ad077f1a101567d240c6369454c6e4d0c0c: Status 404 returned error can't find the container with id a69f07c0b2bdec540431231e52798ad077f1a101567d240c6369454c6e4d0c0c
Jul 06 21:31:52.260710 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:52.260694    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 21:31:53.151668 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:53.151578    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8" event={"ID":"1837d621-96ec-44d5-8d2e-7a86ed3641e5","Type":"ContainerStarted","Data":"e00581d9a8a384c8a5ddc024313a16abf878942480136899290e8e35ad34eeb7"}
Jul 06 21:31:53.151668 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:53.151634    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8" event={"ID":"1837d621-96ec-44d5-8d2e-7a86ed3641e5","Type":"ContainerStarted","Data":"a69f07c0b2bdec540431231e52798ad077f1a101567d240c6369454c6e4d0c0c"}
Jul 06 21:31:53.171058 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:31:53.171001    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8" podStartSLOduration=1.967992741 podStartE2EDuration="2.170985363s" totalImagesPullingTime="202.992622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:31:53.16901119 +0000 UTC m=+621.790593529" watchObservedRunningTime="2026-07-06 21:31:53.170985363 +0000 UTC m=+621.792567680"
Jul 06 21:32:02.127627 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:02.127595    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:32:02.128004 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:02.127647    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:32:02.140332 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:02.140300    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:32:02.216046 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:02.216020    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-r8vl8"
Jul 06 21:32:57.091258 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.091226    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-845967d4d7-ngmv5"]
Jul 06 21:32:57.094603 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.094586    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845967d4d7-ngmv5"
Jul 06 21:32:57.104342 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.104317    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-845967d4d7-ngmv5"]
Jul 06 21:32:57.212605 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.212567    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgf4n\" (UniqueName: \"kubernetes.io/projected/dbc0a1df-8bb3-477f-919a-0e8ac8c5733b-kube-api-access-mgf4n\") pod \"authorino-845967d4d7-ngmv5\" (UID: \"dbc0a1df-8bb3-477f-919a-0e8ac8c5733b\") " pod="kuadrant-system/authorino-845967d4d7-ngmv5"
Jul 06 21:32:57.212788 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.212634    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbc0a1df-8bb3-477f-919a-0e8ac8c5733b-tls-cert\") pod \"authorino-845967d4d7-ngmv5\" (UID: \"dbc0a1df-8bb3-477f-919a-0e8ac8c5733b\") " pod="kuadrant-system/authorino-845967d4d7-ngmv5"
Jul 06 21:32:57.314100 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.314059    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbc0a1df-8bb3-477f-919a-0e8ac8c5733b-tls-cert\") pod \"authorino-845967d4d7-ngmv5\" (UID: \"dbc0a1df-8bb3-477f-919a-0e8ac8c5733b\") " pod="kuadrant-system/authorino-845967d4d7-ngmv5"
Jul 06 21:32:57.314287 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.314156    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgf4n\" (UniqueName: \"kubernetes.io/projected/dbc0a1df-8bb3-477f-919a-0e8ac8c5733b-kube-api-access-mgf4n\") pod \"authorino-845967d4d7-ngmv5\" (UID: \"dbc0a1df-8bb3-477f-919a-0e8ac8c5733b\") " pod="kuadrant-system/authorino-845967d4d7-ngmv5"
Jul 06 21:32:57.316532 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.316508    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbc0a1df-8bb3-477f-919a-0e8ac8c5733b-tls-cert\") pod \"authorino-845967d4d7-ngmv5\" (UID: \"dbc0a1df-8bb3-477f-919a-0e8ac8c5733b\") " pod="kuadrant-system/authorino-845967d4d7-ngmv5"
Jul 06 21:32:57.323811 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.323780    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgf4n\" (UniqueName: \"kubernetes.io/projected/dbc0a1df-8bb3-477f-919a-0e8ac8c5733b-kube-api-access-mgf4n\") pod \"authorino-845967d4d7-ngmv5\" (UID: \"dbc0a1df-8bb3-477f-919a-0e8ac8c5733b\") " pod="kuadrant-system/authorino-845967d4d7-ngmv5"
Jul 06 21:32:57.404296 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.404203    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845967d4d7-ngmv5"
Jul 06 21:32:57.543055 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:57.543029    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-845967d4d7-ngmv5"]
Jul 06 21:32:57.545101 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:32:57.545073    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbc0a1df_8bb3_477f_919a_0e8ac8c5733b.slice/crio-8819d17be2274c6ce35dae5683e05df5c7dd0251fb1ab7b26f5861d83fc3f615 WatchSource:0}: Error finding container 8819d17be2274c6ce35dae5683e05df5c7dd0251fb1ab7b26f5861d83fc3f615: Status 404 returned error can't find the container with id 8819d17be2274c6ce35dae5683e05df5c7dd0251fb1ab7b26f5861d83fc3f615
Jul 06 21:32:58.498517 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:58.498467    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-845967d4d7-ngmv5" event={"ID":"dbc0a1df-8bb3-477f-919a-0e8ac8c5733b","Type":"ContainerStarted","Data":"b08f2b6b3c7cef33e2ac545bb8ba3a2ab8cd5d92f9d3a43b5a9c14911d160cbd"}
Jul 06 21:32:58.499001 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:58.498533    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-845967d4d7-ngmv5" event={"ID":"dbc0a1df-8bb3-477f-919a-0e8ac8c5733b","Type":"ContainerStarted","Data":"8819d17be2274c6ce35dae5683e05df5c7dd0251fb1ab7b26f5861d83fc3f615"}
Jul 06 21:32:58.528493 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:58.528414    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-845967d4d7-ngmv5" podStartSLOduration=1.12410799 podStartE2EDuration="1.528392588s" totalImagesPullingTime="404.284598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:32:58.527828888 +0000 UTC m=+687.149411202" watchObservedRunningTime="2026-07-06 21:32:58.528392588 +0000 UTC m=+687.149974906"
Jul 06 21:32:58.579549 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:58.579513    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-549d7966c8-9c4wx"]
Jul 06 21:32:58.579804 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:58.579724    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-549d7966c8-9c4wx" podUID="cde95054-b05a-4209-9cd3-efe73d8be849" containerName="authorino" containerID="cri-o://13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e" gracePeriod=30
Jul 06 21:32:58.856145 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:58.856120    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:32:59.031932 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.031826    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sxmg\" (UniqueName: \"kubernetes.io/projected/cde95054-b05a-4209-9cd3-efe73d8be849-kube-api-access-4sxmg\") pod \"cde95054-b05a-4209-9cd3-efe73d8be849\" (UID: \"cde95054-b05a-4209-9cd3-efe73d8be849\") "
Jul 06 21:32:59.031932 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.031897    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cde95054-b05a-4209-9cd3-efe73d8be849-tls-cert\") pod \"cde95054-b05a-4209-9cd3-efe73d8be849\" (UID: \"cde95054-b05a-4209-9cd3-efe73d8be849\") "
Jul 06 21:32:59.034070 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.034028    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde95054-b05a-4209-9cd3-efe73d8be849-kube-api-access-4sxmg" (OuterVolumeSpecName: "kube-api-access-4sxmg") pod "cde95054-b05a-4209-9cd3-efe73d8be849" (UID: "cde95054-b05a-4209-9cd3-efe73d8be849"). InnerVolumeSpecName "kube-api-access-4sxmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:32:59.042415 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.042383    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cde95054-b05a-4209-9cd3-efe73d8be849-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cde95054-b05a-4209-9cd3-efe73d8be849" (UID: "cde95054-b05a-4209-9cd3-efe73d8be849"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:32:59.132912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.132877    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sxmg\" (UniqueName: \"kubernetes.io/projected/cde95054-b05a-4209-9cd3-efe73d8be849-kube-api-access-4sxmg\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:32:59.132912 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.132909    2554 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cde95054-b05a-4209-9cd3-efe73d8be849-tls-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:32:59.506251 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.506221    2554 generic.go:356] "Generic (PLEG): container finished" podID="cde95054-b05a-4209-9cd3-efe73d8be849" containerID="13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e" exitCode=0
Jul 06 21:32:59.506712 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.506290    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-549d7966c8-9c4wx"
Jul 06 21:32:59.506712 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.506306    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549d7966c8-9c4wx" event={"ID":"cde95054-b05a-4209-9cd3-efe73d8be849","Type":"ContainerDied","Data":"13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e"}
Jul 06 21:32:59.506712 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.506346    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-549d7966c8-9c4wx" event={"ID":"cde95054-b05a-4209-9cd3-efe73d8be849","Type":"ContainerDied","Data":"45fa736f58f29f2772a478d65fca46a9f1870cc33193749e7f3d8b7537cf10b6"}
Jul 06 21:32:59.506712 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.506362    2554 scope.go:117] "RemoveContainer" containerID="13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e"
Jul 06 21:32:59.517785 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.517763    2554 scope.go:117] "RemoveContainer" containerID="13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e"
Jul 06 21:32:59.518075 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:32:59.518054    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e\": container with ID starting with 13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e not found: ID does not exist" containerID="13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e"
Jul 06 21:32:59.518151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.518083    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e"} err="failed to get container status \"13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e\": rpc error: code = NotFound desc = could not find container \"13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e\": container with ID starting with 13e16d45f67a809756efe5e7cce444b3eeb11d9a90b9bb2ba5854a1d7748e12e not found: ID does not exist"
Jul 06 21:32:59.544976 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.544937    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-549d7966c8-9c4wx"]
Jul 06 21:32:59.557929 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.557881    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-549d7966c8-9c4wx"]
Jul 06 21:32:59.986959 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:32:59.986927    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde95054-b05a-4209-9cd3-efe73d8be849" path="/var/lib/kubelet/pods/cde95054-b05a-4209-9cd3-efe73d8be849/volumes"
Jul 06 21:36:31.869184 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:36:31.869107    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:36:31.869961 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:36:31.869935    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:41:31.904423 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:41:31.904390    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:41:31.906457 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:41:31.906415    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:45:00.150975 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.150939    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722905-ww9bs"]
Jul 06 21:45:00.151474 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.151287    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde95054-b05a-4209-9cd3-efe73d8be849" containerName="authorino"
Jul 06 21:45:00.151474 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.151298    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde95054-b05a-4209-9cd3-efe73d8be849" containerName="authorino"
Jul 06 21:45:00.151474 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.151385    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde95054-b05a-4209-9cd3-efe73d8be849" containerName="authorino"
Jul 06 21:45:00.154512 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.154498    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs"
Jul 06 21:45:00.157245 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.157210    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cxwgs\""
Jul 06 21:45:00.173872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.173835    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722905-ww9bs"]
Jul 06 21:45:00.258328 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.258292    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wllw\" (UniqueName: \"kubernetes.io/projected/074b350b-6883-478e-9a83-0e2551b6c2f3-kube-api-access-9wllw\") pod \"maas-api-key-cleanup-29722905-ww9bs\" (UID: \"074b350b-6883-478e-9a83-0e2551b6c2f3\") " pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs"
Jul 06 21:45:00.359512 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.359478    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wllw\" (UniqueName: \"kubernetes.io/projected/074b350b-6883-478e-9a83-0e2551b6c2f3-kube-api-access-9wllw\") pod \"maas-api-key-cleanup-29722905-ww9bs\" (UID: \"074b350b-6883-478e-9a83-0e2551b6c2f3\") " pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs"
Jul 06 21:45:00.369098 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.369068    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wllw\" (UniqueName: \"kubernetes.io/projected/074b350b-6883-478e-9a83-0e2551b6c2f3-kube-api-access-9wllw\") pod \"maas-api-key-cleanup-29722905-ww9bs\" (UID: \"074b350b-6883-478e-9a83-0e2551b6c2f3\") " pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs"
Jul 06 21:45:00.464398 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.464320    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs"
Jul 06 21:45:00.596921 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.596896    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722905-ww9bs"]
Jul 06 21:45:00.599185 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:45:00.599161    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074b350b_6883_478e_9a83_0e2551b6c2f3.slice/crio-f7d259aff1af15cb584d2f22e0645c4ad839e1b6102b2bdcf8e7f2d84f9d4e38 WatchSource:0}: Error finding container f7d259aff1af15cb584d2f22e0645c4ad839e1b6102b2bdcf8e7f2d84f9d4e38: Status 404 returned error can't find the container with id f7d259aff1af15cb584d2f22e0645c4ad839e1b6102b2bdcf8e7f2d84f9d4e38
Jul 06 21:45:00.600996 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:00.600978    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 21:45:01.277051 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:01.277012    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs" event={"ID":"074b350b-6883-478e-9a83-0e2551b6c2f3","Type":"ContainerStarted","Data":"f7d259aff1af15cb584d2f22e0645c4ad839e1b6102b2bdcf8e7f2d84f9d4e38"}
Jul 06 21:45:04.296740 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:04.296706    2554 generic.go:356] "Generic (PLEG): container finished" podID="074b350b-6883-478e-9a83-0e2551b6c2f3" containerID="f0fef4b5fe771cbabdf82c7cc12e6c92e9c26ac936e9c97f985e95a0dc441589" exitCode=0
Jul 06 21:45:04.297185 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:04.296796    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs" event={"ID":"074b350b-6883-478e-9a83-0e2551b6c2f3","Type":"ContainerDied","Data":"f0fef4b5fe771cbabdf82c7cc12e6c92e9c26ac936e9c97f985e95a0dc441589"}
Jul 06 21:45:05.442217 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:05.442189    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs"
Jul 06 21:45:05.611011 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:05.610936    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wllw\" (UniqueName: \"kubernetes.io/projected/074b350b-6883-478e-9a83-0e2551b6c2f3-kube-api-access-9wllw\") pod \"074b350b-6883-478e-9a83-0e2551b6c2f3\" (UID: \"074b350b-6883-478e-9a83-0e2551b6c2f3\") "
Jul 06 21:45:05.613117 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:05.613087    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074b350b-6883-478e-9a83-0e2551b6c2f3-kube-api-access-9wllw" (OuterVolumeSpecName: "kube-api-access-9wllw") pod "074b350b-6883-478e-9a83-0e2551b6c2f3" (UID: "074b350b-6883-478e-9a83-0e2551b6c2f3"). InnerVolumeSpecName "kube-api-access-9wllw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:45:05.711695 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:05.711658    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wllw\" (UniqueName: \"kubernetes.io/projected/074b350b-6883-478e-9a83-0e2551b6c2f3-kube-api-access-9wllw\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:45:06.309215 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:06.309192    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs"
Jul 06 21:45:06.309386 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:06.309190    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722905-ww9bs" event={"ID":"074b350b-6883-478e-9a83-0e2551b6c2f3","Type":"ContainerDied","Data":"f7d259aff1af15cb584d2f22e0645c4ad839e1b6102b2bdcf8e7f2d84f9d4e38"}
Jul 06 21:45:06.309386 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:45:06.309312    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7d259aff1af15cb584d2f22e0645c4ad839e1b6102b2bdcf8e7f2d84f9d4e38"
Jul 06 21:46:11.160569 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.160535    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"]
Jul 06 21:46:11.161094 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.161076    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="074b350b-6883-478e-9a83-0e2551b6c2f3" containerName="cleanup"
Jul 06 21:46:11.161139 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.161099    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="074b350b-6883-478e-9a83-0e2551b6c2f3" containerName="cleanup"
Jul 06 21:46:11.161247 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.161235    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="074b350b-6883-478e-9a83-0e2551b6c2f3" containerName="cleanup"
Jul 06 21:46:11.164635 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.164605    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.168119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.168099    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6b851c3b-openshift-default-dockercfg-q7z5q\""
Jul 06 21:46:11.179942 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.179919    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"]
Jul 06 21:46:11.213224 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213192    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r92tm\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-kube-api-access-r92tm\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.213224 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213230    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-envoy\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.213520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213247    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istiod-ca-cert\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.213520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213323    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-certs\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.213520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213358    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-data\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.213520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213407    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-token\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.213520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213473    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-socket\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.213520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213507    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-credential-socket\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.213744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.213572    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-podinfo\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314027 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.313994    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-certs\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314027 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314026    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-data\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314060    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-token\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314102    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-socket\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314133    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-credential-socket\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314261 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314169    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-podinfo\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314465 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314290    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r92tm\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-kube-api-access-r92tm\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314465 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314339    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-envoy\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314589    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-data\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314614 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314538    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-certs\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314723 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314602    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istiod-ca-cert\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314723 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314679    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-credential-socket\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.314831 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.314792    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-socket\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.315100 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.315081    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istiod-ca-cert\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.316574 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.316551    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-envoy\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.316721 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.316704    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-podinfo\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.322336 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.322311    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-token\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.322590 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.322574    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r92tm\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-kube-api-access-r92tm\") pod \"e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") " pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.475209 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.475124    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:11.615029 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.614999    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"]
Jul 06 21:46:11.617120 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:46:11.617094    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26c2d5e_d398_46b6_a1f7_b0c31febdb6f.slice/crio-4a6ef67a4954c0b38d8661fe7aaf17487ab562034a9f8bbf59b65076096d2fcb WatchSource:0}: Error finding container 4a6ef67a4954c0b38d8661fe7aaf17487ab562034a9f8bbf59b65076096d2fcb: Status 404 returned error can't find the container with id 4a6ef67a4954c0b38d8661fe7aaf17487ab562034a9f8bbf59b65076096d2fcb
Jul 06 21:46:11.619608 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.619572    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:46:11.619703 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.619641    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:46:11.619703 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.619670    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:46:11.648025 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:11.648000    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5" event={"ID":"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f","Type":"ContainerStarted","Data":"4a6ef67a4954c0b38d8661fe7aaf17487ab562034a9f8bbf59b65076096d2fcb"}
Jul 06 21:46:12.661015 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:12.660979    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5" event={"ID":"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f","Type":"ContainerStarted","Data":"2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250"}
Jul 06 21:46:12.688002 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:12.687953    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5" podStartSLOduration=1.687937743 podStartE2EDuration="1.687937743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:46:12.684644424 +0000 UTC m=+1481.306226745" watchObservedRunningTime="2026-07-06 21:46:12.687937743 +0000 UTC m=+1481.309520059"
Jul 06 21:46:13.476044 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:13.476009    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:13.480914 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:13.480887    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:13.666249 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:13.666222    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:13.667096 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:13.667081    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:17.642321 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:17.642285    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"]
Jul 06 21:46:17.642829 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:17.642495    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5" podUID="e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" containerName="istio-proxy" containerID="cri-o://2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250" gracePeriod=30
Jul 06 21:46:24.501371 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.501349    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:24.646148 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646057    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-certs\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646148 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646105    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-socket\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646148 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646154    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r92tm\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-kube-api-access-r92tm\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646180    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-data\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646200    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-podinfo\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646339    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:24.646461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646396    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-credential-socket\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646453    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istiod-ca-cert\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646748 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646527    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-envoy\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646748 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646536    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:24.646748 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646570    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-token\") pod \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\" (UID: \"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f\") "
Jul 06 21:46:24.646748 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646657    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:24.646966 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646838    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:46:24.646966 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646925    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.646966 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646941    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-workload-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.646966 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646955    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-credential-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.647179 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.646968    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istiod-ca-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.647179 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.647079    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:24.648883 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.648859    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-kube-api-access-r92tm" (OuterVolumeSpecName: "kube-api-access-r92tm") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "kube-api-access-r92tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:46:24.649059 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.649028    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:46:24.649159 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.649078    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:24.649159 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.649107    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" (UID: "e26c2d5e-d398-46b6-a1f7-b0c31febdb6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:46:24.723461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.723417    2554 generic.go:356] "Generic (PLEG): container finished" podID="e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" containerID="2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250" exitCode=0
Jul 06 21:46:24.723651 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.723497    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"
Jul 06 21:46:24.723651 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.723503    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5" event={"ID":"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f","Type":"ContainerDied","Data":"2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250"}
Jul 06 21:46:24.723651 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.723556    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5" event={"ID":"e26c2d5e-d398-46b6-a1f7-b0c31febdb6f","Type":"ContainerDied","Data":"4a6ef67a4954c0b38d8661fe7aaf17487ab562034a9f8bbf59b65076096d2fcb"}
Jul 06 21:46:24.723651 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.723568    2554 scope.go:117] "RemoveContainer" containerID="2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250"
Jul 06 21:46:24.733151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.733135    2554 scope.go:117] "RemoveContainer" containerID="2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250"
Jul 06 21:46:24.733375 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:46:24.733358    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250\": container with ID starting with 2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250 not found: ID does not exist" containerID="2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250"
Jul 06 21:46:24.733445 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.733382    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250"} err="failed to get container status \"2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250\": rpc error: code = NotFound desc = could not find container \"2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250\": container with ID starting with 2abc1326171b4c3dc16626d838f250e614808251e4d3b2d788c7793829f3e250 not found: ID does not exist"
Jul 06 21:46:24.748457 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.748413    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-envoy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.748457 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.748459    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.748630 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.748474    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r92tm\" (UniqueName: \"kubernetes.io/projected/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-kube-api-access-r92tm\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.748630 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.748489    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-data\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.748630 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.748501    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f-istio-podinfo\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:24.748739 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.748657    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"]
Jul 06 21:46:24.753410 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:24.753388    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6b851c3b-openshift-default-7c97dfc7c5-pl4b5"]
Jul 06 21:46:25.992717 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:25.987595    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" path="/var/lib/kubelet/pods/e26c2d5e-d398-46b6-a1f7-b0c31febdb6f/volumes"
Jul 06 21:46:31.946451 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:31.946410    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:46:31.949353 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:31.949329    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:46:42.492807 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.492777    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"]
Jul 06 21:46:42.493186 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.493172    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" containerName="istio-proxy"
Jul 06 21:46:42.493186 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.493184    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" containerName="istio-proxy"
Jul 06 21:46:42.493259 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.493250    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e26c2d5e-d398-46b6-a1f7-b0c31febdb6f" containerName="istio-proxy"
Jul 06 21:46:42.495841 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.495820    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.499525 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.499504    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c14d9971-openshift-default-dockercfg-wrsjx\""
Jul 06 21:46:42.524359 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.524325    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"]
Jul 06 21:46:42.609692 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.609656    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-envoy\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.609877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.609702    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e1a310-e081-49c7-b921-20743ddc2756-istiod-ca-cert\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.609877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.609785    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-728sk\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-kube-api-access-728sk\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.609877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.609843    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-data\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.610036 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.609892    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-certs\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.610036 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.609962    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e1a310-e081-49c7-b921-20743ddc2756-istio-podinfo\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.610036 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.610012    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-istio-token\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.610201 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.610046    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-credential-socket\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.610201 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.610134    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-socket\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.710922 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.710882    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-istio-token\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.710922 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.710932    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-credential-socket\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711188 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.710960    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-socket\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711188 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711006    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-envoy\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711188 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711023    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e1a310-e081-49c7-b921-20743ddc2756-istiod-ca-cert\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711188 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711043    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-728sk\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-kube-api-access-728sk\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711188 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711073    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-data\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711188 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711098    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-certs\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711188 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711129    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e1a310-e081-49c7-b921-20743ddc2756-istio-podinfo\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711555 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711420    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-socket\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711555 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711517    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-data\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711642 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711567    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-credential-socket\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.711678 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.711639    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-certs\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.712107 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.712081    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e1a310-e081-49c7-b921-20743ddc2756-istiod-ca-cert\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.713487 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.713466    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-envoy\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.713567 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.713550    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e1a310-e081-49c7-b921-20743ddc2756-istio-podinfo\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.719230 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.719206    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-istio-token\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.719450 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.719417    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-728sk\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-kube-api-access-728sk\") pod \"e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") " pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.806786 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.806750    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:42.947322 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.947293    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"]
Jul 06 21:46:42.948726 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:46:42.948694    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e1a310_e081_49c7_b921_20743ddc2756.slice/crio-34ac52b61ba8ec76cabf335c914d3d0432e00427b816f94ee28515acb3c644bf WatchSource:0}: Error finding container 34ac52b61ba8ec76cabf335c914d3d0432e00427b816f94ee28515acb3c644bf: Status 404 returned error can't find the container with id 34ac52b61ba8ec76cabf335c914d3d0432e00427b816f94ee28515acb3c644bf
Jul 06 21:46:42.950910 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.950878    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:46:42.950998 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.950953    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:46:42.951066 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:42.950995    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:46:43.826954 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:43.826912    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79" event={"ID":"78e1a310-e081-49c7-b921-20743ddc2756","Type":"ContainerStarted","Data":"f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7"}
Jul 06 21:46:43.827340 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:43.826967    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79" event={"ID":"78e1a310-e081-49c7-b921-20743ddc2756","Type":"ContainerStarted","Data":"34ac52b61ba8ec76cabf335c914d3d0432e00427b816f94ee28515acb3c644bf"}
Jul 06 21:46:43.855220 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:43.855154    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79" podStartSLOduration=1.855138104 podStartE2EDuration="1.855138104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:46:43.85373558 +0000 UTC m=+1512.475317897" watchObservedRunningTime="2026-07-06 21:46:43.855138104 +0000 UTC m=+1512.476720420"
Jul 06 21:46:44.807423 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:44.807389    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:44.813244 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:44.813217    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:44.832828 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:44.832796    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:44.833799 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:44.833783    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:48.285250 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:48.285217    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"]
Jul 06 21:46:48.285706 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:48.285385    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79" podUID="78e1a310-e081-49c7-b921-20743ddc2756" containerName="istio-proxy" containerID="cri-o://f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7" gracePeriod=30
Jul 06 21:46:54.426391 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.426369    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:54.528178 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528145    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-data\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528178 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528184    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-istio-token\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528396 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528202    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-credential-socket\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528494 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528409    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-certs\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528494 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528483    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-socket\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528601 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528541    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:54.528601 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528559    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e1a310-e081-49c7-b921-20743ddc2756-istiod-ca-cert\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528601 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528586    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-728sk\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-kube-api-access-728sk\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528755 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528645    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e1a310-e081-49c7-b921-20743ddc2756-istio-podinfo\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528755 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528647    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:54.528755 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528685    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-envoy\") pod \"78e1a310-e081-49c7-b921-20743ddc2756\" (UID: \"78e1a310-e081-49c7-b921-20743ddc2756\") "
Jul 06 21:46:54.528755 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528739    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:54.528965 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528947    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-credential-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.529024 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528959    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e1a310-e081-49c7-b921-20743ddc2756-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:46:54.529024 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.528970    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.529024 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.529006    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-workload-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.529176 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.529125    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-data" (OuterVolumeSpecName: "istio-data") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:54.530454 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.530397    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-istio-token" (OuterVolumeSpecName: "istio-token") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:46:54.530767 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.530744    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-kube-api-access-728sk" (OuterVolumeSpecName: "kube-api-access-728sk") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "kube-api-access-728sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:46:54.530886 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.530869    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/78e1a310-e081-49c7-b921-20743ddc2756-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:46:54.530928 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.530872    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "78e1a310-e081-49c7-b921-20743ddc2756" (UID: "78e1a310-e081-49c7-b921-20743ddc2756"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:54.630603 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.630568    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78e1a310-e081-49c7-b921-20743ddc2756-istiod-ca-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.630603 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.630605    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-728sk\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-kube-api-access-728sk\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.630796 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.630622    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78e1a310-e081-49c7-b921-20743ddc2756-istio-podinfo\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.630796 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.630639    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-envoy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.630796 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.630653    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78e1a310-e081-49c7-b921-20743ddc2756-istio-data\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.630796 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.630668    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78e1a310-e081-49c7-b921-20743ddc2756-istio-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:46:54.913842 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.913759    2554 generic.go:356] "Generic (PLEG): container finished" podID="78e1a310-e081-49c7-b921-20743ddc2756" containerID="f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7" exitCode=0
Jul 06 21:46:54.913842 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.913808    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"
Jul 06 21:46:54.914128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.913844    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79" event={"ID":"78e1a310-e081-49c7-b921-20743ddc2756","Type":"ContainerDied","Data":"f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7"}
Jul 06 21:46:54.914128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.913901    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79" event={"ID":"78e1a310-e081-49c7-b921-20743ddc2756","Type":"ContainerDied","Data":"34ac52b61ba8ec76cabf335c914d3d0432e00427b816f94ee28515acb3c644bf"}
Jul 06 21:46:54.914128 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.913916    2554 scope.go:117] "RemoveContainer" containerID="f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7"
Jul 06 21:46:54.923586 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.923564    2554 scope.go:117] "RemoveContainer" containerID="f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7"
Jul 06 21:46:54.923833 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:46:54.923817    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7\": container with ID starting with f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7 not found: ID does not exist" containerID="f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7"
Jul 06 21:46:54.923900 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.923839    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7"} err="failed to get container status \"f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7\": rpc error: code = NotFound desc = could not find container \"f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7\": container with ID starting with f37fdb27e5221384d9d8cc6204494f018b5b4f64b043c6976e04889a2ac535f7 not found: ID does not exist"
Jul 06 21:46:54.944226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.944201    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"]
Jul 06 21:46:54.960864 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:54.960837    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c14d9971-openshift-default-56f657d7dc-k5k79"]
Jul 06 21:46:55.986848 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:46:55.986816    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78e1a310-e081-49c7-b921-20743ddc2756" path="/var/lib/kubelet/pods/78e1a310-e081-49c7-b921-20743ddc2756/volumes"
Jul 06 21:48:31.323335 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.323263    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"]
Jul 06 21:48:31.323787 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.323635    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78e1a310-e081-49c7-b921-20743ddc2756" containerName="istio-proxy"
Jul 06 21:48:31.323787 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.323647    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="78e1a310-e081-49c7-b921-20743ddc2756" containerName="istio-proxy"
Jul 06 21:48:31.323787 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.323731    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="78e1a310-e081-49c7-b921-20743ddc2756" containerName="istio-proxy"
Jul 06 21:48:31.325754 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.325739    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.331561 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.331537    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9f64f2fa-openshift-default-dockercfg-tc8jc\""
Jul 06 21:48:31.354767 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.354743    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"]
Jul 06 21:48:31.405807 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.405778    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-socket\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.405807 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.405807    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-credential-socket\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.406012 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.405856    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-data\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.406012 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.405914    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-certs\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.406012 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.405949    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-podinfo\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.406012 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.405968    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-envoy\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.406158 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.406085    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-token\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.406158 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.406124    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istiod-ca-cert\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.406231 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.406161    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89dtz\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-kube-api-access-89dtz\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.506648 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506600    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-envoy\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.506814 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506685    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-token\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.506814 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506705    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istiod-ca-cert\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.506814 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89dtz\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-kube-api-access-89dtz\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.506814 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506768    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-socket\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.506814 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506790    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-credential-socket\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.507063 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506839    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-data\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.507063 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506885    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-certs\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.507063 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.506930    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-podinfo\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.507201 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.507111    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-socket\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.507391 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.507368    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-data\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.507488 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.507397    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-credential-socket\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.507488 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.507461    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istiod-ca-cert\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.507563 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.507490    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-certs\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.508895 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.508874    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-envoy\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.509227 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.509211    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-podinfo\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.519364 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.519338    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-token\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.529322 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.529301    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89dtz\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-kube-api-access-89dtz\") pod \"e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") " pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.636821 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.636724    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:31.775469 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.775442    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"]
Jul 06 21:48:31.777400 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:48:31.777373    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667f7bdc_646a_46ff_ac6e_6f73993b69fd.slice/crio-0053364dd7ee1e538240b6e785589e885068862465bd18bcbacf37c477077d61 WatchSource:0}: Error finding container 0053364dd7ee1e538240b6e785589e885068862465bd18bcbacf37c477077d61: Status 404 returned error can't find the container with id 0053364dd7ee1e538240b6e785589e885068862465bd18bcbacf37c477077d61
Jul 06 21:48:31.786390 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.781936    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:48:31.786390 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.782301    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:48:31.786390 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:31.782473    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:48:32.415062 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:32.415026    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" event={"ID":"667f7bdc-646a-46ff-ac6e-6f73993b69fd","Type":"ContainerStarted","Data":"3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600"}
Jul 06 21:48:32.415592 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:32.415095    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" event={"ID":"667f7bdc-646a-46ff-ac6e-6f73993b69fd","Type":"ContainerStarted","Data":"0053364dd7ee1e538240b6e785589e885068862465bd18bcbacf37c477077d61"}
Jul 06 21:48:32.442896 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:32.442851    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" podStartSLOduration=1.442836191 podStartE2EDuration="1.442836191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:48:32.44063123 +0000 UTC m=+1621.062213548" watchObservedRunningTime="2026-07-06 21:48:32.442836191 +0000 UTC m=+1621.064418507"
Jul 06 21:48:32.637215 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:32.637178    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:32.638749 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:32.638720    2554 patch_prober.go:28] interesting pod/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 21:48:32.638890 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:32.638780    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 21:48:33.641251 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:33.641220    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:34.425999 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:34.425964    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:34.426807 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:34.426790    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:49.428041 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:49.427945    2554 patch_prober.go:28] interesting pod/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 21:48:49.428041 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:49.428007    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 21:48:49.515831 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:49.515803    2554 generic.go:356] "Generic (PLEG): container finished" podID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerID="3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600" exitCode=0
Jul 06 21:48:49.516002 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:49.515864    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" event={"ID":"667f7bdc-646a-46ff-ac6e-6f73993b69fd","Type":"ContainerDied","Data":"3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600"}
Jul 06 21:48:49.516257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:49.516229    2554 scope.go:117] "RemoveContainer" containerID="3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600"
Jul 06 21:48:49.517233 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:49.517204    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:48:49.517287 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:49.517271    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:48:49.517324 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:49.517305    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:48:50.523492 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:50.523458    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" event={"ID":"667f7bdc-646a-46ff-ac6e-6f73993b69fd","Type":"ContainerStarted","Data":"6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6"}
Jul 06 21:48:50.637501 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:50.637424    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:50.642049 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:50.642020    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:51.529314 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:51.529285    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:51.530395 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:51.530379    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:53.369355 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:53.369317    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"]
Jul 06 21:48:53.539693 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:53.539659    2554 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" secret="" err="secret \"e2e-mt-9f64f2fa-openshift-default-dockercfg-tc8jc\" not found"
Jul 06 21:48:54.544802 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:54.544740    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy" containerID="cri-o://6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6" gracePeriod=30
Jul 06 21:48:59.799632 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.799608    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:48:59.865125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865034    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-certs\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865070    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istiod-ca-cert\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865093    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-credential-socket\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865125 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865115    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-podinfo\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865480 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865138    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-token\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865480 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865205    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-socket\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865480 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865229    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-data\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865480 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865270    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89dtz\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-kube-api-access-89dtz\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865480 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865320    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:48:59.865480 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865300    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-envoy\") pod \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\" (UID: \"667f7bdc-646a-46ff-ac6e-6f73993b69fd\") "
Jul 06 21:48:59.865480 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865369    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:48:59.865811 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865500    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:48:59.865811 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865537    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:48:59.865811 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865707    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:48:59.865811 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865726    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-workload-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:48:59.865811 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.865740    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-credential-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:48:59.866227 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.866203    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:48:59.867568 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.867541    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:48:59.867687 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.867575    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:48:59.867909 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.867889    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-kube-api-access-89dtz" (OuterVolumeSpecName: "kube-api-access-89dtz") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "kube-api-access-89dtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:48:59.867950 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.867881    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "667f7bdc-646a-46ff-ac6e-6f73993b69fd" (UID: "667f7bdc-646a-46ff-ac6e-6f73993b69fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:48:59.966424 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.966383    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-data\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:48:59.966424 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.966420    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89dtz\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-kube-api-access-89dtz\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:48:59.966424 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.966459    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-envoy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:48:59.966702 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.966469    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istiod-ca-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:48:59.966702 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.966478    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-podinfo\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:48:59.966702 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:48:59.966486    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/667f7bdc-646a-46ff-ac6e-6f73993b69fd-istio-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:49:00.584801 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.584766    2554 generic.go:356] "Generic (PLEG): container finished" podID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerID="6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6" exitCode=0
Jul 06 21:49:00.584988 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.584817    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"
Jul 06 21:49:00.584988 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.584850    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" event={"ID":"667f7bdc-646a-46ff-ac6e-6f73993b69fd","Type":"ContainerDied","Data":"6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6"}
Jul 06 21:49:00.584988 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.584908    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd" event={"ID":"667f7bdc-646a-46ff-ac6e-6f73993b69fd","Type":"ContainerDied","Data":"0053364dd7ee1e538240b6e785589e885068862465bd18bcbacf37c477077d61"}
Jul 06 21:49:00.584988 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.584933    2554 scope.go:117] "RemoveContainer" containerID="6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6"
Jul 06 21:49:00.594071 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.594049    2554 scope.go:117] "RemoveContainer" containerID="3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600"
Jul 06 21:49:00.602623 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.602602    2554 scope.go:117] "RemoveContainer" containerID="6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6"
Jul 06 21:49:00.602953 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:49:00.602930    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6\": container with ID starting with 6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6 not found: ID does not exist" containerID="6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6"
Jul 06 21:49:00.603046 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.602961    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6"} err="failed to get container status \"6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6\": rpc error: code = NotFound desc = could not find container \"6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6\": container with ID starting with 6515ae21de1dfd8e7c42d4f4c7437d5adc62b5bb534f627ae8a3194146d0f0d6 not found: ID does not exist"
Jul 06 21:49:00.603046 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.602980    2554 scope.go:117] "RemoveContainer" containerID="3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600"
Jul 06 21:49:00.603232 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:49:00.603213    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600\": container with ID starting with 3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600 not found: ID does not exist" containerID="3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600"
Jul 06 21:49:00.603275 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.603243    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600"} err="failed to get container status \"3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600\": rpc error: code = NotFound desc = could not find container \"3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600\": container with ID starting with 3668a20d9ba6ce067d128e36d1a1bde7e766c9813490d0d140a3596f16872600 not found: ID does not exist"
Jul 06 21:49:00.620332 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.620295    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"]
Jul 06 21:49:00.627373 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:00.627348    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9f64f2fa-openshift-default-85cbff75bc-89mzd"]
Jul 06 21:49:01.986725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:01.986694    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" path="/var/lib/kubelet/pods/667f7bdc-646a-46ff-ac6e-6f73993b69fd/volumes"
Jul 06 21:49:13.217794 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.217764    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"]
Jul 06 21:49:13.218225 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.218159    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy"
Jul 06 21:49:13.218225 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.218176    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy"
Jul 06 21:49:13.218225 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.218186    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy"
Jul 06 21:49:13.218225 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.218195    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy"
Jul 06 21:49:13.218360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.218285    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy"
Jul 06 21:49:13.221453 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.221423    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.224003 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.223977    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f377e18b-openshift-default-dockercfg-h7ft6\""
Jul 06 21:49:13.231732 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.231709    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"]
Jul 06 21:49:13.269112 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269081    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-istio-token\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.269253 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269160    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-certs\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.269253 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d01f3206-1abb-4e07-a158-e253f5801679-istio-podinfo\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.269253 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269244    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-envoy\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.269414 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269305    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s74c8\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-kube-api-access-s74c8\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.269414 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269350    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d01f3206-1abb-4e07-a158-e253f5801679-istiod-ca-cert\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.269704 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269415    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-credential-socket\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.269704 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269455    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-data\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.269704 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.269477    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-socket\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.370524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370488    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-credential-socket\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.370524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370529    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-data\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.370766 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370554    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-socket\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.370766 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370591    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-istio-token\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.370766 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370616    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-certs\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.370766 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370630    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d01f3206-1abb-4e07-a158-e253f5801679-istio-podinfo\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.370766 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370690    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-envoy\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.370766 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370729    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s74c8\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-kube-api-access-s74c8\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.371092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370901    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d01f3206-1abb-4e07-a158-e253f5801679-istiod-ca-cert\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.371092 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.370947    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-data\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.371214 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.371194    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-certs\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.371275 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.371247    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-socket\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.371341 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.371277    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-credential-socket\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.371593 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.371577    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d01f3206-1abb-4e07-a158-e253f5801679-istiod-ca-cert\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.372917 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.372899    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-envoy\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.373136 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.373117    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d01f3206-1abb-4e07-a158-e253f5801679-istio-podinfo\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.382498 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.382476    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s74c8\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-kube-api-access-s74c8\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.384563 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.384539    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-istio-token\") pod \"e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") " pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.533056 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.533018    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:13.671656 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.671630    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"]
Jul 06 21:49:13.673267 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:49:13.673241    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01f3206_1abb_4e07_a158_e253f5801679.slice/crio-26bc69b2a8008c2328faeeeebed5ee3c72d143e22e8b10b6c9c5334dbf125b76 WatchSource:0}: Error finding container 26bc69b2a8008c2328faeeeebed5ee3c72d143e22e8b10b6c9c5334dbf125b76: Status 404 returned error can't find the container with id 26bc69b2a8008c2328faeeeebed5ee3c72d143e22e8b10b6c9c5334dbf125b76
Jul 06 21:49:13.675474 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.675420    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:49:13.675582 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.675518    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:49:13.675582 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:13.675563    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:49:14.659871 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:14.659833    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" event={"ID":"d01f3206-1abb-4e07-a158-e253f5801679","Type":"ContainerStarted","Data":"31ee2a7475195e8cf1ef80782d790ca66dde3089d622f2db1c26ccaf1d1afe5e"}
Jul 06 21:49:14.660260 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:14.659894    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" event={"ID":"d01f3206-1abb-4e07-a158-e253f5801679","Type":"ContainerStarted","Data":"26bc69b2a8008c2328faeeeebed5ee3c72d143e22e8b10b6c9c5334dbf125b76"}
Jul 06 21:49:14.683965 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:14.683917    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" podStartSLOduration=1.6838974009999998 podStartE2EDuration="1.683897401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:49:14.681814665 +0000 UTC m=+1663.303396996" watchObservedRunningTime="2026-07-06 21:49:14.683897401 +0000 UTC m=+1663.305479718"
Jul 06 21:49:15.533209 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:15.533172    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:15.538165 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:15.538137    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:15.665729 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:15.665697    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:15.666677 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:15.666658    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:28.739097 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:28.739064    2554 generic.go:356] "Generic (PLEG): container finished" podID="d01f3206-1abb-4e07-a158-e253f5801679" containerID="31ee2a7475195e8cf1ef80782d790ca66dde3089d622f2db1c26ccaf1d1afe5e" exitCode=0
Jul 06 21:49:28.739516 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:28.739140    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" event={"ID":"d01f3206-1abb-4e07-a158-e253f5801679","Type":"ContainerDied","Data":"31ee2a7475195e8cf1ef80782d790ca66dde3089d622f2db1c26ccaf1d1afe5e"}
Jul 06 21:49:28.739564 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:28.739544    2554 scope.go:117] "RemoveContainer" containerID="31ee2a7475195e8cf1ef80782d790ca66dde3089d622f2db1c26ccaf1d1afe5e"
Jul 06 21:49:28.740536 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:28.740503    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:49:28.740647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:28.740589    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:49:28.740647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:28.740636    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:49:29.745720 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:29.745674    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" event={"ID":"d01f3206-1abb-4e07-a158-e253f5801679","Type":"ContainerStarted","Data":"8e060f49873eb0f35a5f68b31c104301452ab3255dd47b348ff363770e970c45"}
Jul 06 21:49:30.534075 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:30.534031    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:30.535242 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:30.535219    2554 patch_prober.go:28] interesting pod/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 06 21:49:30.535305 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:30.535268    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 06 21:49:30.665967 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:30.665921    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:31.534113 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:31.534076    2554 patch_prober.go:28] interesting pod/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 06 21:49:31.534625 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:31.534134    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 06 21:49:32.533569 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:32.533532    2554 patch_prober.go:28] interesting pod/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 06 21:49:32.533749 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:32.533588    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 06 21:49:33.584207 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:33.584170    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:49:33.585199 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:49:33.585178    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:50:54.089928 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:54.089894    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"]
Jul 06 21:50:54.090514 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:54.090109    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy" containerID="cri-o://8e060f49873eb0f35a5f68b31c104301452ab3255dd47b348ff363770e970c45" gracePeriod=30
Jul 06 21:50:59.228393 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.228360    2554 generic.go:356] "Generic (PLEG): container finished" podID="d01f3206-1abb-4e07-a158-e253f5801679" containerID="8e060f49873eb0f35a5f68b31c104301452ab3255dd47b348ff363770e970c45" exitCode=0
Jul 06 21:50:59.228783 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.228473    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" event={"ID":"d01f3206-1abb-4e07-a158-e253f5801679","Type":"ContainerDied","Data":"8e060f49873eb0f35a5f68b31c104301452ab3255dd47b348ff363770e970c45"}
Jul 06 21:50:59.228783 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.228561    2554 scope.go:117] "RemoveContainer" containerID="31ee2a7475195e8cf1ef80782d790ca66dde3089d622f2db1c26ccaf1d1afe5e"
Jul 06 21:50:59.356252 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.356177    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:50:59.430141 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430109    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-credential-socket\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430141 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430146    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-envoy\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430163    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d01f3206-1abb-4e07-a158-e253f5801679-istiod-ca-cert\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430193    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s74c8\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-kube-api-access-s74c8\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430221    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-data\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430300    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-istio-token\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430352    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-certs\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430379    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d01f3206-1abb-4e07-a158-e253f5801679-istio-podinfo\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430404    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:59.430527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430456    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-socket\") pod \"d01f3206-1abb-4e07-a158-e253f5801679\" (UID: \"d01f3206-1abb-4e07-a158-e253f5801679\") "
Jul 06 21:50:59.430916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430592    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:59.430916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430660    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d01f3206-1abb-4e07-a158-e253f5801679-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:50:59.430916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430800    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:59.430916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430885    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:50:59.430916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430905    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-credential-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:50:59.430916 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.430919    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d01f3206-1abb-4e07-a158-e253f5801679-istiod-ca-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:50:59.431577 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.431547    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-data" (OuterVolumeSpecName: "istio-data") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:59.432727 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.432697    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-istio-token" (OuterVolumeSpecName: "istio-token") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:50:59.432833 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.432730    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d01f3206-1abb-4e07-a158-e253f5801679-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:50:59.432833 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.432748    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:59.432959 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.432939    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-kube-api-access-s74c8" (OuterVolumeSpecName: "kube-api-access-s74c8") pod "d01f3206-1abb-4e07-a158-e253f5801679" (UID: "d01f3206-1abb-4e07-a158-e253f5801679"). InnerVolumeSpecName "kube-api-access-s74c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:50:59.531542 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.531506    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-envoy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:50:59.531542 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.531536    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s74c8\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-kube-api-access-s74c8\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:50:59.531542 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.531546    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-istio-data\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:50:59.531542 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.531554    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d01f3206-1abb-4e07-a158-e253f5801679-istio-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:50:59.531808 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.531562    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d01f3206-1abb-4e07-a158-e253f5801679-istio-podinfo\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:50:59.531808 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:50:59.531569    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d01f3206-1abb-4e07-a158-e253f5801679-workload-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:51:00.235873 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:00.235838    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"
Jul 06 21:51:00.235873 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:00.235863    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv" event={"ID":"d01f3206-1abb-4e07-a158-e253f5801679","Type":"ContainerDied","Data":"26bc69b2a8008c2328faeeeebed5ee3c72d143e22e8b10b6c9c5334dbf125b76"}
Jul 06 21:51:00.236351 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:00.235922    2554 scope.go:117] "RemoveContainer" containerID="8e060f49873eb0f35a5f68b31c104301452ab3255dd47b348ff363770e970c45"
Jul 06 21:51:00.259521 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:00.259489    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"]
Jul 06 21:51:00.263024 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:00.262995    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f377e18b-openshift-default-7f7bcb69ff-rgpjv"]
Jul 06 21:51:01.985876 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:01.985842    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d01f3206-1abb-4e07-a158-e253f5801679" path="/var/lib/kubelet/pods/d01f3206-1abb-4e07-a158-e253f5801679/volumes"
Jul 06 21:51:31.981149 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:31.981120    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:51:31.986888 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:31.986866    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:51:49.796158 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.796122    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"]
Jul 06 21:51:49.796570 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.796484    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy"
Jul 06 21:51:49.796570 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.796495    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy"
Jul 06 21:51:49.796570 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.796506    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy"
Jul 06 21:51:49.796570 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.796512    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy"
Jul 06 21:51:49.796707 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.796578    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy"
Jul 06 21:51:49.796707 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.796587    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d01f3206-1abb-4e07-a158-e253f5801679" containerName="istio-proxy"
Jul 06 21:51:49.796707 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.796595    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="667f7bdc-646a-46ff-ac6e-6f73993b69fd" containerName="istio-proxy"
Jul 06 21:51:49.799611 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.799592    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.802850 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.802829    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ea178e-openshift-default-dockercfg-nbrsf\""
Jul 06 21:51:49.811123 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.811103    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"]
Jul 06 21:51:49.893977 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.893938    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-socket\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.894172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.894003    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-token\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.894172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.894027    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-credential-socket\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.894172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.894047    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-podinfo\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.894172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.894067    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-data\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.894172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.894090    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-certs\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.894172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.894113    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhfp5\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-kube-api-access-bhfp5\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.894172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.894151    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-envoy\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.894503 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.894198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istiod-ca-cert\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995488 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995458    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istiod-ca-cert\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995634 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995517    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-socket\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995634 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-token\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995634 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995569    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-credential-socket\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995634 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995583    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-podinfo\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995821 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995651    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-data\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995821 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995677    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-certs\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995821 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995702    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhfp5\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-kube-api-access-bhfp5\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.995821 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995746    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-envoy\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.996013 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.995966    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-credential-socket\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.996151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.996027    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-socket\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.996151 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.996109    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-data\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.996289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.996253    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-certs\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.996289 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.996261    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istiod-ca-cert\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.998189 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.998166    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-envoy\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:49.998669 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:49.998650    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-podinfo\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:50.004548 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.004523    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhfp5\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-kube-api-access-bhfp5\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:50.005250 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.005226    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-token\") pod \"e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") " pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:50.110189 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.110100    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:50.252226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.252201    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"]
Jul 06 21:51:50.253399 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:51:50.253369    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ccdc48_31e6_4b93_a032_ccce9bd5d6b9.slice/crio-653d8aeb06b111c0b277e7294ff8f53edb44f6307fa790ccb7f6defef2a7b557 WatchSource:0}: Error finding container 653d8aeb06b111c0b277e7294ff8f53edb44f6307fa790ccb7f6defef2a7b557: Status 404 returned error can't find the container with id 653d8aeb06b111c0b277e7294ff8f53edb44f6307fa790ccb7f6defef2a7b557
Jul 06 21:51:50.255526 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.255492    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:51:50.255635 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.255557    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:51:50.255635 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.255587    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:51:50.497656 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.497622    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" event={"ID":"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9","Type":"ContainerStarted","Data":"7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456"}
Jul 06 21:51:50.497857 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.497685    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" event={"ID":"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9","Type":"ContainerStarted","Data":"653d8aeb06b111c0b277e7294ff8f53edb44f6307fa790ccb7f6defef2a7b557"}
Jul 06 21:51:50.524950 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:50.524900    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" podStartSLOduration=1.524884159 podStartE2EDuration="1.524884159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:51:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:51:50.5219612 +0000 UTC m=+1819.143543539" watchObservedRunningTime="2026-07-06 21:51:50.524884159 +0000 UTC m=+1819.146466475"
Jul 06 21:51:51.110841 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:51.110804    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:51.115734 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:51.115709    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:51.503027 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:51.502994    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:51:51.504080 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:51:51.504062    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:52:07.544669 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:07.544620    2554 patch_prober.go:28] interesting pod/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 21:52:07.545058 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:07.544709    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 21:52:08.604845 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:08.604752    2554 generic.go:356] "Generic (PLEG): container finished" podID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerID="7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456" exitCode=0
Jul 06 21:52:08.605348 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:08.604829    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" event={"ID":"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9","Type":"ContainerDied","Data":"7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456"}
Jul 06 21:52:08.605348 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:08.605319    2554 scope.go:117] "RemoveContainer" containerID="7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456"
Jul 06 21:52:08.606342 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:08.606313    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:52:08.606464 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:08.606379    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:52:08.606464 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:08.606409    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:52:09.612217 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:09.612184    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" event={"ID":"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9","Type":"ContainerStarted","Data":"944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0"}
Jul 06 21:52:10.110827 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:10.110784    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:52:10.111086 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:10.111036    2554 patch_prober.go:28] interesting pod/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 21:52:10.111131 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:10.111100    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 21:52:11.033117 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.033082    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"]
Jul 06 21:52:11.036484 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.036464    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.039174 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.039153    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ea178e\"/\"kube-root-ca.crt\""
Jul 06 21:52:11.041077 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.041058    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ea178e\"/\"default-dockercfg-bsbg7\""
Jul 06 21:52:11.041077 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.041071    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ea178e\"/\"openshift-service-ca.crt\""
Jul 06 21:52:11.041259 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.041233    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ea178e\"/\"test-model-ea178e-kserve-self-signed-certs\""
Jul 06 21:52:11.045825 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.045800    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"]
Jul 06 21:52:11.110626 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.110581    2554 patch_prober.go:28] interesting pod/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 21:52:11.110801 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.110648    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 21:52:11.192380 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.192342    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-dshm\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.192593 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.192394    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tmp-dir\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.192593 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.192479    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkcs\" (UniqueName: \"kubernetes.io/projected/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-kube-api-access-rmkcs\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.192593 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.192511    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-model-cache\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.192593 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.192586    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-home\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.192738 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.192606    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tls-certs\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.293927 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.293825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-dshm\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.293927 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.293880    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tmp-dir\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.293927 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.293911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkcs\" (UniqueName: \"kubernetes.io/projected/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-kube-api-access-rmkcs\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.294218 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.293938    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-model-cache\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.294218 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.294002    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-home\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.294218 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.294062    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tls-certs\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.294527 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.294465    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-home\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.294626 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.294478    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tmp-dir\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.294626 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.294553    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-model-cache\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.296316 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.296287    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-dshm\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.296876 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.296860    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tls-certs\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.302876 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.302843    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkcs\" (UniqueName: \"kubernetes.io/projected/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-kube-api-access-rmkcs\") pod \"test-model-ea178e-kserve-7f9f6f848c-74kxx\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") " pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.346885 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.346842    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:11.525349 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.525322    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"]
Jul 06 21:52:11.527315 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:52:11.527281    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c508178_1a85_494e_b9bd_f6f45a2fe8d2.slice/crio-6d7c23a734f7655bfabc995fceefa3f07dee2f81ccf3a4bb542bcf2d3f2c4411 WatchSource:0}: Error finding container 6d7c23a734f7655bfabc995fceefa3f07dee2f81ccf3a4bb542bcf2d3f2c4411: Status 404 returned error can't find the container with id 6d7c23a734f7655bfabc995fceefa3f07dee2f81ccf3a4bb542bcf2d3f2c4411
Jul 06 21:52:11.624446 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.624405    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx" event={"ID":"5c508178-1a85-494e-b9bd-f6f45a2fe8d2","Type":"ContainerStarted","Data":"da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4"}
Jul 06 21:52:11.624616 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.624460    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx" event={"ID":"5c508178-1a85-494e-b9bd-f6f45a2fe8d2","Type":"ContainerStarted","Data":"6d7c23a734f7655bfabc995fceefa3f07dee2f81ccf3a4bb542bcf2d3f2c4411"}
Jul 06 21:52:11.644976 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:11.644921    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx" podStartSLOduration=0.644904629 podStartE2EDuration="644.904629ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:52:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:52:11.644080285 +0000 UTC m=+1840.265662607" watchObservedRunningTime="2026-07-06 21:52:11.644904629 +0000 UTC m=+1840.266486945"
Jul 06 21:52:12.110679 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:12.110647    2554 patch_prober.go:28] interesting pod/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 21:52:12.111065 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:12.110699    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 21:52:13.111549 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:13.111514    2554 patch_prober.go:28] interesting pod/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 21:52:13.112026 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:13.111566    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 21:52:14.114726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:14.114695    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:52:14.115121 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:14.114956    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:52:14.115686 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:14.115672    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:52:21.347220 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:21.347187    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:21.347706 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:21.347246    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:21.360396 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:21.360372    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:52:21.690779 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:52:21.690697    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:53:13.926192 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:13.926153    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"]
Jul 06 21:53:28.946152 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:28.946104    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx" podUID="5c508178-1a85-494e-b9bd-f6f45a2fe8d2" containerName="main" containerID="cri-o://da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4" gracePeriod=45
Jul 06 21:53:29.200913 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.200848    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:53:29.301253 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301210    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tls-certs\") pod \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") "
Jul 06 21:53:29.301491 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301276    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-dshm\") pod \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") "
Jul 06 21:53:29.301491 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301313    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmkcs\" (UniqueName: \"kubernetes.io/projected/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-kube-api-access-rmkcs\") pod \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") "
Jul 06 21:53:29.301491 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301361    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-home\") pod \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") "
Jul 06 21:53:29.301681 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301495    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-model-cache\") pod \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") "
Jul 06 21:53:29.301681 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301575    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tmp-dir\") pod \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\" (UID: \"5c508178-1a85-494e-b9bd-f6f45a2fe8d2\") "
Jul 06 21:53:29.301681 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301646    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-home" (OuterVolumeSpecName: "home") pod "5c508178-1a85-494e-b9bd-f6f45a2fe8d2" (UID: "5c508178-1a85-494e-b9bd-f6f45a2fe8d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:53:29.301839 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301773    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c508178-1a85-494e-b9bd-f6f45a2fe8d2" (UID: "5c508178-1a85-494e-b9bd-f6f45a2fe8d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:53:29.301839 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301810    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c508178-1a85-494e-b9bd-f6f45a2fe8d2" (UID: "5c508178-1a85-494e-b9bd-f6f45a2fe8d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:53:29.301935 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301900    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tmp-dir\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:53:29.301935 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301912    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-home\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:53:29.301935 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.301925    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-model-cache\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:53:29.303698 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.303676    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-kube-api-access-rmkcs" (OuterVolumeSpecName: "kube-api-access-rmkcs") pod "5c508178-1a85-494e-b9bd-f6f45a2fe8d2" (UID: "5c508178-1a85-494e-b9bd-f6f45a2fe8d2"). InnerVolumeSpecName "kube-api-access-rmkcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:53:29.303960 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.303944    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c508178-1a85-494e-b9bd-f6f45a2fe8d2" (UID: "5c508178-1a85-494e-b9bd-f6f45a2fe8d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:53:29.304002 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.303945    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-dshm" (OuterVolumeSpecName: "dshm") pod "5c508178-1a85-494e-b9bd-f6f45a2fe8d2" (UID: "5c508178-1a85-494e-b9bd-f6f45a2fe8d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:53:29.402611 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.402572    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-tls-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:53:29.402611 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.402605    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-dshm\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:53:29.402611 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:29.402615    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmkcs\" (UniqueName: \"kubernetes.io/projected/5c508178-1a85-494e-b9bd-f6f45a2fe8d2-kube-api-access-rmkcs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:53:30.042679 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.042647    2554 generic.go:356] "Generic (PLEG): container finished" podID="5c508178-1a85-494e-b9bd-f6f45a2fe8d2" containerID="da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4" exitCode=0
Jul 06 21:53:30.043121 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.042708    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"
Jul 06 21:53:30.043121 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.042710    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx" event={"ID":"5c508178-1a85-494e-b9bd-f6f45a2fe8d2","Type":"ContainerDied","Data":"da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4"}
Jul 06 21:53:30.043121 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.042829    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx" event={"ID":"5c508178-1a85-494e-b9bd-f6f45a2fe8d2","Type":"ContainerDied","Data":"6d7c23a734f7655bfabc995fceefa3f07dee2f81ccf3a4bb542bcf2d3f2c4411"}
Jul 06 21:53:30.043121 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.042854    2554 scope.go:117] "RemoveContainer" containerID="da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4"
Jul 06 21:53:30.051992 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.051978    2554 scope.go:117] "RemoveContainer" containerID="da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4"
Jul 06 21:53:30.052241 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:53:30.052222    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4\": container with ID starting with da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4 not found: ID does not exist" containerID="da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4"
Jul 06 21:53:30.052312 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.052249    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4"} err="failed to get container status \"da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4\": rpc error: code = NotFound desc = could not find container \"da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4\": container with ID starting with da9f681b34d73ac31b13460d3b7f6bca0bf512535c282d500118e6bfbe2a73b4 not found: ID does not exist"
Jul 06 21:53:30.060596 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.060572    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"]
Jul 06 21:53:30.068139 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:30.068120    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ea178e/test-model-ea178e-kserve-7f9f6f848c-74kxx"]
Jul 06 21:53:31.987484 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:31.987457    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c508178-1a85-494e-b9bd-f6f45a2fe8d2" path="/var/lib/kubelet/pods/5c508178-1a85-494e-b9bd-f6f45a2fe8d2/volumes"
Jul 06 21:53:57.816801 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:57.816769    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"]
Jul 06 21:53:57.817322 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:57.816971    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy" containerID="cri-o://944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0" gracePeriod=30
Jul 06 21:53:59.117521 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:59.117484    2554 patch_prober.go:28] interesting pod/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 21:53:59.117876 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:53:59.117557    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 21:54:03.058082 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.058058    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:54:03.110028 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.109958    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-token\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110028 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.109992    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-credential-socket\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110028 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110010    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-certs\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110057    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istiod-ca-cert\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110100    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-socket\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110123    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-data\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110175    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhfp5\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-kube-api-access-bhfp5\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110211    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-podinfo\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110253    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-envoy\") pod \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\" (UID: \"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9\") "
Jul 06 21:54:03.110273 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110265    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:03.110647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110543    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-credential-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.110647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110542    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:03.110647 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110610    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:03.110795 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.110771    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:54:03.111134 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.111107    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:03.112213 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.112192    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:54:03.112528 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.112505    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:54:03.112618 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.112551    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:03.112660 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.112642    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-kube-api-access-bhfp5" (OuterVolumeSpecName: "kube-api-access-bhfp5") pod "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" (UID: "10ccdc48-31e6-4b93-a032-ccce9bd5d6b9"). InnerVolumeSpecName "kube-api-access-bhfp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:54:03.211300 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.211270    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istiod-ca-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.211300 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.211295    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.211300 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.211304    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-data\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.211625 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.211312    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhfp5\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-kube-api-access-bhfp5\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.211625 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.211321    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-podinfo\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.211625 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.211329    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-envoy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.211625 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.211336    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-istio-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.211625 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.211343    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9-workload-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:03.224215 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.224191    2554 generic.go:356] "Generic (PLEG): container finished" podID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerID="944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0" exitCode=0
Jul 06 21:54:03.224355 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.224239    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"
Jul 06 21:54:03.224355 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.224242    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" event={"ID":"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9","Type":"ContainerDied","Data":"944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0"}
Jul 06 21:54:03.224512 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.224386    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls" event={"ID":"10ccdc48-31e6-4b93-a032-ccce9bd5d6b9","Type":"ContainerDied","Data":"653d8aeb06b111c0b277e7294ff8f53edb44f6307fa790ccb7f6defef2a7b557"}
Jul 06 21:54:03.224512 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.224442    2554 scope.go:117] "RemoveContainer" containerID="944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0"
Jul 06 21:54:03.234995 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.234975    2554 scope.go:117] "RemoveContainer" containerID="7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456"
Jul 06 21:54:03.243211 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.243195    2554 scope.go:117] "RemoveContainer" containerID="944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0"
Jul 06 21:54:03.243475 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:54:03.243454    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0\": container with ID starting with 944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0 not found: ID does not exist" containerID="944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0"
Jul 06 21:54:03.243524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.243486    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0"} err="failed to get container status \"944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0\": rpc error: code = NotFound desc = could not find container \"944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0\": container with ID starting with 944ff916b240b7e0a3a25011b0211f3f623dfe526e35e6846f10cbea8316b8b0 not found: ID does not exist"
Jul 06 21:54:03.243524 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.243502    2554 scope.go:117] "RemoveContainer" containerID="7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456"
Jul 06 21:54:03.243746 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:54:03.243728    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456\": container with ID starting with 7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456 not found: ID does not exist" containerID="7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456"
Jul 06 21:54:03.243782 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.243754    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456"} err="failed to get container status \"7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456\": rpc error: code = NotFound desc = could not find container \"7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456\": container with ID starting with 7e429aaa875742a80dc947bedd63c246e2db29ef6f2612d3899ce8669c176456 not found: ID does not exist"
Jul 06 21:54:03.248276 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.248252    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"]
Jul 06 21:54:03.256034 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.256009    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ea178e-openshift-default-5547498d7-5kdls"]
Jul 06 21:54:03.986706 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:03.986677    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" path="/var/lib/kubelet/pods/10ccdc48-31e6-4b93-a032-ccce9bd5d6b9/volumes"
Jul 06 21:54:06.124639 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.124609    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"]
Jul 06 21:54:06.124996 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.124948    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy"
Jul 06 21:54:06.124996 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.124959    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy"
Jul 06 21:54:06.124996 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.124968    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c508178-1a85-494e-b9bd-f6f45a2fe8d2" containerName="main"
Jul 06 21:54:06.124996 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.124974    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c508178-1a85-494e-b9bd-f6f45a2fe8d2" containerName="main"
Jul 06 21:54:06.125129 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.125045    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy"
Jul 06 21:54:06.125129 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.125053    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy"
Jul 06 21:54:06.125129 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.125061    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c508178-1a85-494e-b9bd-f6f45a2fe8d2" containerName="main"
Jul 06 21:54:06.128062 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.128042    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.131014 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.130992    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f1c0e1-openshift-default-dockercfg-fg6gl\""
Jul 06 21:54:06.144173 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.144147    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"]
Jul 06 21:54:06.238234 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238203    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-podinfo\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.238234 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238247    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-socket\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.238541 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238276    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-certs\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.238541 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238345    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gjjx\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-kube-api-access-8gjjx\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.238541 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238381    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-credential-socket\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.238541 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238404    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-envoy\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.238541 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238490    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-data\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.238541 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238519    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istiod-ca-cert\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.238781 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.238543    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-token\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.339882 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.339835    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-podinfo\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340084 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.339899    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-socket\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340084 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.339932    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-certs\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340084 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.339970    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gjjx\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-kube-api-access-8gjjx\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340084 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.339990    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-credential-socket\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340084 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340012    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-envoy\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340084 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-data\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340426 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340096    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istiod-ca-cert\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340426 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-token\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340426 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340389    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-socket\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340598 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340421    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-certs\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340598    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-data\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340646 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340616    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-credential-socket\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.340918 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.340897    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istiod-ca-cert\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.342383 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.342353    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-envoy\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.342505 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.342472    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-podinfo\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.348778 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.348757    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-token\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.348778 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.348774    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gjjx\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-kube-api-access-8gjjx\") pod \"e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") " pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.439533 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.439421    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:06.584322 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.584297    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"]
Jul 06 21:54:06.586313 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:54:06.586271    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e627b17_1789_46f7_bc2b_dd4a97d788b4.slice/crio-a67ba67ffb2057f6feb95ee7117ec05230adf57da330e0096912a8da6c682c7d WatchSource:0}: Error finding container a67ba67ffb2057f6feb95ee7117ec05230adf57da330e0096912a8da6c682c7d: Status 404 returned error can't find the container with id a67ba67ffb2057f6feb95ee7117ec05230adf57da330e0096912a8da6c682c7d
Jul 06 21:54:06.588733 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.588706    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:06.588799 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.588762    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:06.588838 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:06.588809    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:07.252179 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:07.252136    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" event={"ID":"3e627b17-1789-46f7-bc2b-dd4a97d788b4","Type":"ContainerStarted","Data":"67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188"}
Jul 06 21:54:07.252556 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:07.252187    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" event={"ID":"3e627b17-1789-46f7-bc2b-dd4a97d788b4","Type":"ContainerStarted","Data":"a67ba67ffb2057f6feb95ee7117ec05230adf57da330e0096912a8da6c682c7d"}
Jul 06 21:54:07.275060 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:07.275017    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" podStartSLOduration=1.2750030620000001 podStartE2EDuration="1.275003062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:54:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:54:07.27308144 +0000 UTC m=+1955.894663763" watchObservedRunningTime="2026-07-06 21:54:07.275003062 +0000 UTC m=+1955.896585421"
Jul 06 21:54:07.440100 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:07.440064    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:07.445078 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:07.445049    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:08.257340 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:08.257306    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:08.258339 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:08.258321    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:24.299702 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:24.299609    2554 patch_prober.go:28] interesting pod/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 21:54:24.299702 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:24.299674    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 21:54:25.352744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:25.352711    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerID="67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188" exitCode=0
Jul 06 21:54:25.353195 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:25.352757    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" event={"ID":"3e627b17-1789-46f7-bc2b-dd4a97d788b4","Type":"ContainerDied","Data":"67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188"}
Jul 06 21:54:25.353195 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:25.353133    2554 scope.go:117] "RemoveContainer" containerID="67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188"
Jul 06 21:54:25.354069 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:25.354042    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:25.354135 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:25.354122    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:25.354172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:25.354158    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:26.363619 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:26.363570    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" event={"ID":"3e627b17-1789-46f7-bc2b-dd4a97d788b4","Type":"ContainerStarted","Data":"f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d"}
Jul 06 21:54:26.440329 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:26.440296    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:26.440530 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:26.440507    2554 patch_prober.go:28] interesting pod/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 06 21:54:26.440584 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:26.440549    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 06 21:54:27.440078 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:27.440041    2554 patch_prober.go:28] interesting pod/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 06 21:54:27.440520 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:27.440107    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 06 21:54:28.440279 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:28.440237    2554 patch_prober.go:28] interesting pod/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 06 21:54:28.440705 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:28.440308    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 06 21:54:29.440717 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:29.440680    2554 patch_prober.go:28] interesting pod/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 06 21:54:29.441116 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:29.440752    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 06 21:54:30.443956 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:30.443928    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:30.444331 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:30.444201    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:30.444860 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:30.444840    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:37.028175 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:37.028144    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"]
Jul 06 21:54:37.028607 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:37.028360    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy" containerID="cri-o://f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d" gracePeriod=30
Jul 06 21:54:42.274955 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.274930    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:42.366324 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366246    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-envoy\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366324 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366295    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istiod-ca-cert\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366324 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366312    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-token\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366329    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-certs\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366345    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gjjx\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-kube-api-access-8gjjx\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366387    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-data\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366472    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-podinfo\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366500    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-socket\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366539    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-credential-socket\") pod \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\" (UID: \"3e627b17-1789-46f7-bc2b-dd4a97d788b4\") "
Jul 06 21:54:42.366725 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366693    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:42.367042 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366918    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:42.367042 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.366950    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.367042 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.367032    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:54:42.367167 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.367101    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:42.367519 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.367488    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:42.368724 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.368697    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:54:42.368915 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.368890    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:54:42.368971 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.368935    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:42.369513 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.369494    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-kube-api-access-8gjjx" (OuterVolumeSpecName: "kube-api-access-8gjjx") pod "3e627b17-1789-46f7-bc2b-dd4a97d788b4" (UID: "3e627b17-1789-46f7-bc2b-dd4a97d788b4"). InnerVolumeSpecName "kube-api-access-8gjjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:54:42.461899 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.461859    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerID="f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d" exitCode=0
Jul 06 21:54:42.462113 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.461912    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"
Jul 06 21:54:42.462113 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.461949    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" event={"ID":"3e627b17-1789-46f7-bc2b-dd4a97d788b4","Type":"ContainerDied","Data":"f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d"}
Jul 06 21:54:42.462113 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.462024    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf" event={"ID":"3e627b17-1789-46f7-bc2b-dd4a97d788b4","Type":"ContainerDied","Data":"a67ba67ffb2057f6feb95ee7117ec05230adf57da330e0096912a8da6c682c7d"}
Jul 06 21:54:42.462113 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.462057    2554 scope.go:117] "RemoveContainer" containerID="f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d"
Jul 06 21:54:42.467775 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.467752    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gjjx\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-kube-api-access-8gjjx\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.467775 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.467774    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-data\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.467972 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.467785    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-podinfo\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.467972 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.467793    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-workload-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.467972 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.467801    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-credential-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.467972 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.467810    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-envoy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.467972 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.467818    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istiod-ca-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.467972 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.467825    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e627b17-1789-46f7-bc2b-dd4a97d788b4-istio-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:54:42.472294 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.472277    2554 scope.go:117] "RemoveContainer" containerID="67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188"
Jul 06 21:54:42.480538 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.480515    2554 scope.go:117] "RemoveContainer" containerID="f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d"
Jul 06 21:54:42.480798 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:54:42.480779    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d\": container with ID starting with f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d not found: ID does not exist" containerID="f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d"
Jul 06 21:54:42.480870 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.480805    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d"} err="failed to get container status \"f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d\": rpc error: code = NotFound desc = could not find container \"f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d\": container with ID starting with f247103ad7fd544371abda8aa56938bd7a0238c4b698e19726c9b506d80baf0d not found: ID does not exist"
Jul 06 21:54:42.480870 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.480823    2554 scope.go:117] "RemoveContainer" containerID="67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188"
Jul 06 21:54:42.481023 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:54:42.481008    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188\": container with ID starting with 67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188 not found: ID does not exist" containerID="67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188"
Jul 06 21:54:42.481064 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.481028    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188"} err="failed to get container status \"67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188\": rpc error: code = NotFound desc = could not find container \"67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188\": container with ID starting with 67a36cbd50e763d85d7566892783d959a6061cd669a33db126dac4b0e0f95188 not found: ID does not exist"
Jul 06 21:54:42.487221 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.487188    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"]
Jul 06 21:54:42.494039 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:42.494021    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f1c0e1-openshift-default-dfbb89859-n29mf"]
Jul 06 21:54:43.986880 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:43.986847    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" path="/var/lib/kubelet/pods/3e627b17-1789-46f7-bc2b-dd4a97d788b4/volumes"
Jul 06 21:54:45.477242 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477205    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"]
Jul 06 21:54:45.477744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477581    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy"
Jul 06 21:54:45.477744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477595    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ccdc48-31e6-4b93-a032-ccce9bd5d6b9" containerName="istio-proxy"
Jul 06 21:54:45.477744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477607    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy"
Jul 06 21:54:45.477744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477612    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy"
Jul 06 21:54:45.477744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477619    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy"
Jul 06 21:54:45.477744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477624    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy"
Jul 06 21:54:45.477744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477720    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy"
Jul 06 21:54:45.477744 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.477732    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e627b17-1789-46f7-bc2b-dd4a97d788b4" containerName="istio-proxy"
Jul 06 21:54:45.482573 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.482552    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.485006 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.484987    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-ace6c2-openshift-default-dockercfg-kd72b\""
Jul 06 21:54:45.495857 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.495830    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-credential-socket\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.495982 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.495864    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-socket\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.495982 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.495881    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36afee0-0097-46a5-9f2b-5e879823b648-istiod-ca-cert\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.495982 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.495908    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-certs\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.495982 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.495928    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-data\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.495982 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.495970    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-istio-token\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.496598 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.496470    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36afee0-0097-46a5-9f2b-5e879823b648-istio-podinfo\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.504499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.496669    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-envoy\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.504499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.496709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cnwg\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-kube-api-access-5cnwg\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.504499 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.497104    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"]
Jul 06 21:54:45.597989 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.597954    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-envoy\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.597989 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.597991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cnwg\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-kube-api-access-5cnwg\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598017    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-credential-socket\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598037    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-socket\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598057    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36afee0-0097-46a5-9f2b-5e879823b648-istiod-ca-cert\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598094    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-certs\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598117    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-data\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598185    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-istio-token\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598246 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598223    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36afee0-0097-46a5-9f2b-5e879823b648-istio-podinfo\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598644 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598419    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-credential-socket\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598644 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598568    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-socket\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598644 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598580    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-data\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598845 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598824    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-certs\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.598890 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.598876    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36afee0-0097-46a5-9f2b-5e879823b648-istiod-ca-cert\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.600234 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.600211    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-envoy\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.600667 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.600650    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36afee0-0097-46a5-9f2b-5e879823b648-istio-podinfo\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.606451 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.606413    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-istio-token\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.606596 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.606578    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cnwg\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-kube-api-access-5cnwg\") pod \"e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") " pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.792626 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.792595    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:45.934444 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.934406    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"]
Jul 06 21:54:45.937175 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:54:45.937131    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36afee0_0097_46a5_9f2b_5e879823b648.slice/crio-ba698545d064b3026009807dde6adb641f8954416f4e9980d25c632b7923c52a WatchSource:0}: Error finding container ba698545d064b3026009807dde6adb641f8954416f4e9980d25c632b7923c52a: Status 404 returned error can't find the container with id ba698545d064b3026009807dde6adb641f8954416f4e9980d25c632b7923c52a
Jul 06 21:54:45.939630 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.939594    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:45.939741 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.939677    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:45.939741 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:45.939725    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:54:46.488580 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:46.488546    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" event={"ID":"a36afee0-0097-46a5-9f2b-5e879823b648","Type":"ContainerStarted","Data":"3b5058407d2c72d8cbbcb627174251602803364ade1317a499391df9ccc9e56a"}
Jul 06 21:54:46.488977 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:46.488601    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" event={"ID":"a36afee0-0097-46a5-9f2b-5e879823b648","Type":"ContainerStarted","Data":"ba698545d064b3026009807dde6adb641f8954416f4e9980d25c632b7923c52a"}
Jul 06 21:54:46.512458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:46.512397    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" podStartSLOduration=1.512380483 podStartE2EDuration="1.512380483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:54:46.511139109 +0000 UTC m=+1995.132721450" watchObservedRunningTime="2026-07-06 21:54:46.512380483 +0000 UTC m=+1995.133962800"
Jul 06 21:54:46.793099 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:46.793060    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:46.798166 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:46.798138    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:47.494696 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:47.494659    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:54:47.495616 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:54:47.495596    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:55:02.495848 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:02.495815    2554 patch_prober.go:28] interesting pod/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:55:02.496287 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:02.495866    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 06 21:55:02.596854 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:02.596822    2554 generic.go:356] "Generic (PLEG): container finished" podID="a36afee0-0097-46a5-9f2b-5e879823b648" containerID="3b5058407d2c72d8cbbcb627174251602803364ade1317a499391df9ccc9e56a" exitCode=0
Jul 06 21:55:02.597011 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:02.596896    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" event={"ID":"a36afee0-0097-46a5-9f2b-5e879823b648","Type":"ContainerDied","Data":"3b5058407d2c72d8cbbcb627174251602803364ade1317a499391df9ccc9e56a"}
Jul 06 21:55:02.597288 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:02.597273    2554 scope.go:117] "RemoveContainer" containerID="3b5058407d2c72d8cbbcb627174251602803364ade1317a499391df9ccc9e56a"
Jul 06 21:55:02.598280 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:02.598246    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:55:02.598382 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:02.598319    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:55:02.598382 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:02.598357    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 21:55:03.621457 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:03.619804    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" event={"ID":"a36afee0-0097-46a5-9f2b-5e879823b648","Type":"ContainerStarted","Data":"c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113"}
Jul 06 21:55:03.792993 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:03.792956    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:55:03.793232 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:03.793209    2554 patch_prober.go:28] interesting pod/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:55:03.793291 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:03.793271    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 06 21:55:04.793961 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:04.793920    2554 patch_prober.go:28] interesting pod/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:55:04.794360 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:04.793978    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 06 21:55:05.793418 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:05.793376    2554 patch_prober.go:28] interesting pod/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:55:05.793621 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:05.793475    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 06 21:55:06.793923 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:06.793887    2554 patch_prober.go:28] interesting pod/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:55:06.794315 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:06.793957    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 06 21:55:07.797306 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:07.797277    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:55:07.797796 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:07.797697    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:55:07.798426 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:07.798404    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 21:55:16.009347 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.009318    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"]
Jul 06 21:55:16.011580 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.011560    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.014127 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.014107    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"default-dockercfg-7fwm8\""
Jul 06 21:55:16.015208 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.015193    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"openshift-service-ca.crt\""
Jul 06 21:55:16.015372 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.015352    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"auth-test-model-ace6c2-kserve-self-signed-certs\""
Jul 06 21:55:16.015445 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.015391    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"kube-root-ca.crt\""
Jul 06 21:55:16.025609 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.025589    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"]
Jul 06 21:55:16.085748 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.085709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385c78fc-a770-4d83-8601-98255b039585-tls-certs\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.085748 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.085747    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-model-cache\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.086007 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.085785    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s279\" (UniqueName: \"kubernetes.io/projected/385c78fc-a770-4d83-8601-98255b039585-kube-api-access-4s279\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.086007 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.085873    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-home\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.086007 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.085974    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-tmp-dir\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.086172 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.086015    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-dshm\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.187407 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.187355    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385c78fc-a770-4d83-8601-98255b039585-tls-certs\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.187407 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.187407    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-model-cache\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.187708 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.187475    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s279\" (UniqueName: \"kubernetes.io/projected/385c78fc-a770-4d83-8601-98255b039585-kube-api-access-4s279\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.187708 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.187495    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-home\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.187708 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.187539    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-tmp-dir\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.187708 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.187568    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-dshm\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.188028 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.187994    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-model-cache\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.188028 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.188021    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-tmp-dir\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.188221 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.188045    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-home\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.189780 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.189754    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-dshm\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.189950 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.189932    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385c78fc-a770-4d83-8601-98255b039585-tls-certs\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.197179 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.197155    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s279\" (UniqueName: \"kubernetes.io/projected/385c78fc-a770-4d83-8601-98255b039585-kube-api-access-4s279\") pod \"auth-test-model-ace6c2-kserve-5876c59cbc-g5whs\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") " pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.321478 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.321355    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:16.458775 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.458750    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"]
Jul 06 21:55:16.460203 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:55:16.460174    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod385c78fc_a770_4d83_8601_98255b039585.slice/crio-5d083592fe8139833c1ab7bcbb1f83558360db1d1bea3383139c71a00f0d4505 WatchSource:0}: Error finding container 5d083592fe8139833c1ab7bcbb1f83558360db1d1bea3383139c71a00f0d4505: Status 404 returned error can't find the container with id 5d083592fe8139833c1ab7bcbb1f83558360db1d1bea3383139c71a00f0d4505
Jul 06 21:55:16.691846 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.691752    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs" event={"ID":"385c78fc-a770-4d83-8601-98255b039585","Type":"ContainerStarted","Data":"fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434"}
Jul 06 21:55:16.691846 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.691791    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs" event={"ID":"385c78fc-a770-4d83-8601-98255b039585","Type":"ContainerStarted","Data":"5d083592fe8139833c1ab7bcbb1f83558360db1d1bea3383139c71a00f0d4505"}
Jul 06 21:55:16.715964 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:16.715916    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs" podStartSLOduration=1.715899611 podStartE2EDuration="1.715899611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:55:16.71412307 +0000 UTC m=+2025.335705387" watchObservedRunningTime="2026-07-06 21:55:16.715899611 +0000 UTC m=+2025.337481953"
Jul 06 21:55:26.321794 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:26.321755    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:26.322208 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:26.321812    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:26.334270 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:26.334240    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:55:26.756597 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:55:26.756572    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:56:32.017183 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:56:32.017160    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:56:32.025163 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:56:32.025140    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 21:57:46.886332 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:57:46.886251    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"]
Jul 06 21:58:01.906412 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:01.906348    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs" podUID="385c78fc-a770-4d83-8601-98255b039585" containerName="main" containerID="cri-o://fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434" gracePeriod=45
Jul 06 21:58:02.154952 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.154925    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:58:02.183589 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.183525    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-home\") pod \"385c78fc-a770-4d83-8601-98255b039585\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") "
Jul 06 21:58:02.183589 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.183563    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s279\" (UniqueName: \"kubernetes.io/projected/385c78fc-a770-4d83-8601-98255b039585-kube-api-access-4s279\") pod \"385c78fc-a770-4d83-8601-98255b039585\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") "
Jul 06 21:58:02.183589 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.183586    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-model-cache\") pod \"385c78fc-a770-4d83-8601-98255b039585\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") "
Jul 06 21:58:02.183826 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.183613    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-dshm\") pod \"385c78fc-a770-4d83-8601-98255b039585\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") "
Jul 06 21:58:02.183826 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.183676    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385c78fc-a770-4d83-8601-98255b039585-tls-certs\") pod \"385c78fc-a770-4d83-8601-98255b039585\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") "
Jul 06 21:58:02.183826 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.183714    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-tmp-dir\") pod \"385c78fc-a770-4d83-8601-98255b039585\" (UID: \"385c78fc-a770-4d83-8601-98255b039585\") "
Jul 06 21:58:02.183997 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.183849    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-model-cache" (OuterVolumeSpecName: "model-cache") pod "385c78fc-a770-4d83-8601-98255b039585" (UID: "385c78fc-a770-4d83-8601-98255b039585"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:58:02.183997 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.183870    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-home" (OuterVolumeSpecName: "home") pod "385c78fc-a770-4d83-8601-98255b039585" (UID: "385c78fc-a770-4d83-8601-98255b039585"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:58:02.184119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.184056    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "385c78fc-a770-4d83-8601-98255b039585" (UID: "385c78fc-a770-4d83-8601-98255b039585"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:58:02.184119 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.184108    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-home\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:58:02.184211 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.184127    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-model-cache\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:58:02.185840 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.185815    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/385c78fc-a770-4d83-8601-98255b039585-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "385c78fc-a770-4d83-8601-98255b039585" (UID: "385c78fc-a770-4d83-8601-98255b039585"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:58:02.185954 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.185813    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-dshm" (OuterVolumeSpecName: "dshm") pod "385c78fc-a770-4d83-8601-98255b039585" (UID: "385c78fc-a770-4d83-8601-98255b039585"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:58:02.186159 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.186139    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/385c78fc-a770-4d83-8601-98255b039585-kube-api-access-4s279" (OuterVolumeSpecName: "kube-api-access-4s279") pod "385c78fc-a770-4d83-8601-98255b039585" (UID: "385c78fc-a770-4d83-8601-98255b039585"). InnerVolumeSpecName "kube-api-access-4s279". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:58:02.285359 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.285327    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s279\" (UniqueName: \"kubernetes.io/projected/385c78fc-a770-4d83-8601-98255b039585-kube-api-access-4s279\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:58:02.285359 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.285351    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-dshm\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:58:02.285359 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.285365    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385c78fc-a770-4d83-8601-98255b039585-tls-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:58:02.285652 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.285378    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385c78fc-a770-4d83-8601-98255b039585-tmp-dir\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:58:02.580445 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.580397    2554 generic.go:356] "Generic (PLEG): container finished" podID="385c78fc-a770-4d83-8601-98255b039585" containerID="fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434" exitCode=0
Jul 06 21:58:02.580616 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.580460    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"
Jul 06 21:58:02.580616 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.580486    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs" event={"ID":"385c78fc-a770-4d83-8601-98255b039585","Type":"ContainerDied","Data":"fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434"}
Jul 06 21:58:02.580616 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.580534    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs" event={"ID":"385c78fc-a770-4d83-8601-98255b039585","Type":"ContainerDied","Data":"5d083592fe8139833c1ab7bcbb1f83558360db1d1bea3383139c71a00f0d4505"}
Jul 06 21:58:02.580616 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.580552    2554 scope.go:117] "RemoveContainer" containerID="fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434"
Jul 06 21:58:02.590560 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.590542    2554 scope.go:117] "RemoveContainer" containerID="fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434"
Jul 06 21:58:02.590864 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:58:02.590845    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434\": container with ID starting with fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434 not found: ID does not exist" containerID="fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434"
Jul 06 21:58:02.590952 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.590875    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434"} err="failed to get container status \"fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434\": rpc error: code = NotFound desc = could not find container \"fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434\": container with ID starting with fec2d0fcf701229463c5441c0410cbef4bfbf29f32687f74430d68bc1da56434 not found: ID does not exist"
Jul 06 21:58:02.608522 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.608490    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"]
Jul 06 21:58:02.610585 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:02.610564    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/auth-test-model-ace6c2-kserve-5876c59cbc-g5whs"]
Jul 06 21:58:03.986872 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:03.986837    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="385c78fc-a770-4d83-8601-98255b039585" path="/var/lib/kubelet/pods/385c78fc-a770-4d83-8601-98255b039585/volumes"
Jul 06 21:58:04.510875 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.510847    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"]
Jul 06 21:58:04.511230 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.511218    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="385c78fc-a770-4d83-8601-98255b039585" containerName="main"
Jul 06 21:58:04.511275 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.511233    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="385c78fc-a770-4d83-8601-98255b039585" containerName="main"
Jul 06 21:58:04.511310 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.511299    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="385c78fc-a770-4d83-8601-98255b039585" containerName="main"
Jul 06 21:58:04.516008 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.515988    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.518877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.518856    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"kube-root-ca.crt\""
Jul 06 21:58:04.519000 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.518900    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"openshift-service-ca.crt\""
Jul 06 21:58:04.520080 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.520061    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"sub-test-model-ace6c2-kserve-self-signed-certs\""
Jul 06 21:58:04.520185 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.520126    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"default-dockercfg-7fwm8\""
Jul 06 21:58:04.527322 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.527301    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"]
Jul 06 21:58:04.607503 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.607470    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tmp-dir\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.607667 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.607524    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7glqn\" (UniqueName: \"kubernetes.io/projected/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-kube-api-access-7glqn\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.607667 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.607573    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-model-cache\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.607667 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.607605    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-home\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.607667 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.607648    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-dshm\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.607806 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.607687    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tls-certs\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.708877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.708839    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-dshm\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.709079 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.708899    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tls-certs\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.709079 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.708952    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tmp-dir\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.709079 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.708998    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7glqn\" (UniqueName: \"kubernetes.io/projected/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-kube-api-access-7glqn\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.709079 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.709028    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-model-cache\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.709079 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.709064    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-home\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.709461 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.709411    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tmp-dir\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.709561 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.709468    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-home\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.709561 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.709493    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-model-cache\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.711130 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.711113    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-dshm\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.711561 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.711542    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tls-certs\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.717914 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.717894    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7glqn\" (UniqueName: \"kubernetes.io/projected/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-kube-api-access-7glqn\") pod \"sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") " pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.827861 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.827767    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:04.962698 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:04.962666    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"]
Jul 06 21:58:04.964501 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:58:04.964473    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2796dbf1_e2eb_42fc_8d79_d8320a6ad753.slice/crio-62673a3865c3f805674f03c4287078012b3669b4e7d4511af46f564e7e65ed92 WatchSource:0}: Error finding container 62673a3865c3f805674f03c4287078012b3669b4e7d4511af46f564e7e65ed92: Status 404 returned error can't find the container with id 62673a3865c3f805674f03c4287078012b3669b4e7d4511af46f564e7e65ed92
Jul 06 21:58:05.599174 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:05.599135    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd" event={"ID":"2796dbf1-e2eb-42fc-8d79-d8320a6ad753","Type":"ContainerStarted","Data":"5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4"}
Jul 06 21:58:05.599584 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:05.599182    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd" event={"ID":"2796dbf1-e2eb-42fc-8d79-d8320a6ad753","Type":"ContainerStarted","Data":"62673a3865c3f805674f03c4287078012b3669b4e7d4511af46f564e7e65ed92"}
Jul 06 21:58:05.619698 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:05.619648    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd" podStartSLOduration=1.619632432 podStartE2EDuration="1.619632432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:58:05.617664407 +0000 UTC m=+2194.239246725" watchObservedRunningTime="2026-07-06 21:58:05.619632432 +0000 UTC m=+2194.241214749"
Jul 06 21:58:14.827927 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:14.827874    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:14.827927 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:14.827939    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:14.840578 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:14.840544    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:58:15.667652 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:58:15.667621    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:59:11.736910 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:11.736878    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"]
Jul 06 21:59:26.756424 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:26.756359    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd" podUID="2796dbf1-e2eb-42fc-8d79-d8320a6ad753" containerName="main" containerID="cri-o://5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4" gracePeriod=45
Jul 06 21:59:27.003443 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.003403    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:59:27.027328 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.027248    2554 generic.go:356] "Generic (PLEG): container finished" podID="2796dbf1-e2eb-42fc-8d79-d8320a6ad753" containerID="5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4" exitCode=0
Jul 06 21:59:27.027328 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.027297    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"
Jul 06 21:59:27.027536 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.027335    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd" event={"ID":"2796dbf1-e2eb-42fc-8d79-d8320a6ad753","Type":"ContainerDied","Data":"5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4"}
Jul 06 21:59:27.027536 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.027392    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd" event={"ID":"2796dbf1-e2eb-42fc-8d79-d8320a6ad753","Type":"ContainerDied","Data":"62673a3865c3f805674f03c4287078012b3669b4e7d4511af46f564e7e65ed92"}
Jul 06 21:59:27.027536 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.027419    2554 scope.go:117] "RemoveContainer" containerID="5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4"
Jul 06 21:59:27.036257 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.036241    2554 scope.go:117] "RemoveContainer" containerID="5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4"
Jul 06 21:59:27.036528 ip-10-0-133-11 kubenswrapper[2554]: E0706 21:59:27.036508    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4\": container with ID starting with 5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4 not found: ID does not exist" containerID="5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4"
Jul 06 21:59:27.036595 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.036536    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4"} err="failed to get container status \"5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4\": rpc error: code = NotFound desc = could not find container \"5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4\": container with ID starting with 5734a3e6f8be333447279a7f52a78859ba236bb91fd26dd923c304b74898c8a4 not found: ID does not exist"
Jul 06 21:59:27.042849 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.042832    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tmp-dir\") pod \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") "
Jul 06 21:59:27.042923 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.042873    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7glqn\" (UniqueName: \"kubernetes.io/projected/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-kube-api-access-7glqn\") pod \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") "
Jul 06 21:59:27.042923 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.042916    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-model-cache\") pod \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") "
Jul 06 21:59:27.043006 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.042933    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tls-certs\") pod \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") "
Jul 06 21:59:27.043006 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.042960    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-dshm\") pod \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") "
Jul 06 21:59:27.043006 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.042983    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-home\") pod \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\" (UID: \"2796dbf1-e2eb-42fc-8d79-d8320a6ad753\") "
Jul 06 21:59:27.043155 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.043107    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2796dbf1-e2eb-42fc-8d79-d8320a6ad753" (UID: "2796dbf1-e2eb-42fc-8d79-d8320a6ad753"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:59:27.043155 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.043127    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-model-cache" (OuterVolumeSpecName: "model-cache") pod "2796dbf1-e2eb-42fc-8d79-d8320a6ad753" (UID: "2796dbf1-e2eb-42fc-8d79-d8320a6ad753"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:59:27.043328 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.043274    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tmp-dir\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:59:27.043328 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.043309    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-model-cache\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:59:27.043328 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.043321    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-home" (OuterVolumeSpecName: "home") pod "2796dbf1-e2eb-42fc-8d79-d8320a6ad753" (UID: "2796dbf1-e2eb-42fc-8d79-d8320a6ad753"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:59:27.045096 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.045072    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-dshm" (OuterVolumeSpecName: "dshm") pod "2796dbf1-e2eb-42fc-8d79-d8320a6ad753" (UID: "2796dbf1-e2eb-42fc-8d79-d8320a6ad753"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:59:27.045096 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.045084    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-kube-api-access-7glqn" (OuterVolumeSpecName: "kube-api-access-7glqn") pod "2796dbf1-e2eb-42fc-8d79-d8320a6ad753" (UID: "2796dbf1-e2eb-42fc-8d79-d8320a6ad753"). InnerVolumeSpecName "kube-api-access-7glqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:59:27.045393 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.045364    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2796dbf1-e2eb-42fc-8d79-d8320a6ad753" (UID: "2796dbf1-e2eb-42fc-8d79-d8320a6ad753"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:59:27.144626 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.144597    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-home\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:59:27.144626 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.144622    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7glqn\" (UniqueName: \"kubernetes.io/projected/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-kube-api-access-7glqn\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:59:27.144626 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.144632    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-tls-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:59:27.144844 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.144642    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2796dbf1-e2eb-42fc-8d79-d8320a6ad753-dshm\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 21:59:27.351390 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.351356    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"]
Jul 06 21:59:27.355226 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.355196    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/sub-test-model-ace6c2-kserve-6966dc8dc-bdrfd"]
Jul 06 21:59:27.986193 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:27.986161    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2796dbf1-e2eb-42fc-8d79-d8320a6ad753" path="/var/lib/kubelet/pods/2796dbf1-e2eb-42fc-8d79-d8320a6ad753/volumes"
Jul 06 21:59:36.304502 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.304463    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"]
Jul 06 21:59:36.304928 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.304825    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2796dbf1-e2eb-42fc-8d79-d8320a6ad753" containerName="main"
Jul 06 21:59:36.304928 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.304835    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2796dbf1-e2eb-42fc-8d79-d8320a6ad753" containerName="main"
Jul 06 21:59:36.304928 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.304923    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2796dbf1-e2eb-42fc-8d79-d8320a6ad753" containerName="main"
Jul 06 21:59:36.309497 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.309480    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.313251 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.313220    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"openshift-service-ca.crt\""
Jul 06 21:59:36.313251 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.313248    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"default-dockercfg-7fwm8\""
Jul 06 21:59:36.313458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.313232    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"rate-test-model-ace6c2-kserve-self-signed-certs\""
Jul 06 21:59:36.313458 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.313237    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ace6c2\"/\"kube-root-ca.crt\""
Jul 06 21:59:36.320065 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.320043    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"]
Jul 06 21:59:36.431521 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.431489    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-model-cache\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.431726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.431563    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-home\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.431726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.431592    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-tmp-dir\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.431726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.431614    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/592079e2-475f-400c-b529-0b431dc46141-tls-certs\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.431726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.431635    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9h4\" (UniqueName: \"kubernetes.io/projected/592079e2-475f-400c-b529-0b431dc46141-kube-api-access-nc9h4\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.431726 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.431693    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-dshm\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.532877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.532841    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-home\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.532877 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.532883    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-tmp-dir\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.533111 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.532898    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/592079e2-475f-400c-b529-0b431dc46141-tls-certs\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.533111 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.533009    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9h4\" (UniqueName: \"kubernetes.io/projected/592079e2-475f-400c-b529-0b431dc46141-kube-api-access-nc9h4\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.533111 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.533072    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-dshm\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.533268 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.533156    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-model-cache\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.533268 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.533220    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-tmp-dir\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.533369 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.533279    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-home\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.533547 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.533526    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-model-cache\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.535161 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.535143    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-dshm\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.535485 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.535451    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/592079e2-475f-400c-b529-0b431dc46141-tls-certs\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.542067 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.542043    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9h4\" (UniqueName: \"kubernetes.io/projected/592079e2-475f-400c-b529-0b431dc46141-kube-api-access-nc9h4\") pod \"rate-test-model-ace6c2-kserve-db8746df9-7sndc\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") " pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.619880 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.619770    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:36.758835 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:36.758811    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"]
Jul 06 21:59:36.760758 ip-10-0-133-11 kubenswrapper[2554]: W0706 21:59:36.760729    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod592079e2_475f_400c_b529_0b431dc46141.slice/crio-e20963c7e21c9b9874de1d71c376acdb3f1b422c924216d94b48ec3a4226a541 WatchSource:0}: Error finding container e20963c7e21c9b9874de1d71c376acdb3f1b422c924216d94b48ec3a4226a541: Status 404 returned error can't find the container with id e20963c7e21c9b9874de1d71c376acdb3f1b422c924216d94b48ec3a4226a541
Jul 06 21:59:37.081394 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:37.081360    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc" event={"ID":"592079e2-475f-400c-b529-0b431dc46141","Type":"ContainerStarted","Data":"6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799"}
Jul 06 21:59:37.081594 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:37.081401    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc" event={"ID":"592079e2-475f-400c-b529-0b431dc46141","Type":"ContainerStarted","Data":"e20963c7e21c9b9874de1d71c376acdb3f1b422c924216d94b48ec3a4226a541"}
Jul 06 21:59:37.101704 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:37.101650    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc" podStartSLOduration=1.101632806 podStartE2EDuration="1.101632806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:59:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:59:37.09929925 +0000 UTC m=+2285.720881570" watchObservedRunningTime="2026-07-06 21:59:37.101632806 +0000 UTC m=+2285.723215122"
Jul 06 21:59:46.620805 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:46.620728    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:46.621222 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:46.620822    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:46.632975 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:46.632951    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 21:59:47.147316 ip-10-0-133-11 kubenswrapper[2554]: I0706 21:59:47.147290    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 22:00:00.141933 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.141896    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"]
Jul 06 22:00:00.145626 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.145609    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"
Jul 06 22:00:00.148671 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.148622    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cxwgs\""
Jul 06 22:00:00.155354 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.155325    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"]
Jul 06 22:00:00.158041 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.158014    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brff2\" (UniqueName: \"kubernetes.io/projected/7cbde39c-87e4-4f05-b266-d3372e9b09e2-kube-api-access-brff2\") pod \"maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b\" (UID: \"7cbde39c-87e4-4f05-b266-d3372e9b09e2\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"
Jul 06 22:00:00.258934 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.258890    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brff2\" (UniqueName: \"kubernetes.io/projected/7cbde39c-87e4-4f05-b266-d3372e9b09e2-kube-api-access-brff2\") pod \"maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b\" (UID: \"7cbde39c-87e4-4f05-b266-d3372e9b09e2\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"
Jul 06 22:00:00.269014 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.268991    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brff2\" (UniqueName: \"kubernetes.io/projected/7cbde39c-87e4-4f05-b266-d3372e9b09e2-kube-api-access-brff2\") pod \"maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b\" (UID: \"7cbde39c-87e4-4f05-b266-d3372e9b09e2\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"
Jul 06 22:00:00.459055 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.458950    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"
Jul 06 22:00:00.601052 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:00.601022    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"]
Jul 06 22:00:00.603185 ip-10-0-133-11 kubenswrapper[2554]: W0706 22:00:00.603158    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cbde39c_87e4_4f05_b266_d3372e9b09e2.slice/crio-4efa6dcf1ae8dd93dcdd8729cb643f31fd2154533339d619ce5976d403f1abc8 WatchSource:0}: Error finding container 4efa6dcf1ae8dd93dcdd8729cb643f31fd2154533339d619ce5976d403f1abc8: Status 404 returned error can't find the container with id 4efa6dcf1ae8dd93dcdd8729cb643f31fd2154533339d619ce5976d403f1abc8
Jul 06 22:00:01.215805 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:01.215718    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b" event={"ID":"7cbde39c-87e4-4f05-b266-d3372e9b09e2","Type":"ContainerStarted","Data":"e1fdb228e46b3ff852f828147ffc08b1ffbf0a9b411edc563e96b204c92adef5"}
Jul 06 22:00:01.215805 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:01.215772    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b" event={"ID":"7cbde39c-87e4-4f05-b266-d3372e9b09e2","Type":"ContainerStarted","Data":"4efa6dcf1ae8dd93dcdd8729cb643f31fd2154533339d619ce5976d403f1abc8"}
Jul 06 22:00:01.242718 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:01.242668    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b" podStartSLOduration=1.24265296 podStartE2EDuration="1.24265296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:00:01.240005614 +0000 UTC m=+2309.861587932" watchObservedRunningTime="2026-07-06 22:00:01.24265296 +0000 UTC m=+2309.864235278"
Jul 06 22:00:02.223365 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.223330    2554 generic.go:356] "Generic (PLEG): container finished" podID="7cbde39c-87e4-4f05-b266-d3372e9b09e2" containerID="e1fdb228e46b3ff852f828147ffc08b1ffbf0a9b411edc563e96b204c92adef5" exitCode=0
Jul 06 22:00:02.225817 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.223377    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b" event={"ID":"7cbde39c-87e4-4f05-b266-d3372e9b09e2","Type":"ContainerDied","Data":"e1fdb228e46b3ff852f828147ffc08b1ffbf0a9b411edc563e96b204c92adef5"}
Jul 06 22:00:02.786012 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.785983    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"]
Jul 06 22:00:02.789233 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.789211    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.792775 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.792751    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"default-dockercfg-g624z\""
Jul 06 22:00:02.792775 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.792763    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"kube-root-ca.crt\""
Jul 06 22:00:02.792949 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.792767    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"rate-test-model-d392e3-kserve-self-signed-certs\""
Jul 06 22:00:02.792949 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.792805    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"openshift-service-ca.crt\""
Jul 06 22:00:02.799753 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.799734    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"]
Jul 06 22:00:02.879629 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.879595    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-css8n\" (UniqueName: \"kubernetes.io/projected/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-kube-api-access-css8n\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.879629 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.879632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tls-certs\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.879829 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.879720    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-model-cache\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.879829 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.879749    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-dshm\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.879829 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.879785    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tmp-dir\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.879829 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.879814    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-home\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.984729 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.984694    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-css8n\" (UniqueName: \"kubernetes.io/projected/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-kube-api-access-css8n\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.984729 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.984732    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tls-certs\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.984985 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.984783    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-model-cache\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.984985 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.984801    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-dshm\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.984985 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.984824    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tmp-dir\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.984985 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.984862    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-home\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.985181 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.985162    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-model-cache\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.985257 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.985236    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-home\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.985366 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.985262    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tmp-dir\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.987072 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.987050    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-dshm\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.987347 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.987324    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tls-certs\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:02.993564 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:02.993537    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-css8n\" (UniqueName: \"kubernetes.io/projected/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-kube-api-access-css8n\") pod \"rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") " pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:03.099725 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:03.099634    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:03.243171 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:03.243147    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"]
Jul 06 22:00:03.245122 ip-10-0-133-11 kubenswrapper[2554]: W0706 22:00:03.245095    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e5b1cf8_5dd7_46c2_93f8_953c12d12ff2.slice/crio-c3468b10152cfb20b738893e1a719f982b4427dd52018a5aea80b774596a3c05 WatchSource:0}: Error finding container c3468b10152cfb20b738893e1a719f982b4427dd52018a5aea80b774596a3c05: Status 404 returned error can't find the container with id c3468b10152cfb20b738893e1a719f982b4427dd52018a5aea80b774596a3c05
Jul 06 22:00:03.352518 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:03.352421    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"
Jul 06 22:00:03.388286 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:03.388251    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brff2\" (UniqueName: \"kubernetes.io/projected/7cbde39c-87e4-4f05-b266-d3372e9b09e2-kube-api-access-brff2\") pod \"7cbde39c-87e4-4f05-b266-d3372e9b09e2\" (UID: \"7cbde39c-87e4-4f05-b266-d3372e9b09e2\") "
Jul 06 22:00:03.390236 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:03.390209    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cbde39c-87e4-4f05-b266-d3372e9b09e2-kube-api-access-brff2" (OuterVolumeSpecName: "kube-api-access-brff2") pod "7cbde39c-87e4-4f05-b266-d3372e9b09e2" (UID: "7cbde39c-87e4-4f05-b266-d3372e9b09e2"). InnerVolumeSpecName "kube-api-access-brff2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:00:03.489742 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:03.489705    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brff2\" (UniqueName: \"kubernetes.io/projected/7cbde39c-87e4-4f05-b266-d3372e9b09e2-kube-api-access-brff2\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:04.235540 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:04.235515    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"
Jul 06 22:00:04.235540 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:04.235524    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b" event={"ID":"7cbde39c-87e4-4f05-b266-d3372e9b09e2","Type":"ContainerDied","Data":"4efa6dcf1ae8dd93dcdd8729cb643f31fd2154533339d619ce5976d403f1abc8"}
Jul 06 22:00:04.235760 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:04.235567    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4efa6dcf1ae8dd93dcdd8729cb643f31fd2154533339d619ce5976d403f1abc8"
Jul 06 22:00:04.237190 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:04.237165    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9" event={"ID":"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2","Type":"ContainerStarted","Data":"14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e"}
Jul 06 22:00:04.237315 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:04.237195    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9" event={"ID":"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2","Type":"ContainerStarted","Data":"c3468b10152cfb20b738893e1a719f982b4427dd52018a5aea80b774596a3c05"}
Jul 06 22:00:04.257907 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:04.257860    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9" podStartSLOduration=2.257846527 podStartE2EDuration="2.257846527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:00:04.256822502 +0000 UTC m=+2312.878404818" watchObservedRunningTime="2026-07-06 22:00:04.257846527 +0000 UTC m=+2312.879428843"
Jul 06 22:00:13.100097 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:13.100057    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:13.100566 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:13.100139    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:13.112539 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:13.112516    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:13.296942 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:13.296913    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:42.182913 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:42.182832    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"]
Jul 06 22:00:43.185789 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:43.185758    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"]
Jul 06 22:00:45.041201 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:45.041161    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"]
Jul 06 22:00:45.043962 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:45.043935    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-ace6c2-29722920-62q8b"]
Jul 06 22:00:45.986570 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:45.986530    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cbde39c-87e4-4f05-b266-d3372e9b09e2" path="/var/lib/kubelet/pods/7cbde39c-87e4-4f05-b266-d3372e9b09e2/volumes"
Jul 06 22:00:57.202963 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.202870    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc" podUID="592079e2-475f-400c-b529-0b431dc46141" containerName="main" containerID="cri-o://6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799" gracePeriod=45
Jul 06 22:00:57.447338 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.447311    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 22:00:57.537934 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.537903    2554 generic.go:356] "Generic (PLEG): container finished" podID="592079e2-475f-400c-b529-0b431dc46141" containerID="6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799" exitCode=0
Jul 06 22:00:57.538120 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.537951    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"
Jul 06 22:00:57.538120 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.537996    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc" event={"ID":"592079e2-475f-400c-b529-0b431dc46141","Type":"ContainerDied","Data":"6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799"}
Jul 06 22:00:57.538120 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.538042    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc" event={"ID":"592079e2-475f-400c-b529-0b431dc46141","Type":"ContainerDied","Data":"e20963c7e21c9b9874de1d71c376acdb3f1b422c924216d94b48ec3a4226a541"}
Jul 06 22:00:57.538120 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.538058    2554 scope.go:117] "RemoveContainer" containerID="6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799"
Jul 06 22:00:57.546660 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.546646    2554 scope.go:117] "RemoveContainer" containerID="6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799"
Jul 06 22:00:57.546901 ip-10-0-133-11 kubenswrapper[2554]: E0706 22:00:57.546884    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799\": container with ID starting with 6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799 not found: ID does not exist" containerID="6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799"
Jul 06 22:00:57.546950 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.546909    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799"} err="failed to get container status \"6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799\": rpc error: code = NotFound desc = could not find container \"6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799\": container with ID starting with 6d9cd7f8f43c04979cd1de75c37bdbb64abffad5b67e44a008f3689e5e7ec799 not found: ID does not exist"
Jul 06 22:00:57.606317 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606289    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-dshm\") pod \"592079e2-475f-400c-b529-0b431dc46141\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") "
Jul 06 22:00:57.606469 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606357    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc9h4\" (UniqueName: \"kubernetes.io/projected/592079e2-475f-400c-b529-0b431dc46141-kube-api-access-nc9h4\") pod \"592079e2-475f-400c-b529-0b431dc46141\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") "
Jul 06 22:00:57.606469 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606393    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-model-cache\") pod \"592079e2-475f-400c-b529-0b431dc46141\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") "
Jul 06 22:00:57.606469 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606412    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-tmp-dir\") pod \"592079e2-475f-400c-b529-0b431dc46141\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") "
Jul 06 22:00:57.606644 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606497    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/592079e2-475f-400c-b529-0b431dc46141-tls-certs\") pod \"592079e2-475f-400c-b529-0b431dc46141\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") "
Jul 06 22:00:57.606644 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606547    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-home\") pod \"592079e2-475f-400c-b529-0b431dc46141\" (UID: \"592079e2-475f-400c-b529-0b431dc46141\") "
Jul 06 22:00:57.606753 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606699    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-model-cache" (OuterVolumeSpecName: "model-cache") pod "592079e2-475f-400c-b529-0b431dc46141" (UID: "592079e2-475f-400c-b529-0b431dc46141"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:00:57.606855 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606831    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "592079e2-475f-400c-b529-0b431dc46141" (UID: "592079e2-475f-400c-b529-0b431dc46141"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:00:57.606933 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606874    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-home" (OuterVolumeSpecName: "home") pod "592079e2-475f-400c-b529-0b431dc46141" (UID: "592079e2-475f-400c-b529-0b431dc46141"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:00:57.606987 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606937    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-model-cache\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:57.606987 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.606960    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-tmp-dir\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:57.608513 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.608491    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/592079e2-475f-400c-b529-0b431dc46141-kube-api-access-nc9h4" (OuterVolumeSpecName: "kube-api-access-nc9h4") pod "592079e2-475f-400c-b529-0b431dc46141" (UID: "592079e2-475f-400c-b529-0b431dc46141"). InnerVolumeSpecName "kube-api-access-nc9h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:00:57.608568 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.608498    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-dshm" (OuterVolumeSpecName: "dshm") pod "592079e2-475f-400c-b529-0b431dc46141" (UID: "592079e2-475f-400c-b529-0b431dc46141"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:00:57.608568 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.608544    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/592079e2-475f-400c-b529-0b431dc46141-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "592079e2-475f-400c-b529-0b431dc46141" (UID: "592079e2-475f-400c-b529-0b431dc46141"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:00:57.708357 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.708317    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/592079e2-475f-400c-b529-0b431dc46141-tls-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:57.708357 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.708350    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-home\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:57.708357 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.708360    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/592079e2-475f-400c-b529-0b431dc46141-dshm\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:57.708357 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.708369    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc9h4\" (UniqueName: \"kubernetes.io/projected/592079e2-475f-400c-b529-0b431dc46141-kube-api-access-nc9h4\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:57.859468 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.859425    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"]
Jul 06 22:00:57.870062 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.870029    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ace6c2/rate-test-model-ace6c2-kserve-db8746df9-7sndc"]
Jul 06 22:00:57.986924 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:57.986892    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="592079e2-475f-400c-b529-0b431dc46141" path="/var/lib/kubelet/pods/592079e2-475f-400c-b529-0b431dc46141/volumes"
Jul 06 22:00:58.206390 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.206300    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9" podUID="3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" containerName="main" containerID="cri-o://14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e" gracePeriod=45
Jul 06 22:00:58.459487 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.459408    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:58.545564 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.545530    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" containerID="14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e" exitCode=0
Jul 06 22:00:58.545762 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.545580    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"
Jul 06 22:00:58.545762 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.545613    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9" event={"ID":"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2","Type":"ContainerDied","Data":"14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e"}
Jul 06 22:00:58.545762 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.545659    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9" event={"ID":"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2","Type":"ContainerDied","Data":"c3468b10152cfb20b738893e1a719f982b4427dd52018a5aea80b774596a3c05"}
Jul 06 22:00:58.545762 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.545684    2554 scope.go:117] "RemoveContainer" containerID="14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e"
Jul 06 22:00:58.554495 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.554476    2554 scope.go:117] "RemoveContainer" containerID="14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e"
Jul 06 22:00:58.554764 ip-10-0-133-11 kubenswrapper[2554]: E0706 22:00:58.554744    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e\": container with ID starting with 14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e not found: ID does not exist" containerID="14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e"
Jul 06 22:00:58.554820 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.554771    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e"} err="failed to get container status \"14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e\": rpc error: code = NotFound desc = could not find container \"14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e\": container with ID starting with 14d83424b60bc0e058d2dd0e4b8f09467a47ead607290413410eb8a90850987e not found: ID does not exist"
Jul 06 22:00:58.617795 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.617763    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-home\") pod \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") "
Jul 06 22:00:58.617990 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.617805    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-model-cache\") pod \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") "
Jul 06 22:00:58.617990 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.617839    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tls-certs\") pod \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") "
Jul 06 22:00:58.617990 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.617879    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-css8n\" (UniqueName: \"kubernetes.io/projected/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-kube-api-access-css8n\") pod \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") "
Jul 06 22:00:58.617990 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.617905    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-dshm\") pod \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") "
Jul 06 22:00:58.617990 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.617928    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tmp-dir\") pod \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\" (UID: \"3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2\") "
Jul 06 22:00:58.618265 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.618098    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-home" (OuterVolumeSpecName: "home") pod "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" (UID: "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:00:58.618265 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.618107    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" (UID: "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:00:58.618265 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.618242    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" (UID: "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:00:58.620193 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.620171    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-dshm" (OuterVolumeSpecName: "dshm") pod "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" (UID: "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:00:58.620193 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.620177    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-kube-api-access-css8n" (OuterVolumeSpecName: "kube-api-access-css8n") pod "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" (UID: "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2"). InnerVolumeSpecName "kube-api-access-css8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:00:58.620322 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.620268    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" (UID: "3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 22:00:58.718975 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.718874    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-home\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:58.718975 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.718909    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-model-cache\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:58.718975 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.718925    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tls-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:58.718975 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.718940    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-css8n\" (UniqueName: \"kubernetes.io/projected/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-kube-api-access-css8n\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:58.718975 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.718953    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-dshm\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:58.719260 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.718991    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2-tmp-dir\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:00:58.867915 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.867886    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"]
Jul 06 22:00:58.871914 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:58.871887    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/rate-test-model-d392e3-kserve-7c84cd9b7f-fgxp9"]
Jul 06 22:00:59.986335 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:00:59.986292    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" path="/var/lib/kubelet/pods/3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2/volumes"
Jul 06 22:01:26.980123 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:26.980091    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"]
Jul 06 22:01:26.980665 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:26.980356    2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy" containerID="cri-o://c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113" gracePeriod=30
Jul 06 22:01:32.054625 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.054590    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 22:01:32.063138 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.063116    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 22:01:32.149806 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.149777    2554 scope.go:117] "RemoveContainer" containerID="3b5058407d2c72d8cbbcb627174251602803364ade1317a499391df9ccc9e56a"
Jul 06 22:01:32.232642 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.232613    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 22:01:32.335832 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.335801    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-data\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336037 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.335864    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-certs\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336037 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.335894    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36afee0-0097-46a5-9f2b-5e879823b648-istio-podinfo\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336037 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.335933    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-envoy\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336037 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.335969    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36afee0-0097-46a5-9f2b-5e879823b648-istiod-ca-cert\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336256 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336055    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-socket\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336256 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336078    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-istio-token\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336256 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336109    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-credential-socket\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336256 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336134    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cnwg\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-kube-api-access-5cnwg\") pod \"a36afee0-0097-46a5-9f2b-5e879823b648\" (UID: \"a36afee0-0097-46a5-9f2b-5e879823b648\") "
Jul 06 22:01:32.336256 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336176    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:32.336548 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336401    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-certs\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.336548 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336473    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:32.336548 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336543    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:32.336717 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336541    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a36afee0-0097-46a5-9f2b-5e879823b648-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:01:32.336837 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.336815    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-data" (OuterVolumeSpecName: "istio-data") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:32.338230 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.338193    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-istio-token" (OuterVolumeSpecName: "istio-token") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:01:32.338343 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.338238    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a36afee0-0097-46a5-9f2b-5e879823b648-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 22:01:32.338479 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.338461    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:32.338680 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.338663    2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-kube-api-access-5cnwg" (OuterVolumeSpecName: "kube-api-access-5cnwg") pod "a36afee0-0097-46a5-9f2b-5e879823b648" (UID: "a36afee0-0097-46a5-9f2b-5e879823b648"). InnerVolumeSpecName "kube-api-access-5cnwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:01:32.437799 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.437765    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-data\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.437799 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.437790    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a36afee0-0097-46a5-9f2b-5e879823b648-istio-podinfo\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.437799 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.437799    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-istio-envoy\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.437799 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.437807    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a36afee0-0097-46a5-9f2b-5e879823b648-istiod-ca-cert\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.438056 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.437815    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-workload-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.438056 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.437822    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-istio-token\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.438056 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.437830    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a36afee0-0097-46a5-9f2b-5e879823b648-credential-socket\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.438056 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.437838    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cnwg\" (UniqueName: \"kubernetes.io/projected/a36afee0-0097-46a5-9f2b-5e879823b648-kube-api-access-5cnwg\") on node \"ip-10-0-133-11.ec2.internal\" DevicePath \"\""
Jul 06 22:01:32.736880 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.736789    2554 generic.go:356] "Generic (PLEG): container finished" podID="a36afee0-0097-46a5-9f2b-5e879823b648" containerID="c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113" exitCode=0
Jul 06 22:01:32.736880 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.736837    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" event={"ID":"a36afee0-0097-46a5-9f2b-5e879823b648","Type":"ContainerDied","Data":"c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113"}
Jul 06 22:01:32.736880 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.736844    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"
Jul 06 22:01:32.736880 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.736880    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd" event={"ID":"a36afee0-0097-46a5-9f2b-5e879823b648","Type":"ContainerDied","Data":"ba698545d064b3026009807dde6adb641f8954416f4e9980d25c632b7923c52a"}
Jul 06 22:01:32.737206 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.736901    2554 scope.go:117] "RemoveContainer" containerID="c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113"
Jul 06 22:01:32.746467 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.746445    2554 scope.go:117] "RemoveContainer" containerID="c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113"
Jul 06 22:01:32.746740 ip-10-0-133-11 kubenswrapper[2554]: E0706 22:01:32.746719    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113\": container with ID starting with c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113 not found: ID does not exist" containerID="c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113"
Jul 06 22:01:32.746805 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.746753    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113"} err="failed to get container status \"c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113\": rpc error: code = NotFound desc = could not find container \"c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113\": container with ID starting with c0c3b2ddcd05eb6bd392343e05460dd3f4997478eb76ac7f2c70e4cf1178b113 not found: ID does not exist"
Jul 06 22:01:32.757770 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.757744    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"]
Jul 06 22:01:32.762017 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:32.761995    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-ace6c2-openshift-default-56c5c44d6c-h6fvd"]
Jul 06 22:01:33.992825 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:33.992792    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" path="/var/lib/kubelet/pods/a36afee0-0097-46a5-9f2b-5e879823b648/volumes"
Jul 06 22:01:34.845208 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:34.845176    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-845967d4d7-ngmv5_dbc0a1df-8bb3-477f-919a-0e8ac8c5733b/authorino/0.log"
Jul 06 22:01:39.920640 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:39.920606    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722905-ww9bs_074b350b-6883-478e-9a83-0e2551b6c2f3/cleanup/0.log"
Jul 06 22:01:40.264358 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:40.264330    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x2n2t_8c3e61e9-3c43-4cd6-8398-dac7fea93405/server/0.log"
Jul 06 22:01:40.508809 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:40.508775    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757974bfb6-5hmjf_22eb9d8a-e03d-4cf5-823e-e04468a7fbcc/manager/0.log"
Jul 06 22:01:40.515549 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:40.515490    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757974bfb6-5hmjf_22eb9d8a-e03d-4cf5-823e-e04468a7fbcc/copy-manifests/0.log"
Jul 06 22:01:41.699118 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.699090    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz_7a4bdcad-e9e8-49f9-9259-363ef154bc7d/pull/0.log"
Jul 06 22:01:41.705803 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.705779    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz_7a4bdcad-e9e8-49f9-9259-363ef154bc7d/extract/0.log"
Jul 06 22:01:41.712644 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.712623    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz_7a4bdcad-e9e8-49f9-9259-363ef154bc7d/util/0.log"
Jul 06 22:01:41.824502 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.824473    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g_bb73feda-e515-40db-b206-c238644abe03/util/0.log"
Jul 06 22:01:41.830680 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.830657    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g_bb73feda-e515-40db-b206-c238644abe03/pull/0.log"
Jul 06 22:01:41.836616 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.836592    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g_bb73feda-e515-40db-b206-c238644abe03/extract/0.log"
Jul 06 22:01:41.946253 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.946215    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx_cf3ff1fc-e8fe-4e73-973b-0fcf26f83311/pull/0.log"
Jul 06 22:01:41.952244 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.952186    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx_cf3ff1fc-e8fe-4e73-973b-0fcf26f83311/extract/0.log"
Jul 06 22:01:41.957849 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:41.957833    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx_cf3ff1fc-e8fe-4e73-973b-0fcf26f83311/util/0.log"
Jul 06 22:01:42.073703 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:42.073676    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9_2f0a9925-7bcd-446b-89d1-ab4e4b1083ef/extract/0.log"
Jul 06 22:01:42.079784 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:42.079767    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9_2f0a9925-7bcd-446b-89d1-ab4e4b1083ef/util/0.log"
Jul 06 22:01:42.085753 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:42.085731    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9_2f0a9925-7bcd-446b-89d1-ab4e4b1083ef/pull/0.log"
Jul 06 22:01:42.207656 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:42.207563    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-845967d4d7-ngmv5_dbc0a1df-8bb3-477f-919a-0e8ac8c5733b/authorino/0.log"
Jul 06 22:01:43.358283 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:43.358252    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678z7tnn_43e4b537-ee3c-403a-b38a-8da243a1ff5d/istio-proxy/0.log"
Jul 06 22:01:43.701498 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:43.701389    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4d5f5648-s957n_d54b7152-2e32-4180-90eb-8f0ec19f2235/kube-auth-proxy/0.log"
Jul 06 22:01:44.171946 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:44.171920    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c76c95d9c-x72n7_3dafa9ce-5b81-4115-8e1a-60c04ca1581c/router/0.log"
Jul 06 22:01:44.501802 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:44.501770    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8f67c_98ee6afc-e342-46fe-b88d-ea4406eecc6c/main/0.log"
Jul 06 22:01:44.957105 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:44.957019    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-r8vl8_1837d621-96ec-44d5-8d2e-7a86ed3641e5/main/0.log"
Jul 06 22:01:49.180152 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180109    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gx6gm/must-gather-dh6rx"]
Jul 06 22:01:49.180659 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180640    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cbde39c-87e4-4f05-b266-d3372e9b09e2" containerName="cleanup"
Jul 06 22:01:49.180736 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180662    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cbde39c-87e4-4f05-b266-d3372e9b09e2" containerName="cleanup"
Jul 06 22:01:49.180736 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180684    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy"
Jul 06 22:01:49.180736 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180693    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy"
Jul 06 22:01:49.180736 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180702    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" containerName="main"
Jul 06 22:01:49.180736 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180711    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" containerName="main"
Jul 06 22:01:49.180736 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180732    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy"
Jul 06 22:01:49.181029 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180741    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy"
Jul 06 22:01:49.181029 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180768    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="592079e2-475f-400c-b529-0b431dc46141" containerName="main"
Jul 06 22:01:49.181029 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180777    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="592079e2-475f-400c-b529-0b431dc46141" containerName="main"
Jul 06 22:01:49.181029 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180866    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5b1cf8-5dd7-46c2-93f8-953c12d12ff2" containerName="main"
Jul 06 22:01:49.181029 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180880    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy"
Jul 06 22:01:49.181029 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180890    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36afee0-0097-46a5-9f2b-5e879823b648" containerName="istio-proxy"
Jul 06 22:01:49.181029 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180900    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="592079e2-475f-400c-b529-0b431dc46141" containerName="main"
Jul 06 22:01:49.181029 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.180909    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cbde39c-87e4-4f05-b266-d3372e9b09e2" containerName="cleanup"
Jul 06 22:01:49.184321 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.184300    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gx6gm/must-gather-dh6rx"
Jul 06 22:01:49.187089 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.187071    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gx6gm\"/\"kube-root-ca.crt\""
Jul 06 22:01:49.187089 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.187072    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gx6gm\"/\"openshift-service-ca.crt\""
Jul 06 22:01:49.188165 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.188146    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gx6gm\"/\"default-dockercfg-c9jwm\""
Jul 06 22:01:49.195243 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.195218    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gx6gm/must-gather-dh6rx"]
Jul 06 22:01:49.290390 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.290352    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/24aadaff-8547-499e-a0cb-1f509a85709e-must-gather-output\") pod \"must-gather-dh6rx\" (UID: \"24aadaff-8547-499e-a0cb-1f509a85709e\") " pod="openshift-must-gather-gx6gm/must-gather-dh6rx"
Jul 06 22:01:49.290602 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.290411    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q5fc\" (UniqueName: \"kubernetes.io/projected/24aadaff-8547-499e-a0cb-1f509a85709e-kube-api-access-2q5fc\") pod \"must-gather-dh6rx\" (UID: \"24aadaff-8547-499e-a0cb-1f509a85709e\") " pod="openshift-must-gather-gx6gm/must-gather-dh6rx"
Jul 06 22:01:49.391842 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.391801    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/24aadaff-8547-499e-a0cb-1f509a85709e-must-gather-output\") pod \"must-gather-dh6rx\" (UID: \"24aadaff-8547-499e-a0cb-1f509a85709e\") " pod="openshift-must-gather-gx6gm/must-gather-dh6rx"
Jul 06 22:01:49.392018 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.391856    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q5fc\" (UniqueName: \"kubernetes.io/projected/24aadaff-8547-499e-a0cb-1f509a85709e-kube-api-access-2q5fc\") pod \"must-gather-dh6rx\" (UID: \"24aadaff-8547-499e-a0cb-1f509a85709e\") " pod="openshift-must-gather-gx6gm/must-gather-dh6rx"
Jul 06 22:01:49.392168 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.392146    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/24aadaff-8547-499e-a0cb-1f509a85709e-must-gather-output\") pod \"must-gather-dh6rx\" (UID: \"24aadaff-8547-499e-a0cb-1f509a85709e\") " pod="openshift-must-gather-gx6gm/must-gather-dh6rx"
Jul 06 22:01:49.400579 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.400553    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q5fc\" (UniqueName: \"kubernetes.io/projected/24aadaff-8547-499e-a0cb-1f509a85709e-kube-api-access-2q5fc\") pod \"must-gather-dh6rx\" (UID: \"24aadaff-8547-499e-a0cb-1f509a85709e\") " pod="openshift-must-gather-gx6gm/must-gather-dh6rx"
Jul 06 22:01:49.493369 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.493274    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gx6gm/must-gather-dh6rx"
Jul 06 22:01:49.627148 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.627124    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gx6gm/must-gather-dh6rx"]
Jul 06 22:01:49.628273 ip-10-0-133-11 kubenswrapper[2554]: W0706 22:01:49.628236    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24aadaff_8547_499e_a0cb_1f509a85709e.slice/crio-4295604ddcb0e7ee0a5eb49aa656f4080cc2e29389bab2e08f40f5bc954ca406 WatchSource:0}: Error finding container 4295604ddcb0e7ee0a5eb49aa656f4080cc2e29389bab2e08f40f5bc954ca406: Status 404 returned error can't find the container with id 4295604ddcb0e7ee0a5eb49aa656f4080cc2e29389bab2e08f40f5bc954ca406
Jul 06 22:01:49.630096 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.630080    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 22:01:49.830478 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:49.830425    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gx6gm/must-gather-dh6rx" event={"ID":"24aadaff-8547-499e-a0cb-1f509a85709e","Type":"ContainerStarted","Data":"4295604ddcb0e7ee0a5eb49aa656f4080cc2e29389bab2e08f40f5bc954ca406"}
Jul 06 22:01:51.847097 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:51.847059    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gx6gm/must-gather-dh6rx" event={"ID":"24aadaff-8547-499e-a0cb-1f509a85709e","Type":"ContainerStarted","Data":"b71420012e218460b66743086e8631a97405924894332f99470aac950740fcb6"}
Jul 06 22:01:51.847584 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:51.847111    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gx6gm/must-gather-dh6rx" event={"ID":"24aadaff-8547-499e-a0cb-1f509a85709e","Type":"ContainerStarted","Data":"a547bc8dd20cc3e4914bdf8c19862a28f5d7e19a7ce271e23944343f2cb6e088"}
Jul 06 22:01:51.864007 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:51.863944    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gx6gm/must-gather-dh6rx" podStartSLOduration=1.652122869 podStartE2EDuration="2.863924812s" totalImagesPullingTime="1.211801943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:01:51.863577387 +0000 UTC m=+2420.485159705" watchObservedRunningTime="2026-07-06 22:01:51.863924812 +0000 UTC m=+2420.485507129"
Jul 06 22:01:52.409724 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:52.409695    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-447vd_7975b17c-b872-4395-a032-094e41b8ac03/global-pull-secret-syncer/0.log"
Jul 06 22:01:52.600455 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:52.600405    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vlpm7_4f9db558-dde6-4a7e-baf3-8ebd4ae0a5b3/konnectivity-agent/0.log"
Jul 06 22:01:52.670426 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:52.670333    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-11.ec2.internal_9534bd1ba9e0a23b627fcaab9f623fa1/haproxy/0.log"
Jul 06 22:01:57.260960 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.260918    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz_7a4bdcad-e9e8-49f9-9259-363ef154bc7d/extract/0.log"
Jul 06 22:01:57.285356 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.285307    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz_7a4bdcad-e9e8-49f9-9259-363ef154bc7d/util/0.log"
Jul 06 22:01:57.307241 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.307203    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594cxvz_7a4bdcad-e9e8-49f9-9259-363ef154bc7d/pull/0.log"
Jul 06 22:01:57.337051 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.337021    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g_bb73feda-e515-40db-b206-c238644abe03/extract/0.log"
Jul 06 22:01:57.357673 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.357642    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g_bb73feda-e515-40db-b206-c238644abe03/util/0.log"
Jul 06 22:01:57.381305 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.381260    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gj55g_bb73feda-e515-40db-b206-c238644abe03/pull/0.log"
Jul 06 22:01:57.424182 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.424146    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx_cf3ff1fc-e8fe-4e73-973b-0fcf26f83311/extract/0.log"
Jul 06 22:01:57.442906 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.442875    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx_cf3ff1fc-e8fe-4e73-973b-0fcf26f83311/util/0.log"
Jul 06 22:01:57.463445 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.463400    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738mgkx_cf3ff1fc-e8fe-4e73-973b-0fcf26f83311/pull/0.log"
Jul 06 22:01:57.489328 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.489295    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9_2f0a9925-7bcd-446b-89d1-ab4e4b1083ef/extract/0.log"
Jul 06 22:01:57.511838 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.511761    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9_2f0a9925-7bcd-446b-89d1-ab4e4b1083ef/util/0.log"
Jul 06 22:01:57.538558 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.538524    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grbh9_2f0a9925-7bcd-446b-89d1-ab4e4b1083ef/pull/0.log"
Jul 06 22:01:57.940508 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:57.939225    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-845967d4d7-ngmv5_dbc0a1df-8bb3-477f-919a-0e8ac8c5733b/authorino/0.log"
Jul 06 22:01:59.931591 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:59.931554    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31287881-e9e1-48e2-8a1b-fc32a31ad3c5/alertmanager/0.log"
Jul 06 22:01:59.955778 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:59.955746    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31287881-e9e1-48e2-8a1b-fc32a31ad3c5/config-reloader/0.log"
Jul 06 22:01:59.976543 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:01:59.976508    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31287881-e9e1-48e2-8a1b-fc32a31ad3c5/kube-rbac-proxy-web/0.log"
Jul 06 22:02:00.000256 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.000216    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31287881-e9e1-48e2-8a1b-fc32a31ad3c5/kube-rbac-proxy/0.log"
Jul 06 22:02:00.020010 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.019973    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31287881-e9e1-48e2-8a1b-fc32a31ad3c5/kube-rbac-proxy-metric/0.log"
Jul 06 22:02:00.040027 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.039993    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31287881-e9e1-48e2-8a1b-fc32a31ad3c5/prom-label-proxy/0.log"
Jul 06 22:02:00.064157 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.064125    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_31287881-e9e1-48e2-8a1b-fc32a31ad3c5/init-config-reloader/0.log"
Jul 06 22:02:00.104809 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.104774    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-mfdvq_2729e991-d331-4162-b6ce-5b8130722c90/cluster-monitoring-operator/0.log"
Jul 06 22:02:00.138290 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.138256    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-wjfss_dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025/kube-state-metrics/0.log"
Jul 06 22:02:00.156218 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.156161    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-wjfss_dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025/kube-rbac-proxy-main/0.log"
Jul 06 22:02:00.188239 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.188141    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-wjfss_dfe5dcf1-4e60-4fbe-978b-fdb67fc9e025/kube-rbac-proxy-self/0.log"
Jul 06 22:02:00.437311 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.437285    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzkxq_1817e7c7-d772-4dac-9d4f-b8c399f6b8dc/node-exporter/0.log"
Jul 06 22:02:00.457620 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.457543    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzkxq_1817e7c7-d772-4dac-9d4f-b8c399f6b8dc/kube-rbac-proxy/0.log"
Jul 06 22:02:00.479328 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.479235    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzkxq_1817e7c7-d772-4dac-9d4f-b8c399f6b8dc/init-textfile/0.log"
Jul 06 22:02:00.749656 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.749624    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-d9kn2_7b8c61c0-9c76-4368-afc5-a72442107435/prometheus-operator/0.log"
Jul 06 22:02:00.765571 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:00.765530    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-d9kn2_7b8c61c0-9c76-4368-afc5-a72442107435/kube-rbac-proxy/0.log"
Jul 06 22:02:02.794391 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:02.794362    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/1.log"
Jul 06 22:02:02.803091 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:02.803062    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-2thlb_e316c648-a5ec-4935-8dae-4b5dc5d02975/console-operator/2.log"
Jul 06 22:02:03.007895 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.007861    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"]
Jul 06 22:02:03.016537 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.016501    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.020602 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.020563    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"]
Jul 06 22:02:03.143697 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.143615    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-proc\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.143697 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.143647    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-lib-modules\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.143880 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.143760    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcmz8\" (UniqueName: \"kubernetes.io/projected/f36365ae-204a-4cf5-a6c1-a63a06c05a38-kube-api-access-qcmz8\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.143880 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.143786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-podres\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.143880 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.143807    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-sys\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.244455 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.244401    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcmz8\" (UniqueName: \"kubernetes.io/projected/f36365ae-204a-4cf5-a6c1-a63a06c05a38-kube-api-access-qcmz8\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.245085 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.245054    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-podres\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.245195 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.245110    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-sys\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.245195 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.245153    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-proc\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.245195 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.245180    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-lib-modules\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.245299 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.245216    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-podres\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.245299 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.245229    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-sys\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.245299 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.245235    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-proc\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.245397 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.245346    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f36365ae-204a-4cf5-a6c1-a63a06c05a38-lib-modules\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.252993 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.252963    2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcmz8\" (UniqueName: \"kubernetes.io/projected/f36365ae-204a-4cf5-a6c1-a63a06c05a38-kube-api-access-qcmz8\") pod \"perf-node-gather-daemonset-f86l6\" (UID: \"f36365ae-204a-4cf5-a6c1-a63a06c05a38\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.331268 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.331218    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.513807 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.513778    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"]
Jul 06 22:02:03.516092 ip-10-0-133-11 kubenswrapper[2554]: W0706 22:02:03.516055    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf36365ae_204a_4cf5_a6c1_a63a06c05a38.slice/crio-d1daf9a2677cc493daa275a8190e71d283cc14674d8102684783ef131709bcee WatchSource:0}: Error finding container d1daf9a2677cc493daa275a8190e71d283cc14674d8102684783ef131709bcee: Status 404 returned error can't find the container with id d1daf9a2677cc493daa275a8190e71d283cc14674d8102684783ef131709bcee
Jul 06 22:02:03.940465 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.940352    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6" event={"ID":"f36365ae-204a-4cf5-a6c1-a63a06c05a38","Type":"ContainerStarted","Data":"707a40428b27022a169fd7fc04ae93bf6876390a92172afe15c935a5c26d0f72"}
Jul 06 22:02:03.940465 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.940409    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6" event={"ID":"f36365ae-204a-4cf5-a6c1-a63a06c05a38","Type":"ContainerStarted","Data":"d1daf9a2677cc493daa275a8190e71d283cc14674d8102684783ef131709bcee"}
Jul 06 22:02:03.940971 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.940475    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:03.947235 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.947208    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-qlw9t_e5f83e76-e6ae-49c2-b583-a73409caafc8/volume-data-source-validator/0.log"
Jul 06 22:02:03.959451 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:03.959384    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6" podStartSLOduration=1.959364522 podStartE2EDuration="1.959364522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:02:03.95658701 +0000 UTC m=+2432.578169350" watchObservedRunningTime="2026-07-06 22:02:03.959364522 +0000 UTC m=+2432.580946839"
Jul 06 22:02:05.054669 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:05.054642    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qw8q4_1080bc03-6fa6-4840-ba3f-4be61a48ea4a/dns/0.log"
Jul 06 22:02:05.074190 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:05.074155    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qw8q4_1080bc03-6fa6-4840-ba3f-4be61a48ea4a/kube-rbac-proxy/0.log"
Jul 06 22:02:05.142489 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:05.142453    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z966s_a8dc5d9b-cafa-44e0-9031-cf12c0632135/dns-node-resolver/0.log"
Jul 06 22:02:05.736552 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:05.736521    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tzktv_d320d61c-9702-4005-845e-1f9143567533/node-ca/0.log"
Jul 06 22:02:06.694734 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:06.694708    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678z7tnn_43e4b537-ee3c-403a-b38a-8da243a1ff5d/istio-proxy/0.log"
Jul 06 22:02:06.859189 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:06.859163    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4d5f5648-s957n_d54b7152-2e32-4180-90eb-8f0ec19f2235/kube-auth-proxy/0.log"
Jul 06 22:02:07.013909 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:07.013880    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c76c95d9c-x72n7_3dafa9ce-5b81-4115-8e1a-60c04ca1581c/router/0.log"
Jul 06 22:02:07.678921 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:07.678890    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6t952_8afdce3a-fde5-4d11-895a-9abea3702aa7/serve-healthcheck-canary/0.log"
Jul 06 22:02:08.195595 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:08.195564    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rlzt5_3142fb0d-2203-4835-b135-550232ba736b/insights-operator/0.log"
Jul 06 22:02:08.195994 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:08.195631    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rlzt5_3142fb0d-2203-4835-b135-550232ba736b/insights-operator/1.log"
Jul 06 22:02:08.351252 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:08.351179    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmgzk_aa4e6fde-f2f3-49c4-936a-bcc49a65bf85/kube-rbac-proxy/0.log"
Jul 06 22:02:08.371063 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:08.371037    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmgzk_aa4e6fde-f2f3-49c4-936a-bcc49a65bf85/exporter/0.log"
Jul 06 22:02:08.390261 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:08.390234    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fmgzk_aa4e6fde-f2f3-49c4-936a-bcc49a65bf85/extractor/0.log"
Jul 06 22:02:09.958687 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:09.958653    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-f86l6"
Jul 06 22:02:10.685183 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:10.685155    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722905-ww9bs_074b350b-6883-478e-9a83-0e2551b6c2f3/cleanup/0.log"
Jul 06 22:02:10.833031 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:10.833004    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x2n2t_8c3e61e9-3c43-4cd6-8398-dac7fea93405/server/0.log"
Jul 06 22:02:11.005527 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:11.005482    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757974bfb6-5hmjf_22eb9d8a-e03d-4cf5-823e-e04468a7fbcc/manager/0.log"
Jul 06 22:02:11.022755 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:11.022732    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757974bfb6-5hmjf_22eb9d8a-e03d-4cf5-823e-e04468a7fbcc/copy-manifests/0.log"
Jul 06 22:02:12.661386 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:12.661351    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d694bd4f8-b58xq_13ffe78d-5de6-4c5a-9860-efa9bb25c904/manager/0.log"
Jul 06 22:02:12.713948 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:12.713858    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mtvw8_507fefc2-02cd-4976-9708-23fa0efc50d5/openshift-lws-operator/0.log"
Jul 06 22:02:13.244872 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:13.244837    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678z7tnn_43e4b537-ee3c-403a-b38a-8da243a1ff5d/istio-proxy/0.log"
Jul 06 22:02:13.363822 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:13.363794    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4d5f5648-s957n_d54b7152-2e32-4180-90eb-8f0ec19f2235/kube-auth-proxy/0.log"
Jul 06 22:02:13.484988 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:13.484911    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c76c95d9c-x72n7_3dafa9ce-5b81-4115-8e1a-60c04ca1581c/router/0.log"
Jul 06 22:02:14.619093 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:14.618996    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678z7tnn_43e4b537-ee3c-403a-b38a-8da243a1ff5d/istio-proxy/0.log"
Jul 06 22:02:14.769533 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:14.769507    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4d5f5648-s957n_d54b7152-2e32-4180-90eb-8f0ec19f2235/kube-auth-proxy/0.log"
Jul 06 22:02:14.906497 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:14.906407    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c76c95d9c-x72n7_3dafa9ce-5b81-4115-8e1a-60c04ca1581c/router/0.log"
Jul 06 22:02:18.326239 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:18.326202    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-lcr7j_e0f35886-27bf-4fef-99f9-cae10a51a743/kube-storage-version-migrator-operator/1.log"
Jul 06 22:02:18.328022 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:18.327990    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-lcr7j_e0f35886-27bf-4fef-99f9-cae10a51a743/kube-storage-version-migrator-operator/0.log"
Jul 06 22:02:19.377026 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:19.377000    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzk4f_5e0b5fbc-e414-4f2f-bccd-42fba0c9f387/kube-multus-additional-cni-plugins/0.log"
Jul 06 22:02:19.398811 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:19.398783    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzk4f_5e0b5fbc-e414-4f2f-bccd-42fba0c9f387/egress-router-binary-copy/0.log"
Jul 06 22:02:19.419081 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:19.419056    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzk4f_5e0b5fbc-e414-4f2f-bccd-42fba0c9f387/cni-plugins/0.log"
Jul 06 22:02:19.438501 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:19.438474    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzk4f_5e0b5fbc-e414-4f2f-bccd-42fba0c9f387/bond-cni-plugin/0.log"
Jul 06 22:02:19.459584 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:19.459559    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzk4f_5e0b5fbc-e414-4f2f-bccd-42fba0c9f387/routeoverride-cni/0.log"
Jul 06 22:02:19.478304 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:19.478276    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzk4f_5e0b5fbc-e414-4f2f-bccd-42fba0c9f387/whereabouts-cni-bincopy/0.log"
Jul 06 22:02:19.498236 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:19.498207    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzk4f_5e0b5fbc-e414-4f2f-bccd-42fba0c9f387/whereabouts-cni/0.log"
Jul 06 22:02:19.873612 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:19.873577    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vlbt8_e1e160fe-0dbb-423a-ba4b-45836113262b/kube-multus/0.log"
Jul 06 22:02:20.022736 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:20.022709    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-slj8s_4d35cde2-d4f1-4831-bc6e-0db34876af88/network-metrics-daemon/0.log"
Jul 06 22:02:20.039779 ip-10-0-133-11 kubenswrapper[2554]: I0706 22:02:20.039747    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-slj8s_4d35cde2-d4f1-4831-bc6e-0db34876af88/kube-rbac-proxy/0.log"