Jul 23 09:52:48.300391 ip-10-0-141-125 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 09:52:48.300400 ip-10-0-141-125 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 09:52:48.300407 ip-10-0-141-125 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 09:52:48.300617 ip-10-0-141-125 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 09:52:59.511349 ip-10-0-141-125 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 09:52:59.511368 ip-10-0-141-125 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a80b5af42f1947a7a03e3af51d90cc7c --
Jul 23 09:54:35.648523 ip-10-0-141-125 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 09:54:36.036071 ip-10-0-141-125 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 09:54:36.036071 ip-10-0-141-125 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 09:54:36.036071 ip-10-0-141-125 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 09:54:36.036071 ip-10-0-141-125 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 09:54:36.036071 ip-10-0-141-125 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 09:54:36.036942 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.036826    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 09:54:36.042167 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042150    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:36.042167 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042167    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042176    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042179    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042182    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042185    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042188    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042191    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042194    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042198    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042201    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042204    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042207    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042210    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042212    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042215    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042217    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042220    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042223    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042226    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042228    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:36.042231 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042247    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042252    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042279    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042297    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042301    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042305    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042309    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042314    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042318    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042321    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042324    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042327    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042331    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042334    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042337    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042341    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042346    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042349    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042355    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:36.042722 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042358    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042361    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042363    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042366    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042369    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042371    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042374    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042376    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042379    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042385    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042388    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042390    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042393    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042395    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042398    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042402    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042404    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042407    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042410    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042413    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:36.043171 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042415    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042417    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042420    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042422    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042425    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042428    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042430    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042433    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042435    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042438    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042440    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042443    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042445    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042448    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042450    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042452    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042455    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042458    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042460    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042463    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:36.043676 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042465    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042467    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042470    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042473    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042476    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042478    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042481    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042484    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042487    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042490    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042492    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042494    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042497    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042499    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042502    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042504    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042507    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042509    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.042512    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043255    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:36.044160 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043262    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043265    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043268    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043270    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043273    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043276    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043279    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043281    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043284    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043287    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043289    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043292    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043294    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043297    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043300    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043303    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043306    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043308    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043311    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043315    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:36.044685 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043317    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043320    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043322    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043325    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043327    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043330    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043332    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043334    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043337    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043340    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043342    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043345    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043348    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043350    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043352    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043355    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043357    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043360    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043362    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043364    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:36.045186 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043367    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043369    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043372    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043374    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043377    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043379    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043381    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043384    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043387    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043390    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043393    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043396    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043398    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043400    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043403    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043405    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043408    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043410    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043413    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043415    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:36.045695 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043418    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043420    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043422    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043426    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043430    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043433    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043436    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043438    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043441    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043443    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043447    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043451    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043453    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043456    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043459    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043462    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043465    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043467    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:36.046222 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043472    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043475    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043478    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043481    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043485    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043488    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043491    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043494    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043496    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043499    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043502    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043505    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043508    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043510    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043513    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043516    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043518    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043521    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043523    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043526    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043907    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:36.046693 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043912    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043916    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043918    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043921    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043923    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043926    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043929    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043931    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043934    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043937    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043939    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043942    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043944    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043947    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043950    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043953    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043956    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043958    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043961    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043964    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:36.047193 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043966    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043969    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043972    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043974    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043976    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043979    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043981    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043983    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043986    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043989    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043991    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043994    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043996    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.043999    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044001    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044003    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044006    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044008    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044011    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044013    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:36.047688 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044016    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044019    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044021    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044024    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044026    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044029    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044031    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044034    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044037    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044041    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044046    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044049    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044052    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044055    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044058    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044062    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044065    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044068    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044070    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:36.048169 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044073    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044075    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044077    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044080    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044082    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044085    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044087    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044090    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044092    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044095    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044097    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044100    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044102    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044105    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044107    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044110    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044112    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044114    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044117    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044120    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:36.048649 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044122    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044125    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044128    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044130    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044132    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044135    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044137    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044140    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044144    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044148    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044151    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044154    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044156    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044159    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044162    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044165    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044168    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044171    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044174    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044259    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 09:54:36.049137 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044266    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044273    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044277    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044281    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044285    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044289    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044293    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044296    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044299    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044302    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044306    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044309    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044313    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044315    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044319    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044322    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044325    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044331    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044333    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044337    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044340    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044343    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044348    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 09:54:36.049666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044351    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044354    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044357    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044360    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044363    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044366    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044369    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044372    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044376    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044379    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044382    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044384    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044387    2567 flags.go:64] FLAG: --enable-server="true"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044390    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044394    2567 flags.go:64] FLAG: --event-burst="100"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044397    2567 flags.go:64] FLAG: --event-qps="50"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044400    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044403    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044406    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044410    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044417    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044420    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044423    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044426    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044429    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 09:54:36.050218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044432    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044435    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044438    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044441    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044443    2567 flags.go:64] FLAG: --feature-gates=""
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044449    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044452    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044455    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044458    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044462    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044465    2567 flags.go:64] FLAG: --help="false"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044468    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044471    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044474    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044477    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044480    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044483    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044486    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044489    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044491    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044494    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044497    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044500    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044503    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 23 09:54:36.050879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044505    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044508    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044511    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044515    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044518    2567 flags.go:64] FLAG: --lock-file=""
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044521    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044523    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044527    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044532    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044535    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044538    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044540    2567 flags.go:64] FLAG: --logging-format="text"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044543    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044548    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044550    2567 flags.go:64] FLAG: --manifest-url=""
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044553    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044557    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044560    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044564    2567 flags.go:64] FLAG: --max-pods="110"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044567    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044570    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044572    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044575    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044578    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044581    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 09:54:36.051512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044584    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044593    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044596    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044599    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044602    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044605    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044610    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044612    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044615    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044618    2567 flags.go:64] FLAG: --port="10250"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044621    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044626    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cee30745d6236ad5"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044629    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044632    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044635    2567 flags.go:64] FLAG: --register-node="true"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044637    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044641    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044644    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044647    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044650    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044654    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044657    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044660    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044663    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044666    2567 flags.go:64] FLAG: --runonce="false"
Jul 23 09:54:36.052153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044668    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044671    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044674    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044677    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044680    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044682    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044685    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044688    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044691    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044694    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044697    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044700    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044703    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044706    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044709    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044714    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044717    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044719    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044724    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044727    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044730    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044732    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044735    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044738    2567 flags.go:64] FLAG: --v="2"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044743    2567 flags.go:64] FLAG: --version="false"
Jul 23 09:54:36.052991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044747    2567 flags.go:64] FLAG: --vmodule=""
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044750    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.044755    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044866    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044869    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044872    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044876    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044878    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044881    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044885    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044888    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044891    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044894    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044897    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044899    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044902    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044905    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044907    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044910    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:36.053865 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044912    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044914    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044917    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044919    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044922    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044924    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044927    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044929    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044932    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044934    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044937    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044940    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044942    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044945    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044948    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044951    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044954    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044958    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044961    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:36.054355 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044964    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044966    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044969    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044971    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044974    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044976    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044979    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044981    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044984    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044986    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044988    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044991    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044994    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044996    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.044999    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045001    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045003    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045006    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045008    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045011    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:36.054815 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045013    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045015    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045018    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045020    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045023    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045025    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045028    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045033    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045037    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045039    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045041    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045044    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045046    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045048    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045051    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045053    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045056    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045058    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045061    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045064    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:36.055315 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045068    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045070    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045073    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045076    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045079    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045081    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045083    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045086    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045088    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045091    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045093    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045096    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045098    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045101    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045103    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045105    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045108    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045110    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045113    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045115    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:36.055798 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045119    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045122    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045124    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.045126    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.045747    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.054298    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.054315    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.054329    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.054335    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054392    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054397    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054400    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054403    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054407    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054410    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:36.056300 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054413    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054415    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054418    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054421    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054423    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054426    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054429    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054431    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054434    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054437    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054440    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054442    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054445    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054447    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054451    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054453    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054456    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054460    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054463    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054466    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:36.056664 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054469    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054472    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054475    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054478    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054481    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054483    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054486    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054489    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054491    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054494    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054497    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054499    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054502    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054505    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054507    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054510    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054514    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054517    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054520    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:36.057165 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054522    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054525    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054527    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054530    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054532    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054534    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054537    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054540    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054543    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054547    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054551    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054554    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054557    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054560    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054562    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054565    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054568    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054571    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054573    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:36.057655 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054576    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054578    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054581    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054584    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054586    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054588    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054591    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054593    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054596    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054599    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054601    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054604    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054606    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054609    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054611    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054614    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054617    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054620    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054622    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054624    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:36.058126 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054627    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054630    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054632    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054635    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054637    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054640    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054642    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054645    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054647    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054650    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054653    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054655    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054658    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054660    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054663    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:36.058689 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.054668    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054779    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054784    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054786    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054789    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054792    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054795    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054798    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054801    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054803    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054806    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054808    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054811    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054815    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054819    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054822    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054825    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054828    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054831    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:36.059060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054833    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054836    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054839    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054841    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054844    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054846    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054849    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054852    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054855    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054857    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054859    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054862    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054864    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054867    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054869    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054871    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054874    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054876    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054879    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054881    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:36.059538 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054884    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054886    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054889    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054891    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054894    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054896    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054899    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054902    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054904    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054907    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054910    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054912    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054915    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054918    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054939    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054943    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054946    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054949    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054952    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054955    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:36.060016 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054957    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054960    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054963    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054966    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054968    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054971    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054974    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054976    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054978    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054981    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054983    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054986    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054988    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054991    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054993    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054996    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.054998    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055000    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055003    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055005    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:36.060496 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055008    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055012    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055015    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055019    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055021    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055024    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055027    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055030    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055034    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055037    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055039    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055042    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055045    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055047    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055050    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055052    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055054    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055057    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055059    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:36.060987 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055062    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:36.061467 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:36.055064    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:36.061467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.055069    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 09:54:36.061467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.055183    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 09:54:36.061467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.057227    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 09:54:36.061467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.058813    2567 server.go:1019] "Starting client certificate rotation"
Jul 23 09:54:36.061467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.058913    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 09:54:36.061467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.058948    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 09:54:36.061657 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.061531    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 09:54:36.062688 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.062670    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 09:54:36.076557 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.076537    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 23 09:54:36.078761 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.078745    2567 log.go:25] "Validated CRI v1 image API"
Jul 23 09:54:36.079557 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.079536    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 09:54:36.083952 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.083926    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8919c137-bff5-4ca7-8615-a690cf33b24b:/dev/nvme0n1p3 8ef9181c-991c-40c4-875e-0f212bcde948:/dev/nvme0n1p4]
Jul 23 09:54:36.084029 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.083950    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 09:54:36.090621 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.090493    2567 manager.go:216] Machine: {Timestamp:2026-07-23 09:54:36.089084209 +0000 UTC m=+0.327279453 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094101 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2086f916acb9583fd9afe6ee35af4d SystemUUID:ec2086f9-16ac-b958-3fd9-afe6ee35af4d BootID:a80b5af4-2f19-47a7-a03e-3af51d90cc7c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:68:ae:85:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:68:ae:85:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:49:d8:aa:27:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 09:54:36.090621 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.090613    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 09:54:36.090741 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.090699    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 09:54:36.091468 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.091454    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 09:54:36.092612 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.092590    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 09:54:36.092776 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.092627    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 09:54:36.093502 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.093490    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 09:54:36.093545 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.093504    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 09:54:36.093545 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.093512    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 09:54:36.094390 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.094378    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 09:54:36.095681 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.095672    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 09:54:36.098957 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.098945    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 09:54:36.099111 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.099102    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 09:54:36.099140 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.099128    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 09:54:36.099174 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.099149    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 09:54:36.099174 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.099172    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 09:54:36.099230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.099183    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 23 09:54:36.099230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.099193    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 09:54:36.099649 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.099633    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 09:54:36.099708 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.099656    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 09:54:36.104128 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.104103    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 09:54:36.106201 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.106187    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 09:54:36.106264 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.106219    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 09:54:36.107351 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107340    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107356    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107362    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107368    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107379    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107385    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107394    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107399    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107405    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107410    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107418    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 09:54:36.107419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.107423    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 09:54:36.108205 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.108195    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 09:54:36.108205 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.108205    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 09:54:36.111701 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.111689    2567 server.go:1268] "Started kubelet"
Jul 23 09:54:36.111815 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.111762    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 09:54:36.111921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.111833    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 09:54:36.111921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.111836    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 09:54:36.112163 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.112141    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-125.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 09:54:36.112280 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.112249    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 09:54:36.112363 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.112332    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 09:54:36.112677 ip-10-0-141-125 systemd[1]: Started Kubernetes Kubelet.
Jul 23 09:54:36.114660 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.114641    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 09:54:36.116447 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.116429    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 09:54:36.117727 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.117709    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 09:54:36.118360 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.117415    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-125.ec2.internal.18c4e293a5956ee5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-125.ec2.internal,UID:ip-10-0-141-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-125.ec2.internal,},FirstTimestamp:2026-07-23 09:54:36.111662821 +0000 UTC m=+0.349858063,LastTimestamp:2026-07-23 09:54:36.111662821 +0000 UTC m=+0.349858063,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-125.ec2.internal,}"
Jul 23 09:54:36.122606 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.122591    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 09:54:36.122676 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.122607    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 09:54:36.122786 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.122759    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.123500 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123471    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 09:54:36.123500 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123489    2567 factory.go:55] Registering systemd factory
Jul 23 09:54:36.123500 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123499    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 23 09:54:36.123694 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123509    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 09:54:36.123694 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123517    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 09:54:36.123694 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123524    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 09:54:36.123694 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123590    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 09:54:36.123694 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123598    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 09:54:36.123853 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123753    2567 factory.go:153] Registering CRI-O factory
Jul 23 09:54:36.123853 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123766    2567 factory.go:223] Registration of the crio container factory successfully
Jul 23 09:54:36.123853 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123789    2567 factory.go:103] Registering Raw factory
Jul 23 09:54:36.123853 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.123802    2567 manager.go:1196] Started watching for new ooms in manager
Jul 23 09:54:36.124317 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.124302    2567 manager.go:349] Starting recovery of all containers
Jul 23 09:54:36.124489 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.124471    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 09:54:36.124618 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.124602    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 09:54:36.132904 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.132873    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cds46"
Jul 23 09:54:36.136097 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.136080    2567 manager.go:354] Recovery completed
Jul 23 09:54:36.139802 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.139786    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cds46"
Jul 23 09:54:36.140556 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.140457    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:36.142648 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.142632    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:36.142713 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.142662    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:36.142713 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.142673    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:36.143181 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.143167    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 09:54:36.143181 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.143180    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 09:54:36.143270 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.143195    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 09:54:36.143270 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.143179    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:36.143897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.143880    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:36.143976 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.143910    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:36.143976 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.143924    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:36.144352 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.144340    2567 policy_none.go:49] "None policy: Start"
Jul 23 09:54:36.144397 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.144361    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 09:54:36.144397 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.144373    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 09:54:36.145467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.145454    2567 policy_none.go:47] "Start"
Jul 23 09:54:36.198839 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.198821    2567 manager.go:337] "Starting Device Plugin manager"
Jul 23 09:54:36.198955 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.198857    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 09:54:36.198955 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.198869    2567 server.go:87] "Starting device plugin registration server"
Jul 23 09:54:36.199161 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.199148    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 09:54:36.199211 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.199167    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 09:54:36.199296 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.199279    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 09:54:36.199376 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.199360    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 09:54:36.199376 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.199372    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 09:54:36.199941 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.199923    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 09:54:36.200018 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.199979    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.223510 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.223476    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 09:54:36.224788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.224769    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 09:54:36.224896 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.224808    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 09:54:36.224896 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.224838    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 09:54:36.224896 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.224875    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 09:54:36.226425 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.226409    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:36.299951 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.299888    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:36.300994 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.300970    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:36.301082 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.301007    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:36.301082 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.301019    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:36.301082 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.301040    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.310766 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.310748    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.310840 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.310771    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-125.ec2.internal\": node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.324960 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.324934    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"]
Jul 23 09:54:36.325042 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.325001    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:36.325769 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.325756    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:36.325819 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.325782    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:36.325819 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.325792    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:36.327336 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.327324    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:36.327457 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.327444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.327493 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.327476    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:36.328079 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.328052    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:36.328148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.328089    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:36.328148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.328105    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:36.328148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.328042    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:36.328307 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.328160    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:36.328307 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.328175    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:36.329520 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.329504    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.329616 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.329533    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:36.330316 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.330302    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:36.330405 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.330331    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:36.330405 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.330344    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:36.345788 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.345769    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-125.ec2.internal\" not found" node="ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.349430 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.349414    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-125.ec2.internal\" not found" node="ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.371469 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.371446    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.424888 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.424858    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1406054fb757eff60c2c19d545c7c3fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"1406054fb757eff60c2c19d545c7c3fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.425000 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.424891    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1406054fb757eff60c2c19d545c7c3fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"1406054fb757eff60c2c19d545c7c3fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.425000 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.424915    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bc2b0ba399541b1dd777c069fca6d48-config\") pod \"kube-apiserver-proxy-ip-10-0-141-125.ec2.internal\" (UID: \"3bc2b0ba399541b1dd777c069fca6d48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.471775 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.471749    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.525119 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.525091    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1406054fb757eff60c2c19d545c7c3fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"1406054fb757eff60c2c19d545c7c3fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.525213 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.525132    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bc2b0ba399541b1dd777c069fca6d48-config\") pod \"kube-apiserver-proxy-ip-10-0-141-125.ec2.internal\" (UID: \"3bc2b0ba399541b1dd777c069fca6d48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.525213 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.525153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1406054fb757eff60c2c19d545c7c3fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"1406054fb757eff60c2c19d545c7c3fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.525213 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.525103    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1406054fb757eff60c2c19d545c7c3fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"1406054fb757eff60c2c19d545c7c3fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.525213 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.525192    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bc2b0ba399541b1dd777c069fca6d48-config\") pod \"kube-apiserver-proxy-ip-10-0-141-125.ec2.internal\" (UID: \"3bc2b0ba399541b1dd777c069fca6d48\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.525213 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.525176    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1406054fb757eff60c2c19d545c7c3fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal\" (UID: \"1406054fb757eff60c2c19d545c7c3fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.572428 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.572354    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.648998 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.648974    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.652911 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:36.652894    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:36.673080 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.673052    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.773627 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.773576    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.874073 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.873988    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:36.974583 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:36.974543    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:37.058018 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.057989    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 09:54:37.058493 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.058118    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 09:54:37.075299 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:37.075276    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:37.144391 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.144317    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 09:49:36 +0000 UTC" deadline="2028-02-04 03:19:10.847247344 +0000 UTC"
Jul 23 09:54:37.144391 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.144355    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13457h24m33.702896542s"
Jul 23 09:54:37.161494 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.161468    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:37.175768 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:37.175738    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:37.276567 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:37.276545    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:37.280829 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:37.280782    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc2b0ba399541b1dd777c069fca6d48.slice/crio-df931a725118c6501076de1dc20d6707125e4fc894a1978011f9e526d58f5371 WatchSource:0}: Error finding container df931a725118c6501076de1dc20d6707125e4fc894a1978011f9e526d58f5371: Status 404 returned error can't find the container with id df931a725118c6501076de1dc20d6707125e4fc894a1978011f9e526d58f5371
Jul 23 09:54:37.281078 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:37.281058    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1406054fb757eff60c2c19d545c7c3fa.slice/crio-b4e760c4c779dade5b9a6547ee73d8c6b3eb580b6f55efb43bb795a4251c41a6 WatchSource:0}: Error finding container b4e760c4c779dade5b9a6547ee73d8c6b3eb580b6f55efb43bb795a4251c41a6: Status 404 returned error can't find the container with id b4e760c4c779dade5b9a6547ee73d8c6b3eb580b6f55efb43bb795a4251c41a6
Jul 23 09:54:37.286016 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.286000    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 09:54:37.376939 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:37.376905    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:37.437125 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.437045    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:37.477214 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:37.477182    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-125.ec2.internal\" not found"
Jul 23 09:54:37.542292 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.542271    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:37.623817 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.623787    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:37.633842 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.633821    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 09:54:37.634811 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.634796    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal"
Jul 23 09:54:37.646709 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:37.646696    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 09:54:38.101503 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.101425    2567 apiserver.go:52] "Watching apiserver"
Jul 23 09:54:38.111542 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.111348    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 09:54:38.111804 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.111771    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-csr99","kube-system/global-pull-secret-syncer-469fj","kube-system/konnectivity-agent-gw6j9","kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw","openshift-dns/node-resolver-xtvrq","openshift-image-registry/node-ca-g8pml","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal","openshift-multus/multus-pdwkl","openshift-cluster-node-tuning-operator/tuned-lb9gk","openshift-multus/multus-additional-cni-plugins-5bzr5","openshift-multus/network-metrics-daemon-bsrb2","openshift-network-diagnostics/network-check-target-d9tj9","openshift-network-operator/iptables-alerter-bl7rt"]
Jul 23 09:54:38.113663 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.113637    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.115816 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.115796    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.116866 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.116843    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fgkx9\""
Jul 23 09:54:38.116967 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.116902    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 09:54:38.117032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.116852    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:54:38.117198 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.117181    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.118418 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.118396    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.118668 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.118650    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 09:54:38.118922 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.118903    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gl2rf\""
Jul 23 09:54:38.119008 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.118953    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 09:54:38.120069 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.119795    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:38.120069 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.119874    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:38.121411 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121046    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 09:54:38.121411 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121125    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rshdf\""
Jul 23 09:54:38.121411 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121253    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 09:54:38.121411 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121330    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 09:54:38.121663 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121409    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 09:54:38.121663 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121505    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 09:54:38.121663 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121607    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 09:54:38.121812 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121682    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jcsmx\""
Jul 23 09:54:38.121812 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121719    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 09:54:38.121812 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121722    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 09:54:38.121974 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.121858    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.122028 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.122015    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 09:54:38.122222 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.122184    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 09:54:38.123827 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.122740    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.123827 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.123656    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 09:54:38.124672 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.124657    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.124788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.124711    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 09:54:38.124788 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.124718    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:38.124788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.124754    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 09:54:38.124957 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.124836    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q7zm8\""
Jul 23 09:54:38.125534 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.125512    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 09:54:38.125638 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.125513    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t96tt\""
Jul 23 09:54:38.125915 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.125897    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 09:54:38.125996 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.125922    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 09:54:38.126111 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.126091    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 09:54:38.126464 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.126442    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:38.132515 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132485    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcvbc\" (UniqueName: \"kubernetes.io/projected/85f81663-64c2-403d-a0df-8fd7d97a29e7-kube-api-access-lcvbc\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.132622 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-var-lib-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.132622 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132577    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysconfig\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.132754 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-lib-modules\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.132754 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-cnibin\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.132754 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132688    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-etc-kubernetes\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.132754 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132699    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.132754 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132724    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-device-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.133010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.133010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-node-log\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.133010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovn-node-metrics-cert\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.133010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7l7v\" (UniqueName: \"kubernetes.io/projected/e7bdd090-55e9-44f4-b09f-17021a14f169-kube-api-access-v7l7v\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.133010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzkh\" (UniqueName: \"kubernetes.io/projected/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-kube-api-access-gzzkh\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.133010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5sqb\" (UniqueName: \"kubernetes.io/projected/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-kube-api-access-g5sqb\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.133010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovnkube-script-lib\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.133010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.132991    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-socket-dir-parent\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.133463 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133023    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0c4c42f-793a-46be-902d-2f685e945253-cni-binary-copy\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.133463 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133054    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.133463 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovnkube-config\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.133463 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133128    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.133663 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133524    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 09:54:38.133735 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133713    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:38.133827 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.133805    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:38.133880 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjldl\" (UniqueName: \"kubernetes.io/projected/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-kube-api-access-mjldl\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.133880 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133866    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-tuned\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.133980 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133901    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-host\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.133980 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-serviceca\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.133980 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133963    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1946fb9c-00aa-446d-be1e-cecb14f56b61-dbus\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.134119 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.133996    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-cni-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.134119 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.134023    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-env-overrides\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.134210 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.134080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-modprobe-d\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.135254 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysctl-conf\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.135382 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-systemd\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.135448 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-host\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.135524 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135452    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-conf-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.135606 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135547    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr9wz\" (UniqueName: \"kubernetes.io/projected/d0c4c42f-793a-46be-902d-2f685e945253-kube-api-access-wr9wz\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.135606 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135599    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-socket-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.135699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135631    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-system-cni-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.135734 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135718    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 09:54:38.135770 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135719    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-cni-netd\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.135770 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-multus-certs\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.135846 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135794    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-netns\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.135894 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135877    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-cni-multus\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.135941 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135925    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:54:38.135941 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135940    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0c4c42f-793a-46be-902d-2f685e945253-multus-daemon-config\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.136034 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.135967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-registration-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.136034 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.136104 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136035    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7bdd090-55e9-44f4-b09f-17021a14f169-hosts-file\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.136104 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136066    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-var-lib-kubelet\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.136104 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1946fb9c-00aa-446d-be1e-cecb14f56b61-kubelet-config\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.136233 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136126    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:38.136233 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136167    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-systemd-units\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.136344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-slash\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.136401 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136363    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-log-socket\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.136459 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-sys\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.136517 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-kubelet\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.136569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-systemd\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.136671 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-run\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.136736 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.136736 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-run-netns\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.136843 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136755    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-cni-bin\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.136843 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136800    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 09:54:38.136942 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-kubernetes\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.136942 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136880    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.136942 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136911    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 09:54:38.136942 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.136914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-k8s-cni-cncf-io\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.137079 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-cni-bin\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.137079 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.137156 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-sys-fs\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.137156 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-kubelet\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.137156 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-etc-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.137311 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7bdd090-55e9-44f4-b09f-17021a14f169-tmp-dir\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.137311 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-tmp\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.137311 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-ovn\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.137311 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137256    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysctl-d\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.137529 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137409    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r68nk\""
Jul 23 09:54:38.137529 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-os-release\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.137529 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137455    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2hpvn\""
Jul 23 09:54:38.137529 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-hostroot\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.137823 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137583    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 09:54:38.137823 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137731    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 09:54:38.137823 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.137812    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7pvrs\""
Jul 23 09:54:38.141075 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.141051    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 09:54:38.157289 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.157212    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s9g2t"
Jul 23 09:54:38.162376 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.162195    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:38.165179 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.164812    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s9g2t"
Jul 23 09:54:38.224752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.224722    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 09:54:38.232595 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.232486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" event={"ID":"1406054fb757eff60c2c19d545c7c3fa","Type":"ContainerStarted","Data":"b4e760c4c779dade5b9a6547ee73d8c6b3eb580b6f55efb43bb795a4251c41a6"}
Jul 23 09:54:38.234852 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.234772    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal" event={"ID":"3bc2b0ba399541b1dd777c069fca6d48","Type":"ContainerStarted","Data":"df931a725118c6501076de1dc20d6707125e4fc894a1978011f9e526d58f5371"}
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-k8s-cni-cncf-io\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-cni-bin\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238418    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89j5w\" (UniqueName: \"kubernetes.io/projected/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-kube-api-access-89j5w\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-sys-fs\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-kubelet\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-etc-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238516    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7bdd090-55e9-44f4-b09f-17021a14f169-tmp-dir\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-tmp\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-ovn\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysctl-d\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-os-release\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238607    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-hostroot\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238628    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-cnibin\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238651    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70e6ed9a-bb72-4b99-845d-ec3e0978361a-iptables-alerter-script\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.240344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcvbc\" (UniqueName: \"kubernetes.io/projected/85f81663-64c2-403d-a0df-8fd7d97a29e7-kube-api-access-lcvbc\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-var-lib-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238711    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysconfig\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-lib-modules\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-cnibin\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-etc-kubernetes\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12ded5c6-48c0-41af-ab5a-6235eba9d5e9-konnectivity-ca\") pod \"konnectivity-agent-gw6j9\" (UID: \"12ded5c6-48c0-41af-ab5a-6235eba9d5e9\") " pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238804    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70e6ed9a-bb72-4b99-845d-ec3e0978361a-host-slash\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-device-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-node-log\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovn-node-metrics-cert\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238914    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7l7v\" (UniqueName: \"kubernetes.io/projected/e7bdd090-55e9-44f4-b09f-17021a14f169-kube-api-access-v7l7v\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzkh\" (UniqueName: \"kubernetes.io/projected/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-kube-api-access-gzzkh\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238951    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5sqb\" (UniqueName: \"kubernetes.io/projected/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-kube-api-access-g5sqb\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238967    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovnkube-script-lib\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.238993    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-socket-dir-parent\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.241267 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-os-release\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239046    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkf2g\" (UniqueName: \"kubernetes.io/projected/350c77c7-2f2a-4516-943b-446441017528-kube-api-access-lkf2g\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2df9\" (UniqueName: \"kubernetes.io/projected/70e6ed9a-bb72-4b99-845d-ec3e0978361a-kube-api-access-t2df9\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0c4c42f-793a-46be-902d-2f685e945253-cni-binary-copy\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239121    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovnkube-config\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjldl\" (UniqueName: \"kubernetes.io/projected/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-kube-api-access-mjldl\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-tuned\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-host\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239207    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-serviceca\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239232    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1946fb9c-00aa-446d-be1e-cecb14f56b61-dbus\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-cni-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239264    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-env-overrides\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239281    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-modprobe-d\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239303    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysctl-conf\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-systemd\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.242157 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239406    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-host\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-conf-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysctl-conf\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr9wz\" (UniqueName: \"kubernetes.io/projected/d0c4c42f-793a-46be-902d-2f685e945253-kube-api-access-wr9wz\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239500    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-device-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-socket-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239530    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-system-cni-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239563    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-cni-netd\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-multus-certs\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239597    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-system-cni-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239602    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-netns\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239621    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-netns\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239650    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-node-log\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-cni-bin\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.240062    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.240439    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-socket-dir-parent\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.240845    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.243032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.240918    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-sys-fs\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.240933    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0c4c42f-793a-46be-902d-2f685e945253-cni-binary-copy\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.240964    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-kubelet\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.241003    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-etc-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.241019    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.241301    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7bdd090-55e9-44f4-b09f-17021a14f169-tmp-dir\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.241659    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovnkube-config\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.241970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-os-release\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.241970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovnkube-script-lib\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-ovn\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-modprobe-d\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242112    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-cni-netd\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysctl-d\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242175    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-host\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242190    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-hostroot\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242291    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1946fb9c-00aa-446d-be1e-cecb14f56b61-dbus\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.239646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-cni-multus\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0c4c42f-793a-46be-902d-2f685e945253-multus-daemon-config\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.243940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242435    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-registration-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-system-cni-dir\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242465    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-var-lib-openvswitch\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7bdd090-55e9-44f4-b09f-17021a14f169-hosts-file\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-sysconfig\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242548    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-var-lib-kubelet\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242574    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1946fb9c-00aa-446d-be1e-cecb14f56b61-kubelet-config\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242623    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-lib-modules\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-systemd-units\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-slash\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-env-overrides\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-cnibin\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-log-socket\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.244830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-sys\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-conf-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-kubelet\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242783    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12ded5c6-48c0-41af-ab5a-6235eba9d5e9-agent-certs\") pod \"konnectivity-agent-gw6j9\" (UID: \"12ded5c6-48c0-41af-ab5a-6235eba9d5e9\") " pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242784    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-multus-cni-dir\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-systemd\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-systemd\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242858    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-run-systemd\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242870    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-host\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242929    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-registration-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243029    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e7bdd090-55e9-44f4-b09f-17021a14f169-hosts-file\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243073    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-var-lib-kubelet\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1946fb9c-00aa-446d-be1e-cecb14f56b61-kubelet-config\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243188    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-serviceca\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243192    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-log-socket\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243246    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-run\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.245699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-run-netns\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243375    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d0c4c42f-793a-46be-902d-2f685e945253-multus-daemon-config\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-cni-bin\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-kubernetes\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243423    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-cni-bin\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243440    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-slash\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243485    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-run\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243537    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243546    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85f81663-64c2-403d-a0df-8fd7d97a29e7-socket-dir\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-sys\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.243595    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243644    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-host-run-netns\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.243668    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret podName:1946fb9c-00aa-446d-be1e-cecb14f56b61 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:38.743643765 +0000 UTC m=+2.981839016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret") pod "global-pull-secret-syncer-469fj" (UID: "1946fb9c-00aa-446d-be1e-cecb14f56b61") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243708    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-kubelet\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-var-lib-cni-multus\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.246727 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.242783    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-etc-kubernetes\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.247607 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-kubernetes\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.247607 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243806    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-systemd-units\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.247607 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243805    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-multus-certs\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.247607 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.243860    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d0c4c42f-793a-46be-902d-2f685e945253-host-run-k8s-cni-cncf-io\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.247607 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.245313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-ovn-node-metrics-cert\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.247607 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.246719    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-tmp\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.247607 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.247028    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-etc-tuned\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.250541 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.250521    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:38.250541 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.250544    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:38.250722 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.250557    2567 projected.go:196] Error preparing data for projected volume kube-api-access-mlnjc for pod openshift-network-diagnostics/network-check-target-d9tj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:38.250722 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.250610    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc podName:e4021391-ecd4-41d7-b920-0bfc4e53f1f3 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:38.75059684 +0000 UTC m=+2.988792088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnjc" (UniqueName: "kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc") pod "network-check-target-d9tj9" (UID: "e4021391-ecd4-41d7-b920-0bfc4e53f1f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:38.253651 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.253609    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjldl\" (UniqueName: \"kubernetes.io/projected/798ba73a-0c82-45c4-9536-2bd4ae09b7b7-kube-api-access-mjldl\") pod \"ovnkube-node-csr99\" (UID: \"798ba73a-0c82-45c4-9536-2bd4ae09b7b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.254355 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.254292    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcvbc\" (UniqueName: \"kubernetes.io/projected/85f81663-64c2-403d-a0df-8fd7d97a29e7-kube-api-access-lcvbc\") pod \"aws-ebs-csi-driver-node-p2dcw\" (UID: \"85f81663-64c2-403d-a0df-8fd7d97a29e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.254985 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.254961    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7l7v\" (UniqueName: \"kubernetes.io/projected/e7bdd090-55e9-44f4-b09f-17021a14f169-kube-api-access-v7l7v\") pod \"node-resolver-xtvrq\" (UID: \"e7bdd090-55e9-44f4-b09f-17021a14f169\") " pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.256504 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.256398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr9wz\" (UniqueName: \"kubernetes.io/projected/d0c4c42f-793a-46be-902d-2f685e945253-kube-api-access-wr9wz\") pod \"multus-pdwkl\" (UID: \"d0c4c42f-793a-46be-902d-2f685e945253\") " pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.258485 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.258404    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5sqb\" (UniqueName: \"kubernetes.io/projected/90f3e1db-0b1f-497a-af08-c6d7587c7c8b-kube-api-access-g5sqb\") pod \"node-ca-g8pml\" (UID: \"90f3e1db-0b1f-497a-af08-c6d7587c7c8b\") " pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.258585 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.258488    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzkh\" (UniqueName: \"kubernetes.io/projected/55e5a925-bf2c-45a0-a0e5-8fc090f578e0-kube-api-access-gzzkh\") pod \"tuned-lb9gk\" (UID: \"55e5a925-bf2c-45a0-a0e5-8fc090f578e0\") " pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.343982 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.343942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.344180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.343995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-system-cni-dir\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.344180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.344180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344077    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12ded5c6-48c0-41af-ab5a-6235eba9d5e9-agent-certs\") pod \"konnectivity-agent-gw6j9\" (UID: \"12ded5c6-48c0-41af-ab5a-6235eba9d5e9\") " pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:38.344180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.344180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344142    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:38.344180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89j5w\" (UniqueName: \"kubernetes.io/projected/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-kube-api-access-89j5w\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:38.344550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-cnibin\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.344550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344223    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70e6ed9a-bb72-4b99-845d-ec3e0978361a-iptables-alerter-script\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.344550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344253    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12ded5c6-48c0-41af-ab5a-6235eba9d5e9-konnectivity-ca\") pod \"konnectivity-agent-gw6j9\" (UID: \"12ded5c6-48c0-41af-ab5a-6235eba9d5e9\") " pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:38.344550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70e6ed9a-bb72-4b99-845d-ec3e0978361a-host-slash\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.344550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-os-release\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.344550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.344550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkf2g\" (UniqueName: \"kubernetes.io/projected/350c77c7-2f2a-4516-943b-446441017528-kube-api-access-lkf2g\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.344550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.344403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2df9\" (UniqueName: \"kubernetes.io/projected/70e6ed9a-bb72-4b99-845d-ec3e0978361a-kube-api-access-t2df9\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.345181 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.345155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.345297 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.345214    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-system-cni-dir\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.345671 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.345647    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.346685 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.346088    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-os-release\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.346685 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.346126    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70e6ed9a-bb72-4b99-845d-ec3e0978361a-host-slash\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.346685 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.346201    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:38.346685 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.346244    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs podName:87e4cb8a-8ecb-4829-b778-dc8fc8d75d41 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:38.846230984 +0000 UTC m=+3.084426216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs") pod "network-metrics-daemon-bsrb2" (UID: "87e4cb8a-8ecb-4829-b778-dc8fc8d75d41") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:38.346685 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.346573    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70e6ed9a-bb72-4b99-845d-ec3e0978361a-iptables-alerter-script\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.346685 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.346646    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.346685 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.346651    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/350c77c7-2f2a-4516-943b-446441017528-cnibin\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.347131 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.346722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/350c77c7-2f2a-4516-943b-446441017528-cni-binary-copy\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.347429 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.347404    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/12ded5c6-48c0-41af-ab5a-6235eba9d5e9-konnectivity-ca\") pod \"konnectivity-agent-gw6j9\" (UID: \"12ded5c6-48c0-41af-ab5a-6235eba9d5e9\") " pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:38.349273 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.349250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/12ded5c6-48c0-41af-ab5a-6235eba9d5e9-agent-certs\") pod \"konnectivity-agent-gw6j9\" (UID: \"12ded5c6-48c0-41af-ab5a-6235eba9d5e9\") " pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:38.358118 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.358047    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89j5w\" (UniqueName: \"kubernetes.io/projected/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-kube-api-access-89j5w\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:38.358521 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.358496    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2df9\" (UniqueName: \"kubernetes.io/projected/70e6ed9a-bb72-4b99-845d-ec3e0978361a-kube-api-access-t2df9\") pod \"iptables-alerter-bl7rt\" (UID: \"70e6ed9a-bb72-4b99-845d-ec3e0978361a\") " pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.359351 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.359316    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkf2g\" (UniqueName: \"kubernetes.io/projected/350c77c7-2f2a-4516-943b-446441017528-kube-api-access-lkf2g\") pod \"multus-additional-cni-plugins-5bzr5\" (UID: \"350c77c7-2f2a-4516-943b-446441017528\") " pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.437901 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.437868    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lb9gk"
Jul 23 09:54:38.446423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.446393    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw"
Jul 23 09:54:38.457697 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.457672    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:54:38.464788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.464769    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g8pml"
Jul 23 09:54:38.474782 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.474756    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xtvrq"
Jul 23 09:54:38.481805 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.481787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pdwkl"
Jul 23 09:54:38.492606 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.492583    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:38.498689 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.498673    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bl7rt"
Jul 23 09:54:38.504804 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.504785    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5bzr5"
Jul 23 09:54:38.747964 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.747867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:38.748127 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.748016    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:38.748127 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.748090    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret podName:1946fb9c-00aa-446d-be1e-cecb14f56b61 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:39.748066989 +0000 UTC m=+3.986262225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret") pod "global-pull-secret-syncer-469fj" (UID: "1946fb9c-00aa-446d-be1e-cecb14f56b61") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:38.848875 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.848831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:38.849063 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:38.848915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:38.849063 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.849030    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:38.849063 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.849040    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:38.849230 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.849071    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:38.849230 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.849088    2567 projected.go:196] Error preparing data for projected volume kube-api-access-mlnjc for pod openshift-network-diagnostics/network-check-target-d9tj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:38.849230 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.849097    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs podName:87e4cb8a-8ecb-4829-b778-dc8fc8d75d41 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:39.849077959 +0000 UTC m=+4.087273193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs") pod "network-metrics-daemon-bsrb2" (UID: "87e4cb8a-8ecb-4829-b778-dc8fc8d75d41") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:38.849230 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:38.849145    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc podName:e4021391-ecd4-41d7-b920-0bfc4e53f1f3 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:39.849126842 +0000 UTC m=+4.087322102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnjc" (UniqueName: "kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc") pod "network-check-target-d9tj9" (UID: "e4021391-ecd4-41d7-b920-0bfc4e53f1f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:39.167955 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:39.167852    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 09:49:38 +0000 UTC" deadline="2028-01-06 18:02:31.959349053 +0000 UTC"
Jul 23 09:54:39.167955 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:39.167892    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12776h7m52.791461318s"
Jul 23 09:54:39.309268 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:39.309122    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e6ed9a_bb72_4b99_845d_ec3e0978361a.slice/crio-40792bff24c75faee60e94404b144234e54f9dce0d670c6251cfe132d3976aee WatchSource:0}: Error finding container 40792bff24c75faee60e94404b144234e54f9dce0d670c6251cfe132d3976aee: Status 404 returned error can't find the container with id 40792bff24c75faee60e94404b144234e54f9dce0d670c6251cfe132d3976aee
Jul 23 09:54:39.322549 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:39.322522    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bdd090_55e9_44f4_b09f_17021a14f169.slice/crio-d14fba38592b1150c5d5b04cc147ea44a9c4a098d447059575b37b6605587209 WatchSource:0}: Error finding container d14fba38592b1150c5d5b04cc147ea44a9c4a098d447059575b37b6605587209: Status 404 returned error can't find the container with id d14fba38592b1150c5d5b04cc147ea44a9c4a098d447059575b37b6605587209
Jul 23 09:54:39.324740 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:39.324708    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f3e1db_0b1f_497a_af08_c6d7587c7c8b.slice/crio-ba84dbff4a671dce757ee0571c3fc7d111bc3bccf3b887d77553cdf081e313b2 WatchSource:0}: Error finding container ba84dbff4a671dce757ee0571c3fc7d111bc3bccf3b887d77553cdf081e313b2: Status 404 returned error can't find the container with id ba84dbff4a671dce757ee0571c3fc7d111bc3bccf3b887d77553cdf081e313b2
Jul 23 09:54:39.325562 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:39.325542    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350c77c7_2f2a_4516_943b_446441017528.slice/crio-6b3c35c1b94180bf47ca86c351f492b2dd8167ea3cb1a06ac8722bb15b65678d WatchSource:0}: Error finding container 6b3c35c1b94180bf47ca86c351f492b2dd8167ea3cb1a06ac8722bb15b65678d: Status 404 returned error can't find the container with id 6b3c35c1b94180bf47ca86c351f492b2dd8167ea3cb1a06ac8722bb15b65678d
Jul 23 09:54:39.333176 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:39.333139    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798ba73a_0c82_45c4_9536_2bd4ae09b7b7.slice/crio-49fd6d55405d73e9cb3480f5954f30263665a1b2be854e44b288da549332a291 WatchSource:0}: Error finding container 49fd6d55405d73e9cb3480f5954f30263665a1b2be854e44b288da549332a291: Status 404 returned error can't find the container with id 49fd6d55405d73e9cb3480f5954f30263665a1b2be854e44b288da549332a291
Jul 23 09:54:39.336610 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:39.336586    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f81663_64c2_403d_a0df_8fd7d97a29e7.slice/crio-4a0013288f37aadfaf56820168573febcff659628ae335e18933decded1a07de WatchSource:0}: Error finding container 4a0013288f37aadfaf56820168573febcff659628ae335e18933decded1a07de: Status 404 returned error can't find the container with id 4a0013288f37aadfaf56820168573febcff659628ae335e18933decded1a07de
Jul 23 09:54:39.338434 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:54:39.338415    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ded5c6_48c0_41af_ab5a_6235eba9d5e9.slice/crio-37d85656e5a1ebe8abc85445d098a0ac6c3c14fe99f4df1202bae1c9dca7f152 WatchSource:0}: Error finding container 37d85656e5a1ebe8abc85445d098a0ac6c3c14fe99f4df1202bae1c9dca7f152: Status 404 returned error can't find the container with id 37d85656e5a1ebe8abc85445d098a0ac6c3c14fe99f4df1202bae1c9dca7f152
Jul 23 09:54:39.757928 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:39.757713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:39.758098 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:39.757863    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:39.758098 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:39.758002    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret podName:1946fb9c-00aa-446d-be1e-cecb14f56b61 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:41.757987803 +0000 UTC m=+5.996183039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret") pod "global-pull-secret-syncer-469fj" (UID: "1946fb9c-00aa-446d-be1e-cecb14f56b61") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:39.858778 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:39.858742    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:39.858946 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:39.858796    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:39.858946 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:39.858909    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:39.858946 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:39.858930    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:39.859063 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:39.858955    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:39.859063 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:39.858962    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs podName:87e4cb8a-8ecb-4829-b778-dc8fc8d75d41 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:41.858947648 +0000 UTC m=+6.097142879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs") pod "network-metrics-daemon-bsrb2" (UID: "87e4cb8a-8ecb-4829-b778-dc8fc8d75d41") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:39.859063 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:39.858968    2567 projected.go:196] Error preparing data for projected volume kube-api-access-mlnjc for pod openshift-network-diagnostics/network-check-target-d9tj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:39.859063 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:39.859013    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc podName:e4021391-ecd4-41d7-b920-0bfc4e53f1f3 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:41.858998629 +0000 UTC m=+6.097193861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnjc" (UniqueName: "kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc") pod "network-check-target-d9tj9" (UID: "e4021391-ecd4-41d7-b920-0bfc4e53f1f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:40.169208 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.169083    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 09:49:38 +0000 UTC" deadline="2028-01-23 23:00:31.261109162 +0000 UTC"
Jul 23 09:54:40.169208 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.169146    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13189h5m51.091967889s"
Jul 23 09:54:40.228761 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.228734    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:40.228934 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:40.228859    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:40.229005 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.228951    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:40.229064 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:40.229031    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:40.229127 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.229100    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:40.229212 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:40.229189    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:40.244528 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.244445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8pml" event={"ID":"90f3e1db-0b1f-497a-af08-c6d7587c7c8b","Type":"ContainerStarted","Data":"ba84dbff4a671dce757ee0571c3fc7d111bc3bccf3b887d77553cdf081e313b2"}
Jul 23 09:54:40.246761 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.246678    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xtvrq" event={"ID":"e7bdd090-55e9-44f4-b09f-17021a14f169","Type":"ContainerStarted","Data":"d14fba38592b1150c5d5b04cc147ea44a9c4a098d447059575b37b6605587209"}
Jul 23 09:54:40.251189 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.251113    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bl7rt" event={"ID":"70e6ed9a-bb72-4b99-845d-ec3e0978361a","Type":"ContainerStarted","Data":"40792bff24c75faee60e94404b144234e54f9dce0d670c6251cfe132d3976aee"}
Jul 23 09:54:40.256500 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.255611    2567 generic.go:356] "Generic (PLEG): container finished" podID="1406054fb757eff60c2c19d545c7c3fa" containerID="bd8acf3a547400b1988dd82360801b109e0849c7e931d64a3e6d5e079cb4d815" exitCode=0
Jul 23 09:54:40.256500 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.255690    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" event={"ID":"1406054fb757eff60c2c19d545c7c3fa","Type":"ContainerDied","Data":"bd8acf3a547400b1988dd82360801b109e0849c7e931d64a3e6d5e079cb4d815"}
Jul 23 09:54:40.262761 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.262682    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gw6j9" event={"ID":"12ded5c6-48c0-41af-ab5a-6235eba9d5e9","Type":"ContainerStarted","Data":"37d85656e5a1ebe8abc85445d098a0ac6c3c14fe99f4df1202bae1c9dca7f152"}
Jul 23 09:54:40.274338 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.274215    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" event={"ID":"350c77c7-2f2a-4516-943b-446441017528","Type":"ContainerStarted","Data":"6b3c35c1b94180bf47ca86c351f492b2dd8167ea3cb1a06ac8722bb15b65678d"}
Jul 23 09:54:40.288482 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.288450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"49fd6d55405d73e9cb3480f5954f30263665a1b2be854e44b288da549332a291"}
Jul 23 09:54:40.290048 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.289979    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lb9gk" event={"ID":"55e5a925-bf2c-45a0-a0e5-8fc090f578e0","Type":"ContainerStarted","Data":"917cdac86e6528470376b5e4fe634c3bb65cff456c6eb59b4b83b80347cff78e"}
Jul 23 09:54:40.293330 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.293241    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pdwkl" event={"ID":"d0c4c42f-793a-46be-902d-2f685e945253","Type":"ContainerStarted","Data":"8075199ccafa9b5242ad3401b3896a1797b0eeef109d40f0206de097727e649f"}
Jul 23 09:54:40.301161 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.301107    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal" event={"ID":"3bc2b0ba399541b1dd777c069fca6d48","Type":"ContainerStarted","Data":"a7a73620b73e3909a5c6f68268ca3ae3b20cf46da90df42fa70b1598dddce1d5"}
Jul 23 09:54:40.302851 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:40.302794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw" event={"ID":"85f81663-64c2-403d-a0df-8fd7d97a29e7","Type":"ContainerStarted","Data":"4a0013288f37aadfaf56820168573febcff659628ae335e18933decded1a07de"}
Jul 23 09:54:41.327646 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:41.327391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" event={"ID":"1406054fb757eff60c2c19d545c7c3fa","Type":"ContainerStarted","Data":"9491f04b3e51a5f0340f1988729240d2ea053734100e1e874eb9c8ba96c16d27"}
Jul 23 09:54:41.344665 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:41.344416    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-125.ec2.internal" podStartSLOduration=3.344392258 podStartE2EDuration="3.344392258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:54:40.316666517 +0000 UTC m=+4.554861773" watchObservedRunningTime="2026-07-23 09:54:41.344392258 +0000 UTC m=+5.582587490"
Jul 23 09:54:41.778428 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:41.778322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:41.778593 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:41.778517    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:41.778593 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:41.778583    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret podName:1946fb9c-00aa-446d-be1e-cecb14f56b61 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:45.778552525 +0000 UTC m=+10.016747761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret") pod "global-pull-secret-syncer-469fj" (UID: "1946fb9c-00aa-446d-be1e-cecb14f56b61") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:41.879265 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:41.879225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:41.879538 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:41.879314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:41.879538 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:41.879490    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:41.879662 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:41.879585    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs podName:87e4cb8a-8ecb-4829-b778-dc8fc8d75d41 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:45.879534886 +0000 UTC m=+10.117730134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs") pod "network-metrics-daemon-bsrb2" (UID: "87e4cb8a-8ecb-4829-b778-dc8fc8d75d41") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:41.880067 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:41.880044    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:41.880166 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:41.880074    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:41.880166 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:41.880086    2567 projected.go:196] Error preparing data for projected volume kube-api-access-mlnjc for pod openshift-network-diagnostics/network-check-target-d9tj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:41.880166 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:41.880134    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc podName:e4021391-ecd4-41d7-b920-0bfc4e53f1f3 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:45.880118685 +0000 UTC m=+10.118313963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnjc" (UniqueName: "kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc") pod "network-check-target-d9tj9" (UID: "e4021391-ecd4-41d7-b920-0bfc4e53f1f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:42.226469 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:42.226388    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:42.226639 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:42.226528    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:42.226639 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:42.226591    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:42.226775 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:42.226678    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:42.227054 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:42.227034    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:42.227160 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:42.227139    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:44.228371 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:44.228337    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:44.228904 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:44.228476    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:44.228904 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:44.228898    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:44.229014 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:44.228986    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:44.229070 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:44.229046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:44.229146 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:44.229126    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:45.818009 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:45.817970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:45.818511 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:45.818159    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:45.818511 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:45.818211    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret podName:1946fb9c-00aa-446d-be1e-cecb14f56b61 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:53.818197945 +0000 UTC m=+18.056393175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret") pod "global-pull-secret-syncer-469fj" (UID: "1946fb9c-00aa-446d-be1e-cecb14f56b61") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:45.919385 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:45.919348    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:45.919567 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:45.919418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:45.919567 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:45.919492    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:45.919567 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:45.919519    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:45.919567 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:45.919530    2567 projected.go:196] Error preparing data for projected volume kube-api-access-mlnjc for pod openshift-network-diagnostics/network-check-target-d9tj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:45.919567 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:45.919529    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:45.919805 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:45.919575    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc podName:e4021391-ecd4-41d7-b920-0bfc4e53f1f3 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:53.919560607 +0000 UTC m=+18.157755839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnjc" (UniqueName: "kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc") pod "network-check-target-d9tj9" (UID: "e4021391-ecd4-41d7-b920-0bfc4e53f1f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:45.919805 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:45.919597    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs podName:87e4cb8a-8ecb-4829-b778-dc8fc8d75d41 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:53.919585632 +0000 UTC m=+18.157780875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs") pod "network-metrics-daemon-bsrb2" (UID: "87e4cb8a-8ecb-4829-b778-dc8fc8d75d41") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:46.226889 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:46.226818    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:46.227042 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:46.226983    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:46.227096 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:46.227061    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:46.227150 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:46.227139    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:46.227192 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:46.227166    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:46.227248 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:46.227199    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:48.226177 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:48.226140    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:48.226693 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:48.226153    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:48.226693 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:48.226266    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:48.226693 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:48.226291    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:48.226693 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:48.226355    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:48.226693 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:48.226437    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:50.226417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:50.225944    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:50.226417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:50.225956    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:50.226417 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:50.226085    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:50.226417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:50.225956    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:50.226417 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:50.226146    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:50.226417 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:50.226266    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:52.225893 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:52.225859    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:52.226311 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:52.225859    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:52.226311 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:52.225979    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:52.226311 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:52.225990    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:52.226311 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:52.226073    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:52.226311 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:52.226181    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:53.877639 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:53.877605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:53.878086 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:53.877781    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:53.878086 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:53.877850    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret podName:1946fb9c-00aa-446d-be1e-cecb14f56b61 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:09.877830875 +0000 UTC m=+34.116026107 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret") pod "global-pull-secret-syncer-469fj" (UID: "1946fb9c-00aa-446d-be1e-cecb14f56b61") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:53.978754 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:53.978711    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:53.978985 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:53.978784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:53.978985 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:53.978883    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:53.978985 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:53.978885    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:53.978985 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:53.978909    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:53.978985 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:53.978922    2567 projected.go:196] Error preparing data for projected volume kube-api-access-mlnjc for pod openshift-network-diagnostics/network-check-target-d9tj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:53.978985 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:53.978947    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs podName:87e4cb8a-8ecb-4829-b778-dc8fc8d75d41 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:09.978928778 +0000 UTC m=+34.217124031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs") pod "network-metrics-daemon-bsrb2" (UID: "87e4cb8a-8ecb-4829-b778-dc8fc8d75d41") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:53.978985 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:53.978965    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc podName:e4021391-ecd4-41d7-b920-0bfc4e53f1f3 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:09.978954087 +0000 UTC m=+34.217149318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnjc" (UniqueName: "kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc") pod "network-check-target-d9tj9" (UID: "e4021391-ecd4-41d7-b920-0bfc4e53f1f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:54.225530 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:54.225439    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:54.225530 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:54.225468    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:54.225530 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:54.225439    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:54.225733 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:54.225569    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:54.225733 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:54.225639    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:54.225733 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:54.225682    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:56.225941 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:56.225904    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:56.226429 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:56.226001    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:56.226429 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:56.225999    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:56.226429 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:56.226109    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:56.226429 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:56.226176    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:56.226429 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:56.226274    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:58.225788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:58.225743    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:54:58.226404 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:58.225743    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:54:58.226404 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:58.225873    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:54:58.226404 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:58.225965    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:54:58.226404 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:58.225743    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:54:58.226404 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:54:58.226070    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:54:59.369029 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.368668    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gw6j9" event={"ID":"12ded5c6-48c0-41af-ab5a-6235eba9d5e9","Type":"ContainerStarted","Data":"aff2db4bce5e2efd251c0b8a33fa304de43a84806f1aaa33c23d20d0512acd79"}
Jul 23 09:54:59.370228 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.370207    2567 generic.go:356] "Generic (PLEG): container finished" podID="350c77c7-2f2a-4516-943b-446441017528" containerID="78f044a5ad157491be65efc66c9e9de3b64642ef990340d8ed0ea87a8dae92b7" exitCode=0
Jul 23 09:54:59.370331 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.370276    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" event={"ID":"350c77c7-2f2a-4516-943b-446441017528","Type":"ContainerDied","Data":"78f044a5ad157491be65efc66c9e9de3b64642ef990340d8ed0ea87a8dae92b7"}
Jul 23 09:54:59.372576 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.372553    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"491d5c4da403201da0e03b221e3a9f6a3667e6d0c48357930554f2dbd7ae3423"}
Jul 23 09:54:59.372666 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.372633    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"f947636702c8a550f5e72062f325c7dbdde873e8ffdbc4b4ca9e9dcae9b16d82"}
Jul 23 09:54:59.372715 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.372683    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"3804117906c4d7a4375a2edda19bc81c96b5c61b940761b6cf9eb6b07c2b996a"}
Jul 23 09:54:59.372752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.372731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"bac90c34b747db46a4cf6654d7677e25855d445679e56e260bd777c3fb8c3e55"}
Jul 23 09:54:59.373960 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.373937    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lb9gk" event={"ID":"55e5a925-bf2c-45a0-a0e5-8fc090f578e0","Type":"ContainerStarted","Data":"8266af7d9b53bd0c4cc43088b9f916798469e3eb71f19f901e49049d37ea855b"}
Jul 23 09:54:59.375218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.375188    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pdwkl" event={"ID":"d0c4c42f-793a-46be-902d-2f685e945253","Type":"ContainerStarted","Data":"0adf727b73866ebd1eadf265a1b827defe663fbc8e326cdaf5ef97c80686f791"}
Jul 23 09:54:59.376606 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.376586    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw" event={"ID":"85f81663-64c2-403d-a0df-8fd7d97a29e7","Type":"ContainerStarted","Data":"2fd86d521f6bc819c6a338c12bdcc961eb2a1d34450e4e08804abe31bac47f78"}
Jul 23 09:54:59.377910 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.377888    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g8pml" event={"ID":"90f3e1db-0b1f-497a-af08-c6d7587c7c8b","Type":"ContainerStarted","Data":"6a2e385aa23763f5ef0acf9a45d164611b41b58450e662571a96d1d11578c472"}
Jul 23 09:54:59.379022 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.379004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xtvrq" event={"ID":"e7bdd090-55e9-44f4-b09f-17021a14f169","Type":"ContainerStarted","Data":"fb32cae274010ca5e8291b4beb131e024c6f06fcff99197e66cd26669fed5f52"}
Jul 23 09:54:59.384416 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.384378    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gw6j9" podStartSLOduration=6.576992521 podStartE2EDuration="22.384367195s" totalImagesPullingTime="15.807374674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:54:59.38431746 +0000 UTC m=+23.622512724" watchObservedRunningTime="2026-07-23 09:54:59.384367195 +0000 UTC m=+23.622562448"
Jul 23 09:54:59.384592 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.384573    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-125.ec2.internal" podStartSLOduration=21.384568544 podStartE2EDuration="21.384568544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:54:41.345594441 +0000 UTC m=+5.583789700" watchObservedRunningTime="2026-07-23 09:54:59.384568544 +0000 UTC m=+23.622763802"
Jul 23 09:54:59.420196 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.420154    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lb9gk" podStartSLOduration=3.808374474 podStartE2EDuration="23.42013989s" totalImagesPullingTime="19.611765416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:54:59.419933098 +0000 UTC m=+23.658128350" watchObservedRunningTime="2026-07-23 09:54:59.42013989 +0000 UTC m=+23.658335163"
Jul 23 09:54:59.435884 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.435848    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pdwkl" podStartSLOduration=2.759082857 podStartE2EDuration="22.435835782s" totalImagesPullingTime="19.676752925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:54:59.435438432 +0000 UTC m=+23.673633683" watchObservedRunningTime="2026-07-23 09:54:59.435835782 +0000 UTC m=+23.674031034"
Jul 23 09:54:59.482347 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.480669    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xtvrq" podStartSLOduration=2.861651853 podStartE2EDuration="22.480642891s" totalImagesPullingTime="19.618991038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:54:59.479981231 +0000 UTC m=+23.718176486" watchObservedRunningTime="2026-07-23 09:54:59.480642891 +0000 UTC m=+23.718838145"
Jul 23 09:54:59.482347 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.480778    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g8pml" podStartSLOduration=3.868397694 podStartE2EDuration="23.480771608s" totalImagesPullingTime="19.612373914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:54:59.454011894 +0000 UTC m=+23.692207165" watchObservedRunningTime="2026-07-23 09:54:59.480771608 +0000 UTC m=+23.718966863"
Jul 23 09:54:59.540970 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.540944    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:54:59.541507 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:54:59.541482    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:55:00.225715 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.225683    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:00.225956 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.225686    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:00.225956 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:00.225807    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:55:00.225956 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.225818    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:00.225956 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:00.225899    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:55:00.226087 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:00.225958    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:55:00.382947 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.382906    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bl7rt" event={"ID":"70e6ed9a-bb72-4b99-845d-ec3e0978361a","Type":"ContainerStarted","Data":"35842c3546ad7f0f4dfeffd1da0d2fb49a2c3195aada957163e845c8d6344558"}
Jul 23 09:55:00.386655 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.386624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"755d3da3fad51c03e6a1bbe9ff1cf0ed15e8be1666d1af7f3031a76e6cfdff83"}
Jul 23 09:55:00.386805 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.386706    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"e101fe991af5649b162568ea25486961c728791f28edfbac518ee3e30868cac9"}
Jul 23 09:55:00.387207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.387100    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:55:00.387668 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.387649    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gw6j9"
Jul 23 09:55:00.398175 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.398123    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bl7rt" podStartSLOduration=3.775259385 podStartE2EDuration="23.398106384s" totalImagesPullingTime="19.622846999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:00.397584623 +0000 UTC m=+24.635779875" watchObservedRunningTime="2026-07-23 09:55:00.398106384 +0000 UTC m=+24.636301637"
Jul 23 09:55:00.681543 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:00.681516    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 09:55:01.211543 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:01.211351    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T09:55:00.681536193Z","UUID":"b69571dd-e582-48a3-b08e-40d4f4bd64a2","Handler":null,"Name":"","Endpoint":""}
Jul 23 09:55:01.213104 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:01.213084    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 09:55:01.213230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:01.213123    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 09:55:01.392318 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:01.392287    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw" event={"ID":"85f81663-64c2-403d-a0df-8fd7d97a29e7","Type":"ContainerStarted","Data":"390fed5f93f4336a62dc4c1c903059f43dbcf262d956464e33394569d90f5429"}
Jul 23 09:55:02.225550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:02.225501    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:02.225835 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:02.225622    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:55:02.225835 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:02.225648    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:02.225966 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:02.225496    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:02.225966 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:02.225858    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:55:02.226079 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:02.225967    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:55:02.397953 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:02.397917    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"590cfd0614fe5e6da474535dba5edcf18cab906b5527f0448d28c66dafe11a62"}
Jul 23 09:55:02.400146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:02.400115    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw" event={"ID":"85f81663-64c2-403d-a0df-8fd7d97a29e7","Type":"ContainerStarted","Data":"693a41ec453cd41bbfe64fd84b570cd35a8b1f81dfa94c1d6465f0f0a32ba4d1"}
Jul 23 09:55:02.418097 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:02.418037    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2dcw" podStartSLOduration=4.35254563 podStartE2EDuration="26.418023858s" totalImagesPullingTime="22.065478228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:02.417709614 +0000 UTC m=+26.655904868" watchObservedRunningTime="2026-07-23 09:55:02.418023858 +0000 UTC m=+26.656219110"
Jul 23 09:55:04.225958 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.225814    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:04.226743 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.225814    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:04.226743 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:04.226050    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:55:04.226743 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.225895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:04.226743 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:04.226119    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:55:04.226743 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:04.226192    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:55:04.405861 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.405827    2567 generic.go:356] "Generic (PLEG): container finished" podID="350c77c7-2f2a-4516-943b-446441017528" containerID="ee66ba2f153ea38fa71c59818eaf90e0dccec96628d3a1efab8b68825cbf9998" exitCode=0
Jul 23 09:55:04.406039 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.405887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" event={"ID":"350c77c7-2f2a-4516-943b-446441017528","Type":"ContainerDied","Data":"ee66ba2f153ea38fa71c59818eaf90e0dccec96628d3a1efab8b68825cbf9998"}
Jul 23 09:55:04.409378 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.409354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" event={"ID":"798ba73a-0c82-45c4-9536-2bd4ae09b7b7","Type":"ContainerStarted","Data":"8fe79d5a26c9d34c34791833f63e5cfc1e3d4b519dda24cef8b7061d8b845fb4"}
Jul 23 09:55:04.409613 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.409598    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:55:04.409667 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.409660    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:55:04.425747 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.425603    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:55:04.456803 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:04.456757    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-csr99" podStartSLOduration=8.783429254 podStartE2EDuration="28.456745343s" totalImagesPullingTime="19.673316089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:04.453985335 +0000 UTC m=+28.692180588" watchObservedRunningTime="2026-07-23 09:55:04.456745343 +0000 UTC m=+28.694940594"
Jul 23 09:55:05.411638 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:05.411603    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:55:05.426305 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:05.426284    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:55:05.960791 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:05.960717    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d9tj9"]
Jul 23 09:55:05.960985 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:05.960826    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:05.960985 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:05.960912    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:55:05.963004 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:05.962978    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-469fj"]
Jul 23 09:55:05.963106 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:05.963079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:05.963172 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:05.963157    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:55:05.963655 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:05.963630    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bsrb2"]
Jul 23 09:55:05.963753 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:05.963739    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:05.963869 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:05.963846    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:55:06.415024 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:06.414991    2567 generic.go:356] "Generic (PLEG): container finished" podID="350c77c7-2f2a-4516-943b-446441017528" containerID="c2e60b2da4b568a6edf190fe554625c001fa96f6aed18d55374dbd2bc9c0517f" exitCode=0
Jul 23 09:55:06.415451 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:06.415075    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" event={"ID":"350c77c7-2f2a-4516-943b-446441017528","Type":"ContainerDied","Data":"c2e60b2da4b568a6edf190fe554625c001fa96f6aed18d55374dbd2bc9c0517f"}
Jul 23 09:55:07.225965 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:07.225931    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:07.226142 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:07.225930    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:07.226142 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:07.226040    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:55:07.226142 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:07.225930    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:07.226142 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:07.226114    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:55:07.226349 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:07.226208    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:55:08.423406 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:08.423345    2567 generic.go:356] "Generic (PLEG): container finished" podID="350c77c7-2f2a-4516-943b-446441017528" containerID="6364d1add51a62543cb0bd76fbd08670ec6f789c64a9b6ab982f4ad88b8b4365" exitCode=0
Jul 23 09:55:08.423406 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:08.423393    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" event={"ID":"350c77c7-2f2a-4516-943b-446441017528","Type":"ContainerDied","Data":"6364d1add51a62543cb0bd76fbd08670ec6f789c64a9b6ab982f4ad88b8b4365"}
Jul 23 09:55:09.225321 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:09.225283    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:09.225497 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:09.225283    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:09.225497 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.225417    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:55:09.225613 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.225523    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:55:09.225613 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:09.225283    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:09.225709 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.225611    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:55:09.898070 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:09.897826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:09.898585 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.897990    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:55:09.898585 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.898202    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret podName:1946fb9c-00aa-446d-be1e-cecb14f56b61 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:41.898179203 +0000 UTC m=+66.136374446 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret") pod "global-pull-secret-syncer-469fj" (UID: "1946fb9c-00aa-446d-be1e-cecb14f56b61") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:55:09.999503 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:09.999476    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:09.999680 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:09.999518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:09.999680 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.999633    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:55:09.999680 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.999648    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:55:09.999680 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.999667    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:55:09.999680 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.999679    2567 projected.go:196] Error preparing data for projected volume kube-api-access-mlnjc for pod openshift-network-diagnostics/network-check-target-d9tj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:55:09.999935 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.999697    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs podName:87e4cb8a-8ecb-4829-b778-dc8fc8d75d41 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:41.999678196 +0000 UTC m=+66.237873431 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs") pod "network-metrics-daemon-bsrb2" (UID: "87e4cb8a-8ecb-4829-b778-dc8fc8d75d41") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:55:09.999935 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:09.999714    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc podName:e4021391-ecd4-41d7-b920-0bfc4e53f1f3 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:41.999703902 +0000 UTC m=+66.237899134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mlnjc" (UniqueName: "kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc") pod "network-check-target-d9tj9" (UID: "e4021391-ecd4-41d7-b920-0bfc4e53f1f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:55:11.225585 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:11.225548    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:11.226022 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:11.225678    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:11.226022 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:11.225683    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-469fj" podUID="1946fb9c-00aa-446d-be1e-cecb14f56b61"
Jul 23 09:55:11.226022 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:11.225707    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:11.226022 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:11.225779    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d9tj9" podUID="e4021391-ecd4-41d7-b920-0bfc4e53f1f3"
Jul 23 09:55:11.226022 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:11.225870    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bsrb2" podUID="87e4cb8a-8ecb-4829-b778-dc8fc8d75d41"
Jul 23 09:55:12.622366 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.622336    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-125.ec2.internal" event="NodeReady"
Jul 23 09:55:12.622809 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.622464    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 09:55:12.659726 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.659695    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"]
Jul 23 09:55:12.665678 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.665269    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.665828 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.665698    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"]
Jul 23 09:55:12.667863 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.667838    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"]
Jul 23 09:55:12.667980 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.667902    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.667980 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.667839    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 09:55:12.669434 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.669410    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 09:55:12.669573 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.669495    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hgx8p\""
Jul 23 09:55:12.669698 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.669679    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2hvdb"]
Jul 23 09:55:12.669845 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.669830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.669911 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.669833    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.670628 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.670610    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 09:55:12.671017 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.670994    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8c4kr\""
Jul 23 09:55:12.671086 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.671062    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.671591 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.671576    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b6fb8b4bb-rcggg"]
Jul 23 09:55:12.671690 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.671678    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.673130 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.673103    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.673373 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.673359    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-dpdjn"]
Jul 23 09:55:12.673491 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.673471    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.674873 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.674857    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.675725 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.675712    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"]
Jul 23 09:55:12.675829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.675816    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.676484 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.676468    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.676484 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.676478    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 09:55:12.676596 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.676499    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 09:55:12.677176 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677157    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.677176 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677173    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.677763 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677180    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-th8n4\""
Jul 23 09:55:12.677763 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677176    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 09:55:12.677763 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677322    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 09:55:12.677763 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677430    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 09:55:12.677763 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677438    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7"]
Jul 23 09:55:12.677763 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677449    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.677763 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677549    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:12.678079 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.677881    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.678131 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.678070    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xqjkp\""
Jul 23 09:55:12.679230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.679195    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dsnq4\""
Jul 23 09:55:12.679427 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.679412    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 09:55:12.679694 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.679679    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.679879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.679865    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 09:55:12.679947 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.679909    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 09:55:12.680354 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.680337    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 09:55:12.681281 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.681261    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 09:55:12.681458 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.681439    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.682007 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.681921    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.682320 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.682301    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fd85f8dd7-kff2d"]
Jul 23 09:55:12.683479 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.682806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7"
Jul 23 09:55:12.683479 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.683339    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n9bpc\""
Jul 23 09:55:12.683479 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.683352    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tnv6x\""
Jul 23 09:55:12.683645 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.683601    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.683803 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.683781    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 09:55:12.686148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.684032    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"]
Jul 23 09:55:12.686148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.684063    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"]
Jul 23 09:55:12.686148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.684081    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"]
Jul 23 09:55:12.686148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.684127    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.686148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.684586    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 09:55:12.686148 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.685700    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-dpdjn"]
Jul 23 09:55:12.692360 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.692333    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.696685 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.696655    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 09:55:12.696806 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.696741    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 09:55:12.697021 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.696998    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5c92v\""
Jul 23 09:55:12.697254 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.697219    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vtvtf\""
Jul 23 09:55:12.697415 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.697014    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.697510 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.697494    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.697731 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.697716    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 09:55:12.698471 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.698443    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 09:55:12.698563 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.698530    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 09:55:12.698885 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.698860    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2hvdb"]
Jul 23 09:55:12.700385 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.700363    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jqh8v"]
Jul 23 09:55:12.702811 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.702792    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 09:55:12.703192 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.703175    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"]
Jul 23 09:55:12.703354 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.703334    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jqh8v"
Jul 23 09:55:12.706088 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.706065    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr"]
Jul 23 09:55:12.706190 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.706119    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.706629 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.706609    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-96vpq\""
Jul 23 09:55:12.706926 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.706892    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 09:55:12.707103 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.706712    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:12.707205 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.707189    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.708372 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.708352    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7"]
Jul 23 09:55:12.708434 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.708392    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xn2qz"]
Jul 23 09:55:12.708574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.708462    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr"
Jul 23 09:55:12.709603 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.709586    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 23 09:55:12.709890 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.709874    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 23 09:55:12.709961 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.709946    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rrggk\""
Jul 23 09:55:12.711003 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.710988    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b6fb8b4bb-rcggg"]
Jul 23 09:55:12.711339 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711322    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"]
Jul 23 09:55:12.711427 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711355    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fd85f8dd7-kff2d"]
Jul 23 09:55:12.711427 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711379    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jqh8v"]
Jul 23 09:55:12.711427 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711111    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w9vg7\""
Jul 23 09:55:12.711587 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711395    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr"]
Jul 23 09:55:12.711587 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711275    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.711691 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711606    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 09:55:12.711691 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711211    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 09:55:12.711791 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.711765    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"]
Jul 23 09:55:12.713741 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.713682    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 09:55:12.714197 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.714183    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 09:55:12.714916 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.714899    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdkgf\""
Jul 23 09:55:12.719934 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.719915    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xn2qz"]
Jul 23 09:55:12.819085 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819056    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgzv5\" (UniqueName: \"kubernetes.io/projected/f5a119f2-7f76-4498-81fd-1c9574666ec2-kube-api-access-vgzv5\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:12.819085 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmzzk\" (UniqueName: \"kubernetes.io/projected/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-kube-api-access-wmzzk\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.819321 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3a8e806-0afc-4058-9116-cca6bfde7d98-cert\") pod \"ingress-canary-jqh8v\" (UID: \"f3a8e806-0afc-4058-9116-cca6bfde7d98\") " pod="openshift-ingress-canary/ingress-canary-jqh8v"
Jul 23 09:55:12.819321 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819123    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckpg\" (UniqueName: \"kubernetes.io/projected/ca3e4373-64d7-4e96-83be-9a439763d123-kube-api-access-gckpg\") pod \"volume-data-source-validator-78cf4c6f6-dbbg7\" (UID: \"ca3e4373-64d7-4e96-83be-9a439763d123\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7"
Jul 23 09:55:12.819321 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819176    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1596cdd-d541-44ce-82b1-7523cc9b7345-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.819321 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f117bef5-3c98-4c4f-a337-9459f67cd78f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.819321 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819251    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-stats-auth\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.819321 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819268    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7750c8de-1209-4e09-a4ba-720eb375f07b-trusted-ca\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.819321 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-trusted-ca\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819352    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96cceed0-f182-475b-9410-18f174240014-tmp-dir\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ksx6\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-kube-api-access-2ksx6\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqf27\" (UniqueName: \"kubernetes.io/projected/f3a8e806-0afc-4058-9116-cca6bfde7d98-kube-api-access-cqf27\") pod \"ingress-canary-jqh8v\" (UID: \"f3a8e806-0afc-4058-9116-cca6bfde7d98\") " pod="openshift-ingress-canary/ingress-canary-jqh8v"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/59d64ea9-f7cc-4292-947a-f905ff9f039a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmvz6\" (UniqueName: \"kubernetes.io/projected/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-kube-api-access-cmvz6\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819510    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b097844c-2178-407b-b429-3a83390e0261-ca-trust-extracted\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819528    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab152ad-c1e0-43a3-907b-6db993bbabf7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.819569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab152ad-c1e0-43a3-907b-6db993bbabf7-serving-cert\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1596cdd-d541-44ce-82b1-7523cc9b7345-config\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrgzl\" (UniqueName: \"kubernetes.io/projected/8ab152ad-c1e0-43a3-907b-6db993bbabf7-kube-api-access-wrgzl\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-default-certificate\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-installation-pull-secrets\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819725    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ab152ad-c1e0-43a3-907b-6db993bbabf7-tmp\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819739    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8ab152ad-c1e0-43a3-907b-6db993bbabf7-snapshots\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819755    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-bound-sa-token\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlvkd\" (UniqueName: \"kubernetes.io/projected/f117bef5-3c98-4c4f-a337-9459f67cd78f-kube-api-access-dlvkd\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819827    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7750c8de-1209-4e09-a4ba-720eb375f07b-config\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819842    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq2bl\" (UniqueName: \"kubernetes.io/projected/96cceed0-f182-475b-9410-18f174240014-kube-api-access-sq2bl\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819905    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-registry-certificates\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819923    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:12.819943 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819939    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mg96\" (UniqueName: \"kubernetes.io/projected/f2e7fcc2-6ec7-4de7-859e-079b82922efc-kube-api-access-5mg96\") pod \"network-check-source-7bc5b6bf85-8fqmr\" (UID: \"f2e7fcc2-6ec7-4de7-859e-079b82922efc\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.819986    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820019    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96cceed0-f182-475b-9410-18f174240014-config-volume\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8zrr\" (UniqueName: \"kubernetes.io/projected/b1596cdd-d541-44ce-82b1-7523cc9b7345-kube-api-access-n8zrr\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820114    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cjr\" (UniqueName: \"kubernetes.io/projected/7750c8de-1209-4e09-a4ba-720eb375f07b-kube-api-access-w4cjr\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-image-registry-private-configuration\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820200    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab152ad-c1e0-43a3-907b-6db993bbabf7-service-ca-bundle\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820260    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f117bef5-3c98-4c4f-a337-9459f67cd78f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.820574 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.820314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7750c8de-1209-4e09-a4ba-720eb375f07b-serving-cert\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.921531 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921432    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96cceed0-f182-475b-9410-18f174240014-tmp-dir\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.921531 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921468    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ksx6\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-kube-api-access-2ksx6\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.921531 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.921586    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921625    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqf27\" (UniqueName: \"kubernetes.io/projected/f3a8e806-0afc-4058-9116-cca6bfde7d98-kube-api-access-cqf27\") pod \"ingress-canary-jqh8v\" (UID: \"f3a8e806-0afc-4058-9116-cca6bfde7d98\") " pod="openshift-ingress-canary/ingress-canary-jqh8v"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.921635    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls podName:96cceed0-f182-475b-9410-18f174240014 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.421620653 +0000 UTC m=+37.659815902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls") pod "dns-default-xn2qz" (UID: "96cceed0-f182-475b-9410-18f174240014") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/59d64ea9-f7cc-4292-947a-f905ff9f039a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmvz6\" (UniqueName: \"kubernetes.io/projected/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-kube-api-access-cmvz6\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b097844c-2178-407b-b429-3a83390e0261-ca-trust-extracted\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab152ad-c1e0-43a3-907b-6db993bbabf7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921807    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab152ad-c1e0-43a3-907b-6db993bbabf7-serving-cert\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921819    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96cceed0-f182-475b-9410-18f174240014-tmp-dir\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921844    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1596cdd-d541-44ce-82b1-7523cc9b7345-config\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrgzl\" (UniqueName: \"kubernetes.io/projected/8ab152ad-c1e0-43a3-907b-6db993bbabf7-kube-api-access-wrgzl\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.921885    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-default-certificate\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-installation-pull-secrets\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.922332 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.921948    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.421931375 +0000 UTC m=+37.660126605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : secret "router-metrics-certs-default" not found
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.921988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ab152ad-c1e0-43a3-907b-6db993bbabf7-tmp\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922019    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8ab152ad-c1e0-43a3-907b-6db993bbabf7-snapshots\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-bound-sa-token\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlvkd\" (UniqueName: \"kubernetes.io/projected/f117bef5-3c98-4c4f-a337-9459f67cd78f-kube-api-access-dlvkd\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7750c8de-1209-4e09-a4ba-720eb375f07b-config\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922122    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq2bl\" (UniqueName: \"kubernetes.io/projected/96cceed0-f182-475b-9410-18f174240014-kube-api-access-sq2bl\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b097844c-2178-407b-b429-3a83390e0261-ca-trust-extracted\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.922204    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.922267    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert podName:59d64ea9-f7cc-4292-947a-f905ff9f039a nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.422227169 +0000 UTC m=+37.660422400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-8wlsw" (UID: "59d64ea9-f7cc-4292-947a-f905ff9f039a") : secret "networking-console-plugin-cert" not found
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922406    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ab152ad-c1e0-43a3-907b-6db993bbabf7-tmp\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922543    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b1596cdd-d541-44ce-82b1-7523cc9b7345-config\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922676    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/59d64ea9-f7cc-4292-947a-f905ff9f039a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-registry-certificates\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.923194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922781    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mg96\" (UniqueName: \"kubernetes.io/projected/f2e7fcc2-6ec7-4de7-859e-079b82922efc-kube-api-access-5mg96\") pod \"network-check-source-7bc5b6bf85-8fqmr\" (UID: \"f2e7fcc2-6ec7-4de7-859e-079b82922efc\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab152ad-c1e0-43a3-907b-6db993bbabf7-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922813    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922839    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96cceed0-f182-475b-9410-18f174240014-config-volume\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.922870    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8zrr\" (UniqueName: \"kubernetes.io/projected/b1596cdd-d541-44ce-82b1-7523cc9b7345-kube-api-access-n8zrr\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922886    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8ab152ad-c1e0-43a3-907b-6db993bbabf7-snapshots\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7750c8de-1209-4e09-a4ba-720eb375f07b-config\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.922924    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls podName:f5a119f2-7f76-4498-81fd-1c9574666ec2 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.422908625 +0000 UTC m=+37.661103880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-g4rnr" (UID: "f5a119f2-7f76-4498-81fd-1c9574666ec2") : secret "samples-operator-tls" not found
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922947    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cjr\" (UniqueName: \"kubernetes.io/projected/7750c8de-1209-4e09-a4ba-720eb375f07b-kube-api-access-w4cjr\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.922972    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.922979    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-image-registry-private-configuration\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923019    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab152ad-c1e0-43a3-907b-6db993bbabf7-service-ca-bundle\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.923933 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.923030    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls podName:d4fc16e2-347d-4676-afe3-7b39abdf7a5f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.423015469 +0000 UTC m=+37.661210699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hrp9f" (UID: "d4fc16e2-347d-4676-afe3-7b39abdf7a5f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923070    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f117bef5-3c98-4c4f-a337-9459f67cd78f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923132    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7750c8de-1209-4e09-a4ba-720eb375f07b-serving-cert\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgzv5\" (UniqueName: \"kubernetes.io/projected/f5a119f2-7f76-4498-81fd-1c9574666ec2-kube-api-access-vgzv5\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmzzk\" (UniqueName: \"kubernetes.io/projected/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-kube-api-access-wmzzk\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3a8e806-0afc-4058-9116-cca6bfde7d98-cert\") pod \"ingress-canary-jqh8v\" (UID: \"f3a8e806-0afc-4058-9116-cca6bfde7d98\") " pod="openshift-ingress-canary/ingress-canary-jqh8v"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gckpg\" (UniqueName: \"kubernetes.io/projected/ca3e4373-64d7-4e96-83be-9a439763d123-kube-api-access-gckpg\") pod \"volume-data-source-validator-78cf4c6f6-dbbg7\" (UID: \"ca3e4373-64d7-4e96-83be-9a439763d123\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1596cdd-d541-44ce-82b1-7523cc9b7345-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f117bef5-3c98-4c4f-a337-9459f67cd78f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-stats-auth\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.923444    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.423432258 +0000 UTC m=+37.661627509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : configmap references non-existent config key: service-ca.crt
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923464    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96cceed0-f182-475b-9410-18f174240014-config-volume\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923481    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab152ad-c1e0-43a3-907b-6db993bbabf7-service-ca-bundle\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923557    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-registry-certificates\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.924752 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7750c8de-1209-4e09-a4ba-720eb375f07b-trusted-ca\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.925444 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-trusted-ca\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.925444 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.923989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.925444 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.924090    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 09:55:12.925444 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.924101    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd85f8dd7-kff2d: secret "image-registry-tls" not found
Jul 23 09:55:12.925444 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:12.924187    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls podName:b097844c-2178-407b-b429-3a83390e0261 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.424173676 +0000 UTC m=+37.662368906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls") pod "image-registry-6fd85f8dd7-kff2d" (UID: "b097844c-2178-407b-b429-3a83390e0261") : secret "image-registry-tls" not found
Jul 23 09:55:12.925444 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.924758    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.925444 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.925160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7750c8de-1209-4e09-a4ba-720eb375f07b-trusted-ca\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.926370 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.925974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-trusted-ca\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.926370 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.926325    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f117bef5-3c98-4c4f-a337-9459f67cd78f-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.927897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.927661    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-installation-pull-secrets\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.927897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.927698    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3a8e806-0afc-4058-9116-cca6bfde7d98-cert\") pod \"ingress-canary-jqh8v\" (UID: \"f3a8e806-0afc-4058-9116-cca6bfde7d98\") " pod="openshift-ingress-canary/ingress-canary-jqh8v"
Jul 23 09:55:12.927897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.927835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab152ad-c1e0-43a3-907b-6db993bbabf7-serving-cert\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.927897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.927841    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-default-certificate\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.928192 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.928065    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-image-registry-private-configuration\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.928192 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.928137    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7750c8de-1209-4e09-a4ba-720eb375f07b-serving-cert\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.928705 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.928689    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f117bef5-3c98-4c4f-a337-9459f67cd78f-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.928791 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.928756    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1596cdd-d541-44ce-82b1-7523cc9b7345-serving-cert\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.929226 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.929202    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-stats-auth\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.931793 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.931749    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmvz6\" (UniqueName: \"kubernetes.io/projected/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-kube-api-access-cmvz6\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:12.932646 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.932617    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ksx6\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-kube-api-access-2ksx6\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.932822 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.932770    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlvkd\" (UniqueName: \"kubernetes.io/projected/f117bef5-3c98-4c4f-a337-9459f67cd78f-kube-api-access-dlvkd\") pod \"kube-storage-version-migrator-operator-7658d9b749-w9gfw\" (UID: \"f117bef5-3c98-4c4f-a337-9459f67cd78f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.933905 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.933794    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqf27\" (UniqueName: \"kubernetes.io/projected/f3a8e806-0afc-4058-9116-cca6bfde7d98-kube-api-access-cqf27\") pod \"ingress-canary-jqh8v\" (UID: \"f3a8e806-0afc-4058-9116-cca6bfde7d98\") " pod="openshift-ingress-canary/ingress-canary-jqh8v"
Jul 23 09:55:12.934006 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.933937    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckpg\" (UniqueName: \"kubernetes.io/projected/ca3e4373-64d7-4e96-83be-9a439763d123-kube-api-access-gckpg\") pod \"volume-data-source-validator-78cf4c6f6-dbbg7\" (UID: \"ca3e4373-64d7-4e96-83be-9a439763d123\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7"
Jul 23 09:55:12.934410 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.934382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mg96\" (UniqueName: \"kubernetes.io/projected/f2e7fcc2-6ec7-4de7-859e-079b82922efc-kube-api-access-5mg96\") pod \"network-check-source-7bc5b6bf85-8fqmr\" (UID: \"f2e7fcc2-6ec7-4de7-859e-079b82922efc\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr"
Jul 23 09:55:12.934602 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.934542    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cjr\" (UniqueName: \"kubernetes.io/projected/7750c8de-1209-4e09-a4ba-720eb375f07b-kube-api-access-w4cjr\") pod \"console-operator-565b7b569d-2hvdb\" (UID: \"7750c8de-1209-4e09-a4ba-720eb375f07b\") " pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:12.934602 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.934545    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmzzk\" (UniqueName: \"kubernetes.io/projected/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-kube-api-access-wmzzk\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:12.934914 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.934884    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8zrr\" (UniqueName: \"kubernetes.io/projected/b1596cdd-d541-44ce-82b1-7523cc9b7345-kube-api-access-n8zrr\") pod \"service-ca-operator-5bcbc94c78-qhjcl\" (UID: \"b1596cdd-d541-44ce-82b1-7523cc9b7345\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:12.935040 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.935019    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrgzl\" (UniqueName: \"kubernetes.io/projected/8ab152ad-c1e0-43a3-907b-6db993bbabf7-kube-api-access-wrgzl\") pod \"insights-operator-555d9d7885-dpdjn\" (UID: \"8ab152ad-c1e0-43a3-907b-6db993bbabf7\") " pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:12.935140 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.935125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq2bl\" (UniqueName: \"kubernetes.io/projected/96cceed0-f182-475b-9410-18f174240014-kube-api-access-sq2bl\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:12.935323 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.935221    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-bound-sa-token\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:12.936516 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.936495    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgzv5\" (UniqueName: \"kubernetes.io/projected/f5a119f2-7f76-4498-81fd-1c9574666ec2-kube-api-access-vgzv5\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:12.976822 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.976801    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"
Jul 23 09:55:12.999468 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:12.999443    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"
Jul 23 09:55:13.008857 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.008834    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:13.021680 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.021653    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-dpdjn"
Jul 23 09:55:13.034991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.034401    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7"
Jul 23 09:55:13.045640 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.045412    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jqh8v"
Jul 23 09:55:13.057751 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.057450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr"
Jul 23 09:55:13.174191 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.173568    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw"]
Jul 23 09:55:13.191375 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:13.191284    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf117bef5_3c98_4c4f_a337_9459f67cd78f.slice/crio-aef80e2294e6c6f059cdcd80b5f628eee85dbda94e1249cd83a605a00ea84814 WatchSource:0}: Error finding container aef80e2294e6c6f059cdcd80b5f628eee85dbda94e1249cd83a605a00ea84814: Status 404 returned error can't find the container with id aef80e2294e6c6f059cdcd80b5f628eee85dbda94e1249cd83a605a00ea84814
Jul 23 09:55:13.225892 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.225636    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:13.225892 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.225845    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:13.228164 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.227915    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:13.229732 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.229560    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5t7cr\""
Jul 23 09:55:13.230858 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.230837    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2hvdb"]
Jul 23 09:55:13.231622 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.231250    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 09:55:13.231622 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.231339    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ztznw\""
Jul 23 09:55:13.231622 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.231483    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 09:55:13.236744 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:13.236711    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7750c8de_1209_4e09_a4ba_720eb375f07b.slice/crio-aa3c48e5c93ad447c8a2a617a33e27c78c6cd13e0c076bd1ee455a09371ba97f WatchSource:0}: Error finding container aa3c48e5c93ad447c8a2a617a33e27c78c6cd13e0c076bd1ee455a09371ba97f: Status 404 returned error can't find the container with id aa3c48e5c93ad447c8a2a617a33e27c78c6cd13e0c076bd1ee455a09371ba97f
Jul 23 09:55:13.247689 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.247387    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl"]
Jul 23 09:55:13.251797 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:13.251773    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1596cdd_d541_44ce_82b1_7523cc9b7345.slice/crio-0810f311809ad3cd3a3770072d52ad83c533ccd7bb07dc0dd2e0e11f3eaaeabe WatchSource:0}: Error finding container 0810f311809ad3cd3a3770072d52ad83c533ccd7bb07dc0dd2e0e11f3eaaeabe: Status 404 returned error can't find the container with id 0810f311809ad3cd3a3770072d52ad83c533ccd7bb07dc0dd2e0e11f3eaaeabe
Jul 23 09:55:13.267192 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.267167    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-dpdjn"]
Jul 23 09:55:13.274733 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.274462    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7"]
Jul 23 09:55:13.277551 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:13.277457    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3e4373_64d7_4e96_83be_9a439763d123.slice/crio-a5601e1f9027a08a3e2d5a8e12748a5309ed3137a13c760629ce6f2059a70d78 WatchSource:0}: Error finding container a5601e1f9027a08a3e2d5a8e12748a5309ed3137a13c760629ce6f2059a70d78: Status 404 returned error can't find the container with id a5601e1f9027a08a3e2d5a8e12748a5309ed3137a13c760629ce6f2059a70d78
Jul 23 09:55:13.302892 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.302786    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr"]
Jul 23 09:55:13.305187 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:13.305163    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e7fcc2_6ec7_4de7_859e_079b82922efc.slice/crio-6d1577e40449eff63d51054d400dded072c645781adecd6e6bb3edbcbcff8ea5 WatchSource:0}: Error finding container 6d1577e40449eff63d51054d400dded072c645781adecd6e6bb3edbcbcff8ea5: Status 404 returned error can't find the container with id 6d1577e40449eff63d51054d400dded072c645781adecd6e6bb3edbcbcff8ea5
Jul 23 09:55:13.308066 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.308047    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jqh8v"]
Jul 23 09:55:13.311212 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:13.311191    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a8e806_0afc_4058_9116_cca6bfde7d98.slice/crio-c1eb0eb461f04681b27b17fe9033865038c8306a6f5ff1c5ed96a35d889d79d5 WatchSource:0}: Error finding container c1eb0eb461f04681b27b17fe9033865038c8306a6f5ff1c5ed96a35d889d79d5: Status 404 returned error can't find the container with id c1eb0eb461f04681b27b17fe9033865038c8306a6f5ff1c5ed96a35d889d79d5
Jul 23 09:55:13.429369 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.429286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:13.429369 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.429324    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:13.429369 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.429346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.429375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.429430    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429444    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429462    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.429448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429490    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:14.429468677 +0000 UTC m=+38.667663911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : configmap references non-existent config key: service-ca.crt
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429521    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429526    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert podName:59d64ea9-f7cc-4292-947a-f905ff9f039a nodeName:}" failed. No retries permitted until 2026-07-23 09:55:14.429508268 +0000 UTC m=+38.667703498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-8wlsw" (UID: "59d64ea9-f7cc-4292-947a-f905ff9f039a") : secret "networking-console-plugin-cert" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429541    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429558    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls podName:f5a119f2-7f76-4498-81fd-1c9574666ec2 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:14.429551055 +0000 UTC m=+38.667746285 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-g4rnr" (UID: "f5a119f2-7f76-4498-81fd-1c9574666ec2") : secret "samples-operator-tls" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429563    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429569    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls podName:96cceed0-f182-475b-9410-18f174240014 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:14.42956376 +0000 UTC m=+38.667758989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls") pod "dns-default-xn2qz" (UID: "96cceed0-f182-475b-9410-18f174240014") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429575    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd85f8dd7-kff2d: secret "image-registry-tls" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429613    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls podName:b097844c-2178-407b-b429-3a83390e0261 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:14.429599354 +0000 UTC m=+38.667794587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls") pod "image-registry-6fd85f8dd7-kff2d" (UID: "b097844c-2178-407b-b429-3a83390e0261") : secret "image-registry-tls" not found
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.429638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:13.429669 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429655    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 09:55:13.430162 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429679    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:14.429669694 +0000 UTC m=+38.667864923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : secret "router-metrics-certs-default" not found
Jul 23 09:55:13.430162 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:13.429721    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls podName:d4fc16e2-347d-4676-afe3-7b39abdf7a5f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:14.429714217 +0000 UTC m=+38.667909448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hrp9f" (UID: "d4fc16e2-347d-4676-afe3-7b39abdf7a5f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:13.435001 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.434970    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr" event={"ID":"f2e7fcc2-6ec7-4de7-859e-079b82922efc","Type":"ContainerStarted","Data":"6d1577e40449eff63d51054d400dded072c645781adecd6e6bb3edbcbcff8ea5"}
Jul 23 09:55:13.436075 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.436054    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7" event={"ID":"ca3e4373-64d7-4e96-83be-9a439763d123","Type":"ContainerStarted","Data":"a5601e1f9027a08a3e2d5a8e12748a5309ed3137a13c760629ce6f2059a70d78"}
Jul 23 09:55:13.437075 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.437056    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-dpdjn" event={"ID":"8ab152ad-c1e0-43a3-907b-6db993bbabf7","Type":"ContainerStarted","Data":"823886708f089edd2c0b8ce5d0074925d5697739dccf9d94eec90f0655818162"}
Jul 23 09:55:13.438044 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.438025    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" event={"ID":"7750c8de-1209-4e09-a4ba-720eb375f07b","Type":"ContainerStarted","Data":"aa3c48e5c93ad447c8a2a617a33e27c78c6cd13e0c076bd1ee455a09371ba97f"}
Jul 23 09:55:13.438963 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.438937    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jqh8v" event={"ID":"f3a8e806-0afc-4058-9116-cca6bfde7d98","Type":"ContainerStarted","Data":"c1eb0eb461f04681b27b17fe9033865038c8306a6f5ff1c5ed96a35d889d79d5"}
Jul 23 09:55:13.439865 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.439842    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw" event={"ID":"f117bef5-3c98-4c4f-a337-9459f67cd78f","Type":"ContainerStarted","Data":"aef80e2294e6c6f059cdcd80b5f628eee85dbda94e1249cd83a605a00ea84814"}
Jul 23 09:55:13.444322 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.444301    2567 generic.go:356] "Generic (PLEG): container finished" podID="350c77c7-2f2a-4516-943b-446441017528" containerID="c2980ccce3bbba02679b20a05e02cf3d3bee2e6a58326ed1e4089f25ca5d445e" exitCode=0
Jul 23 09:55:13.444417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.444346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" event={"ID":"350c77c7-2f2a-4516-943b-446441017528","Type":"ContainerDied","Data":"c2980ccce3bbba02679b20a05e02cf3d3bee2e6a58326ed1e4089f25ca5d445e"}
Jul 23 09:55:13.445423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:13.445406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl" event={"ID":"b1596cdd-d541-44ce-82b1-7523cc9b7345","Type":"ContainerStarted","Data":"0810f311809ad3cd3a3770072d52ad83c533ccd7bb07dc0dd2e0e11f3eaaeabe"}
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.439912    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.439969    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.440000    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.440044    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.440123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.440155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.440212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.440376    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.440439    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:16.440418885 +0000 UTC m=+40.678614119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : secret "router-metrics-certs-default" not found
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.440841    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.440896    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert podName:59d64ea9-f7cc-4292-947a-f905ff9f039a nodeName:}" failed. No retries permitted until 2026-07-23 09:55:16.440879246 +0000 UTC m=+40.679074498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-8wlsw" (UID: "59d64ea9-f7cc-4292-947a-f905ff9f039a") : secret "networking-console-plugin-cert" not found
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.440951    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.440983    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls podName:f5a119f2-7f76-4498-81fd-1c9574666ec2 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:16.440973203 +0000 UTC m=+40.679168439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-g4rnr" (UID: "f5a119f2-7f76-4498-81fd-1c9574666ec2") : secret "samples-operator-tls" not found
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.441042    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:16.441033201 +0000 UTC m=+40.679228435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : configmap references non-existent config key: service-ca.crt
Jul 23 09:55:14.441367 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.441091    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:14.442934 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.441119    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls podName:d4fc16e2-347d-4676-afe3-7b39abdf7a5f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:16.441110262 +0000 UTC m=+40.679305493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hrp9f" (UID: "d4fc16e2-347d-4676-afe3-7b39abdf7a5f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:14.442934 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.441177    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 09:55:14.442934 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.441187    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd85f8dd7-kff2d: secret "image-registry-tls" not found
Jul 23 09:55:14.442934 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.441213    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls podName:b097844c-2178-407b-b429-3a83390e0261 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:16.441204518 +0000 UTC m=+40.679399750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls") pod "image-registry-6fd85f8dd7-kff2d" (UID: "b097844c-2178-407b-b429-3a83390e0261") : secret "image-registry-tls" not found
Jul 23 09:55:14.442934 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.441288    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:14.442934 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:14.441318    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls podName:96cceed0-f182-475b-9410-18f174240014 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:16.441309154 +0000 UTC m=+40.679504389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls") pod "dns-default-xn2qz" (UID: "96cceed0-f182-475b-9410-18f174240014") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:14.467141 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.465979    2567 generic.go:356] "Generic (PLEG): container finished" podID="350c77c7-2f2a-4516-943b-446441017528" containerID="bd4cf5aa9f229e373ce247109a51957a62caa932ab3acb1ffcfd1627a620f5b5" exitCode=0
Jul 23 09:55:14.467141 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:14.466031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" event={"ID":"350c77c7-2f2a-4516-943b-446441017528","Type":"ContainerDied","Data":"bd4cf5aa9f229e373ce247109a51957a62caa932ab3acb1ffcfd1627a620f5b5"}
Jul 23 09:55:15.485197 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:15.483859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" event={"ID":"350c77c7-2f2a-4516-943b-446441017528","Type":"ContainerStarted","Data":"c7b29bc5b949386180df25edec52a70e2293bd4f336f505d73a7e0cb89af07ce"}
Jul 23 09:55:15.512555 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:15.512246    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5bzr5" podStartSLOduration=7.817586177 podStartE2EDuration="38.512205263s" totalImagesPullingTime="30.694619086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:15.508808592 +0000 UTC m=+39.747003844" watchObservedRunningTime="2026-07-23 09:55:15.512205263 +0000 UTC m=+39.750400519"
Jul 23 09:55:16.461163 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:16.461124    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:16.461363 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:16.461194    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:16.461363 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:16.461225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:16.461363 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:16.461283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:16.461363 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:16.461319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:16.461363 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461323    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:16.461363 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:16.461336    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:16.461363 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:16.461355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461368    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461373    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461394    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd85f8dd7-kff2d: secret "image-registry-tls" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461399    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls podName:d4fc16e2-347d-4676-afe3-7b39abdf7a5f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:20.46137786 +0000 UTC m=+44.699573093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hrp9f" (UID: "d4fc16e2-347d-4676-afe3-7b39abdf7a5f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461425    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls podName:96cceed0-f182-475b-9410-18f174240014 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:20.461408872 +0000 UTC m=+44.699604110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls") pod "dns-default-xn2qz" (UID: "96cceed0-f182-475b-9410-18f174240014") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461444    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls podName:b097844c-2178-407b-b429-3a83390e0261 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:20.461433998 +0000 UTC m=+44.699629228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls") pod "image-registry-6fd85f8dd7-kff2d" (UID: "b097844c-2178-407b-b429-3a83390e0261") : secret "image-registry-tls" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461456    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:20.461450439 +0000 UTC m=+44.699645669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : configmap references non-existent config key: service-ca.crt
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461466    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461478    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461466    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461525    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls podName:f5a119f2-7f76-4498-81fd-1c9574666ec2 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:20.461514095 +0000 UTC m=+44.699709328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-g4rnr" (UID: "f5a119f2-7f76-4498-81fd-1c9574666ec2") : secret "samples-operator-tls" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461563    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:20.461549053 +0000 UTC m=+44.699744282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : secret "router-metrics-certs-default" not found
Jul 23 09:55:16.461707 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:16.461579    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert podName:59d64ea9-f7cc-4292-947a-f905ff9f039a nodeName:}" failed. No retries permitted until 2026-07-23 09:55:20.461569994 +0000 UTC m=+44.699765233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-8wlsw" (UID: "59d64ea9-f7cc-4292-947a-f905ff9f039a") : secret "networking-console-plugin-cert" not found
Jul 23 09:55:20.500587 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:20.500551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:20.500595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:20.500624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:20.500692    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500717    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500736    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:28.500712792 +0000 UTC m=+52.738908024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : configmap references non-existent config key: service-ca.crt
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500764    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls podName:f5a119f2-7f76-4498-81fd-1c9574666ec2 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:28.500752645 +0000 UTC m=+52.738947901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-g4rnr" (UID: "f5a119f2-7f76-4498-81fd-1c9574666ec2") : secret "samples-operator-tls" not found
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:20.500763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500784    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500794    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd85f8dd7-kff2d: secret "image-registry-tls" not found
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500816    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:20.500822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500842    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls podName:b097844c-2178-407b-b429-3a83390e0261 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:28.500828175 +0000 UTC m=+52.739023426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls") pod "image-registry-6fd85f8dd7-kff2d" (UID: "b097844c-2178-407b-b429-3a83390e0261") : secret "image-registry-tls" not found
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500865    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls podName:d4fc16e2-347d-4676-afe3-7b39abdf7a5f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:28.500854378 +0000 UTC m=+52.739049612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hrp9f" (UID: "d4fc16e2-347d-4676-afe3-7b39abdf7a5f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500878    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 09:55:20.501308 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500907    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:28.500897782 +0000 UTC m=+52.739093012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : secret "router-metrics-certs-default" not found
Jul 23 09:55:20.501868 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:20.500925    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:20.501868 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500953    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:20.501868 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.500984    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls podName:96cceed0-f182-475b-9410-18f174240014 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:28.500976353 +0000 UTC m=+52.739171583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls") pod "dns-default-xn2qz" (UID: "96cceed0-f182-475b-9410-18f174240014") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:20.501868 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.501013    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 09:55:20.501868 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:20.501052    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert podName:59d64ea9-f7cc-4292-947a-f905ff9f039a nodeName:}" failed. No retries permitted until 2026-07-23 09:55:28.501042411 +0000 UTC m=+52.739237644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-8wlsw" (UID: "59d64ea9-f7cc-4292-947a-f905ff9f039a") : secret "networking-console-plugin-cert" not found
Jul 23 09:55:21.502297 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.502185    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7" event={"ID":"ca3e4373-64d7-4e96-83be-9a439763d123","Type":"ContainerStarted","Data":"11aea78c4631f89cc13de2c7ce064e8f52ef76c8c5bd688f5c646c80e19ecde9"}
Jul 23 09:55:21.504610 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.504585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-dpdjn" event={"ID":"8ab152ad-c1e0-43a3-907b-6db993bbabf7","Type":"ContainerStarted","Data":"2ea256da132dfda20ceddebce11d867b0327763a06ebb627c21a5fbf1083df42"}
Jul 23 09:55:21.506864 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.506841    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/0.log"
Jul 23 09:55:21.506998 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.506880    2567 generic.go:356] "Generic (PLEG): container finished" podID="7750c8de-1209-4e09-a4ba-720eb375f07b" containerID="521baf68bb85a75e7a4d56d3c9415482b7ee6fe657e1aefb71810e79b6138a4d" exitCode=255
Jul 23 09:55:21.507136 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.507090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" event={"ID":"7750c8de-1209-4e09-a4ba-720eb375f07b","Type":"ContainerDied","Data":"521baf68bb85a75e7a4d56d3c9415482b7ee6fe657e1aefb71810e79b6138a4d"}
Jul 23 09:55:21.507260 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.507190    2567 scope.go:117] "RemoveContainer" containerID="521baf68bb85a75e7a4d56d3c9415482b7ee6fe657e1aefb71810e79b6138a4d"
Jul 23 09:55:21.508937 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.508879    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jqh8v" event={"ID":"f3a8e806-0afc-4058-9116-cca6bfde7d98","Type":"ContainerStarted","Data":"187cc1cf26362bc8bb8b2268f736087a9b85b5116e334db45a07b88b88bd2579"}
Jul 23 09:55:21.521542 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.518457    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-dbbg7" podStartSLOduration=24.68458794 podStartE2EDuration="32.518437436s" totalImagesPullingTime="7.833849496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:21.518179617 +0000 UTC m=+45.756374873" watchObservedRunningTime="2026-07-23 09:55:21.518437436 +0000 UTC m=+45.756632688"
Jul 23 09:55:21.521542 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.519141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw" event={"ID":"f117bef5-3c98-4c4f-a337-9459f67cd78f","Type":"ContainerStarted","Data":"c8a47ea665cdce31b2afeee4e003f7643acc74e71b5fa5bd7bdaa6357ff56aff"}
Jul 23 09:55:21.524643 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.524618    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl" event={"ID":"b1596cdd-d541-44ce-82b1-7523cc9b7345","Type":"ContainerStarted","Data":"609351bde54ad325338f12d8077f7197ecad0f28e238da57d9510950733b9827"}
Jul 23 09:55:21.526521 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.526495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr" event={"ID":"f2e7fcc2-6ec7-4de7-859e-079b82922efc","Type":"ContainerStarted","Data":"b6916f09fd8d345e106e10eff31c27ebddf9f493d126cfe19ec03153cbfd743e"}
Jul 23 09:55:21.556975 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.556927    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jqh8v" podStartSLOduration=1.756034191 podStartE2EDuration="9.556906662s" totalImagesPullingTime="7.800872471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:21.556748543 +0000 UTC m=+45.794943821" watchObservedRunningTime="2026-07-23 09:55:21.556906662 +0000 UTC m=+45.795101913"
Jul 23 09:55:21.578265 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.576122    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-dpdjn" podStartSLOduration=24.739637902 podStartE2EDuration="32.576095505s" totalImagesPullingTime="7.836457603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:21.57447049 +0000 UTC m=+45.812665742" watchObservedRunningTime="2026-07-23 09:55:21.576095505 +0000 UTC m=+45.814290751"
Jul 23 09:55:21.599749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.599697    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw" podStartSLOduration=24.680816031 podStartE2EDuration="32.599676028s" totalImagesPullingTime="7.918859997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:21.598669546 +0000 UTC m=+45.836864806" watchObservedRunningTime="2026-07-23 09:55:21.599676028 +0000 UTC m=+45.837871281"
Jul 23 09:55:21.618219 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:21.617483    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl" podStartSLOduration=24.758703957 podStartE2EDuration="32.617465542s" totalImagesPullingTime="7.858761585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:21.617462156 +0000 UTC m=+45.855657411" watchObservedRunningTime="2026-07-23 09:55:21.617465542 +0000 UTC m=+45.855660796"
Jul 23 09:55:22.532055 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.531976    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/1.log"
Jul 23 09:55:22.532523 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.532445    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/0.log"
Jul 23 09:55:22.532523 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.532477    2567 generic.go:356] "Generic (PLEG): container finished" podID="7750c8de-1209-4e09-a4ba-720eb375f07b" containerID="dfb1ec4a468aacf2a71f2e7e630a8ce6dd53d1034448541bd4006d1b137410f9" exitCode=255
Jul 23 09:55:22.533881 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.532836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" event={"ID":"7750c8de-1209-4e09-a4ba-720eb375f07b","Type":"ContainerDied","Data":"dfb1ec4a468aacf2a71f2e7e630a8ce6dd53d1034448541bd4006d1b137410f9"}
Jul 23 09:55:22.533881 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.532893    2567 scope.go:117] "RemoveContainer" containerID="521baf68bb85a75e7a4d56d3c9415482b7ee6fe657e1aefb71810e79b6138a4d"
Jul 23 09:55:22.533881 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.533457    2567 scope.go:117] "RemoveContainer" containerID="dfb1ec4a468aacf2a71f2e7e630a8ce6dd53d1034448541bd4006d1b137410f9"
Jul 23 09:55:22.533881 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:22.533619    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2hvdb_openshift-console-operator(7750c8de-1209-4e09-a4ba-720eb375f07b)\"" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" podUID="7750c8de-1209-4e09-a4ba-720eb375f07b"
Jul 23 09:55:22.554686 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.554638    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8fqmr" podStartSLOduration=25.737120306 podStartE2EDuration="33.554621961s" totalImagesPullingTime="7.817501655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:21.637790274 +0000 UTC m=+45.875985551" watchObservedRunningTime="2026-07-23 09:55:22.554621961 +0000 UTC m=+46.792817204"
Jul 23 09:55:22.566062 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.566023    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vjhk5"]
Jul 23 09:55:22.603537 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.602827    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vjhk5"]
Jul 23 09:55:22.603537 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.602938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.606009 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.605977    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 09:55:22.606162 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.606142    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 09:55:22.606400 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.606384    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96kbl\""
Jul 23 09:55:22.624069 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.624037    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.624182 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.624125    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz8g2\" (UniqueName: \"kubernetes.io/projected/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-api-access-lz8g2\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.624294 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.624272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7bed865b-e7a5-420d-ac41-9fab6d00035b-crio-socket\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.624380 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.624364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.624455 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.624442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bed865b-e7a5-420d-ac41-9fab6d00035b-data-volume\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.725710 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.725669    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bed865b-e7a5-420d-ac41-9fab6d00035b-data-volume\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.725881 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.725804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.725881 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.725852    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz8g2\" (UniqueName: \"kubernetes.io/projected/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-api-access-lz8g2\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.725995 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.725900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7bed865b-e7a5-420d-ac41-9fab6d00035b-crio-socket\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.725995 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:22.725933    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 09:55:22.725995 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.725961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.726151 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:22.726015    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:23.225992604 +0000 UTC m=+47.464187839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : configmap "kube-rbac-proxy" not found
Jul 23 09:55:22.726151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.726034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bed865b-e7a5-420d-ac41-9fab6d00035b-data-volume\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.726151 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:22.726072    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:22.726151 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:22.726123    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:23.226108864 +0000 UTC m=+47.464304100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:22.726422 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.726309    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7bed865b-e7a5-420d-ac41-9fab6d00035b-crio-socket\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:22.743057 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:22.743027    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz8g2\" (UniqueName: \"kubernetes.io/projected/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-api-access-lz8g2\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:23.009721 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:23.009680    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:23.009914 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:23.009761    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:23.231502 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:23.231467    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:23.231660 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:23.231570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:23.231660 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:23.231622    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:23.231660 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:23.231651    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 09:55:23.231754 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:23.231684    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:24.231669728 +0000 UTC m=+48.469864960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:23.231754 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:23.231704    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:24.231694975 +0000 UTC m=+48.469890211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : configmap "kube-rbac-proxy" not found
Jul 23 09:55:23.538277 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:23.538229    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/1.log"
Jul 23 09:55:23.538653 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:23.538579    2567 scope.go:117] "RemoveContainer" containerID="dfb1ec4a468aacf2a71f2e7e630a8ce6dd53d1034448541bd4006d1b137410f9"
Jul 23 09:55:23.538745 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:23.538726    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2hvdb_openshift-console-operator(7750c8de-1209-4e09-a4ba-720eb375f07b)\"" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" podUID="7750c8de-1209-4e09-a4ba-720eb375f07b"
Jul 23 09:55:24.239777 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:24.239740    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:24.239924 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:24.239834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:24.239924 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:24.239852    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 09:55:24.239924 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:24.239911    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:26.239895506 +0000 UTC m=+50.478090736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : configmap "kube-rbac-proxy" not found
Jul 23 09:55:24.240055 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:24.239924    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:24.240055 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:24.239968    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:26.239955664 +0000 UTC m=+50.478150896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:24.541266 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:24.541182    2567 scope.go:117] "RemoveContainer" containerID="dfb1ec4a468aacf2a71f2e7e630a8ce6dd53d1034448541bd4006d1b137410f9"
Jul 23 09:55:24.541631 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:24.541372    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2hvdb_openshift-console-operator(7750c8de-1209-4e09-a4ba-720eb375f07b)\"" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" podUID="7750c8de-1209-4e09-a4ba-720eb375f07b"
Jul 23 09:55:24.761106 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:24.761078    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xtvrq_e7bdd090-55e9-44f4-b09f-17021a14f169/dns-node-resolver/0.log"
Jul 23 09:55:25.361520 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:25.361493    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8pml_90f3e1db-0b1f-497a-af08-c6d7587c7c8b/node-ca/0.log"
Jul 23 09:55:26.161687 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:26.161650    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jqh8v_f3a8e806-0afc-4058-9116-cca6bfde7d98/serve-healthcheck-canary/0.log"
Jul 23 09:55:26.258486 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:26.258451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:26.258665 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:26.258582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:26.258665 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:26.258585    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:26.258780 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:26.258621    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 09:55:26.258780 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:26.258724    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:30.258682396 +0000 UTC m=+54.496877644 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:26.258780 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:26.258745    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:30.258733966 +0000 UTC m=+54.496929200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : configmap "kube-rbac-proxy" not found
Jul 23 09:55:28.578970 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:28.578938    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:28.578977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:28.578997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:28.579023    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:28.579073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579116    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579146    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579117    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579159    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fd85f8dd7-kff2d: secret "image-registry-tls" not found
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579161    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:44.579137567 +0000 UTC m=+68.817332820 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : configmap references non-existent config key: service-ca.crt
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579187    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert podName:59d64ea9-f7cc-4292-947a-f905ff9f039a nodeName:}" failed. No retries permitted until 2026-07-23 09:55:44.579173979 +0000 UTC m=+68.817369209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-8wlsw" (UID: "59d64ea9-f7cc-4292-947a-f905ff9f039a") : secret "networking-console-plugin-cert" not found
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579193    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:28.579205    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579258    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls podName:d4fc16e2-347d-4676-afe3-7b39abdf7a5f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:44.579224358 +0000 UTC m=+68.817419587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-hrp9f" (UID: "d4fc16e2-347d-4676-afe3-7b39abdf7a5f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579277    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:28.579313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:28.579473 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579325    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls podName:96cceed0-f182-475b-9410-18f174240014 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:44.579311914 +0000 UTC m=+68.817507148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls") pod "dns-default-xn2qz" (UID: "96cceed0-f182-475b-9410-18f174240014") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:28.579951 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579366    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls podName:b097844c-2178-407b-b429-3a83390e0261 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:44.579347763 +0000 UTC m=+68.817542994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls") pod "image-registry-6fd85f8dd7-kff2d" (UID: "b097844c-2178-407b-b429-3a83390e0261") : secret "image-registry-tls" not found
Jul 23 09:55:28.579951 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579378    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 09:55:28.579951 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579393    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls podName:f5a119f2-7f76-4498-81fd-1c9574666ec2 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:44.579385443 +0000 UTC m=+68.817580673 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-g4rnr" (UID: "f5a119f2-7f76-4498-81fd-1c9574666ec2") : secret "samples-operator-tls" not found
Jul 23 09:55:28.579951 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:28.579408    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs podName:2b55c9a2-3b56-4a4f-823e-d63f3fad1631 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:44.579402586 +0000 UTC m=+68.817597816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs") pod "router-default-7b6fb8b4bb-rcggg" (UID: "2b55c9a2-3b56-4a4f-823e-d63f3fad1631") : secret "router-metrics-certs-default" not found
Jul 23 09:55:30.295948 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:30.295921    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:30.296490 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:30.296065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:30.296490 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:30.296069    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:30.296490 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:30.296180    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls podName:7bed865b-e7a5-420d-ac41-9fab6d00035b nodeName:}" failed. No retries permitted until 2026-07-23 09:55:38.296160791 +0000 UTC m=+62.534356025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjhk5" (UID: "7bed865b-e7a5-420d-ac41-9fab6d00035b") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:30.296637 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:30.296556    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7bed865b-e7a5-420d-ac41-9fab6d00035b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:37.433461 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:37.433429    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-csr99"
Jul 23 09:55:38.368932 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:38.368901    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:38.371344 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:38.371318    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7bed865b-e7a5-420d-ac41-9fab6d00035b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjhk5\" (UID: \"7bed865b-e7a5-420d-ac41-9fab6d00035b\") " pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:38.515392 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:38.515366    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96kbl\""
Jul 23 09:55:38.523813 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:38.523791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vjhk5"
Jul 23 09:55:38.648499 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:38.648430    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vjhk5"]
Jul 23 09:55:38.650908 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:38.650881    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bed865b_e7a5_420d_ac41_9fab6d00035b.slice/crio-afd4e26fb5997164d5e80fe98f7cc0076423c09a19fc72d5501feb943586a92d WatchSource:0}: Error finding container afd4e26fb5997164d5e80fe98f7cc0076423c09a19fc72d5501feb943586a92d: Status 404 returned error can't find the container with id afd4e26fb5997164d5e80fe98f7cc0076423c09a19fc72d5501feb943586a92d
Jul 23 09:55:39.226203 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:39.226175    2567 scope.go:117] "RemoveContainer" containerID="dfb1ec4a468aacf2a71f2e7e630a8ce6dd53d1034448541bd4006d1b137410f9"
Jul 23 09:55:39.585512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:39.585435    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 09:55:39.585878 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:39.585809    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/1.log"
Jul 23 09:55:39.585878 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:39.585837    2567 generic.go:356] "Generic (PLEG): container finished" podID="7750c8de-1209-4e09-a4ba-720eb375f07b" containerID="8a6a12e8843bb8a95f059c68233ce4657f4718a7d57c8bd37fe5d8220bd8fa76" exitCode=255
Jul 23 09:55:39.585969 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:39.585907    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" event={"ID":"7750c8de-1209-4e09-a4ba-720eb375f07b","Type":"ContainerDied","Data":"8a6a12e8843bb8a95f059c68233ce4657f4718a7d57c8bd37fe5d8220bd8fa76"}
Jul 23 09:55:39.585969 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:39.585964    2567 scope.go:117] "RemoveContainer" containerID="dfb1ec4a468aacf2a71f2e7e630a8ce6dd53d1034448541bd4006d1b137410f9"
Jul 23 09:55:39.586319 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:39.586299    2567 scope.go:117] "RemoveContainer" containerID="8a6a12e8843bb8a95f059c68233ce4657f4718a7d57c8bd37fe5d8220bd8fa76"
Jul 23 09:55:39.586502 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:39.586480    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-2hvdb_openshift-console-operator(7750c8de-1209-4e09-a4ba-720eb375f07b)\"" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" podUID="7750c8de-1209-4e09-a4ba-720eb375f07b"
Jul 23 09:55:39.587113 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:39.587030    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjhk5" event={"ID":"7bed865b-e7a5-420d-ac41-9fab6d00035b","Type":"ContainerStarted","Data":"afd4e26fb5997164d5e80fe98f7cc0076423c09a19fc72d5501feb943586a92d"}
Jul 23 09:55:40.594830 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:40.594790    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 09:55:41.901478 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:41.901443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:41.904186 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:41.904163    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 09:55:41.914721 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:41.914696    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1946fb9c-00aa-446d-be1e-cecb14f56b61-original-pull-secret\") pod \"global-pull-secret-syncer-469fj\" (UID: \"1946fb9c-00aa-446d-be1e-cecb14f56b61\") " pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:42.002198 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.002161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:42.002198 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.002205    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:42.004870 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.004847    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 09:55:42.005143 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.005120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlnjc\" (UniqueName: \"kubernetes.io/projected/e4021391-ecd4-41d7-b920-0bfc4e53f1f3-kube-api-access-mlnjc\") pod \"network-check-target-d9tj9\" (UID: \"e4021391-ecd4-41d7-b920-0bfc4e53f1f3\") " pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:42.015359 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.015332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87e4cb8a-8ecb-4829-b778-dc8fc8d75d41-metrics-certs\") pod \"network-metrics-daemon-bsrb2\" (UID: \"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41\") " pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:42.047600 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.047574    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-469fj"
Jul 23 09:55:42.064504 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.064467    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5t7cr\""
Jul 23 09:55:42.068288 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.068262    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ztznw\""
Jul 23 09:55:42.072308 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.072289    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:42.076644 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:42.076616    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bsrb2"
Jul 23 09:55:43.010048 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:43.010008    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:43.010508 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:43.010307    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:55:43.010802 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:43.010785    2567 scope.go:117] "RemoveContainer" containerID="8a6a12e8843bb8a95f059c68233ce4657f4718a7d57c8bd37fe5d8220bd8fa76"
Jul 23 09:55:43.011001 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:43.010972    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-2hvdb_openshift-console-operator(7750c8de-1209-4e09-a4ba-720eb375f07b)\"" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" podUID="7750c8de-1209-4e09-a4ba-720eb375f07b"
Jul 23 09:55:43.604365 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:43.604335    2567 scope.go:117] "RemoveContainer" containerID="8a6a12e8843bb8a95f059c68233ce4657f4718a7d57c8bd37fe5d8220bd8fa76"
Jul 23 09:55:43.604554 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:43.604492    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-2hvdb_openshift-console-operator(7750c8de-1209-4e09-a4ba-720eb375f07b)\"" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" podUID="7750c8de-1209-4e09-a4ba-720eb375f07b"
Jul 23 09:55:44.142179 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.142145    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bsrb2"]
Jul 23 09:55:44.145571 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:44.145539    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e4cb8a_8ecb_4829_b778_dc8fc8d75d41.slice/crio-6cd57598d8def3fa364d64c6618b7558e6e3ea2da6e1349ea5be388c702c001d WatchSource:0}: Error finding container 6cd57598d8def3fa364d64c6618b7558e6e3ea2da6e1349ea5be388c702c001d: Status 404 returned error can't find the container with id 6cd57598d8def3fa364d64c6618b7558e6e3ea2da6e1349ea5be388c702c001d
Jul 23 09:55:44.363164 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.363133    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-469fj"]
Jul 23 09:55:44.366579 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:44.366548    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1946fb9c_00aa_446d_be1e_cecb14f56b61.slice/crio-90dbfeeaae77928d2de5b0181992e8e6f3dfa98e91c1fa7638a3b718e298d409 WatchSource:0}: Error finding container 90dbfeeaae77928d2de5b0181992e8e6f3dfa98e91c1fa7638a3b718e298d409: Status 404 returned error can't find the container with id 90dbfeeaae77928d2de5b0181992e8e6f3dfa98e91c1fa7638a3b718e298d409
Jul 23 09:55:44.367397 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.367375    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d9tj9"]
Jul 23 09:55:44.369989 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:44.369905    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4021391_ecd4_41d7_b920_0bfc4e53f1f3.slice/crio-6bc027fa1bc94768a64229411eb15e036c0da300a88c286a7e53cad0aa3420e0 WatchSource:0}: Error finding container 6bc027fa1bc94768a64229411eb15e036c0da300a88c286a7e53cad0aa3420e0: Status 404 returned error can't find the container with id 6bc027fa1bc94768a64229411eb15e036c0da300a88c286a7e53cad0aa3420e0
Jul 23 09:55:44.608086 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.608050    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsrb2" event={"ID":"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41","Type":"ContainerStarted","Data":"6cd57598d8def3fa364d64c6618b7558e6e3ea2da6e1349ea5be388c702c001d"}
Jul 23 09:55:44.609367 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.609343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjhk5" event={"ID":"7bed865b-e7a5-420d-ac41-9fab6d00035b","Type":"ContainerStarted","Data":"ebb783ca4feca841523a7346464f9bf4bc88ac138cfce61c3f5767e6228b51a1"}
Jul 23 09:55:44.610385 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.610363    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-469fj" event={"ID":"1946fb9c-00aa-446d-be1e-cecb14f56b61","Type":"ContainerStarted","Data":"90dbfeeaae77928d2de5b0181992e8e6f3dfa98e91c1fa7638a3b718e298d409"}
Jul 23 09:55:44.611737 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.611716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d9tj9" event={"ID":"e4021391-ecd4-41d7-b920-0bfc4e53f1f3","Type":"ContainerStarted","Data":"31f2a57ab148984a302ad86c22fd03e06d4fb130caff46351de70d64a8943862"}
Jul 23 09:55:44.611818 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.611755    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d9tj9" event={"ID":"e4021391-ecd4-41d7-b920-0bfc4e53f1f3","Type":"ContainerStarted","Data":"6bc027fa1bc94768a64229411eb15e036c0da300a88c286a7e53cad0aa3420e0"}
Jul 23 09:55:44.611885 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.611849    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:55:44.624590 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.624527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:44.624590 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.624562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:44.624768 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.624598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:44.624768 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.624659    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:44.624768 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.624688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:44.624768 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.624716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:44.624768 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.624746    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:44.625774 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.625745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-service-ca-bundle\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:44.627319 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.627292    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96cceed0-f182-475b-9410-18f174240014-metrics-tls\") pod \"dns-default-xn2qz\" (UID: \"96cceed0-f182-475b-9410-18f174240014\") " pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:44.627425 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.627348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f5a119f2-7f76-4498-81fd-1c9574666ec2-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-g4rnr\" (UID: \"f5a119f2-7f76-4498-81fd-1c9574666ec2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:44.627584 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.627561    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55c9a2-3b56-4a4f-823e-d63f3fad1631-metrics-certs\") pod \"router-default-7b6fb8b4bb-rcggg\" (UID: \"2b55c9a2-3b56-4a4f-823e-d63f3fad1631\") " pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:44.627584 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.627587    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d64ea9-f7cc-4292-947a-f905ff9f039a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-8wlsw\" (UID: \"59d64ea9-f7cc-4292-947a-f905ff9f039a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:44.627748 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.627694    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"image-registry-6fd85f8dd7-kff2d\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") " pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:44.627831 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.627813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4fc16e2-347d-4676-afe3-7b39abdf7a5f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-hrp9f\" (UID: \"d4fc16e2-347d-4676-afe3-7b39abdf7a5f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:44.791376 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.791342    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8c4kr\""
Jul 23 09:55:44.799546 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.799526    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"
Jul 23 09:55:44.818154 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.818131    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dsnq4\""
Jul 23 09:55:44.826159 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.826139    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:44.830478 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.830456    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n9bpc\""
Jul 23 09:55:44.838442 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.838420    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"
Jul 23 09:55:44.842813 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.842797    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vtvtf\""
Jul 23 09:55:44.850776 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.850759    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:44.854322 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.854303    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rrggk\""
Jul 23 09:55:44.862376 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.862352    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"
Jul 23 09:55:44.864582 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.864566    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdkgf\""
Jul 23 09:55:44.872639 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.872621    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:44.984428 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.984348    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d9tj9" podStartSLOduration=67.984322358 podStartE2EDuration="1m7.984322358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:44.628027187 +0000 UTC m=+68.866222451" watchObservedRunningTime="2026-07-23 09:55:44.984322358 +0000 UTC m=+69.222517607"
Jul 23 09:55:44.985900 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:44.985656    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f"]
Jul 23 09:55:45.058763 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.058679    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b6fb8b4bb-rcggg"]
Jul 23 09:55:45.111624 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.111550    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr"]
Jul 23 09:55:45.137425 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.137400    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xn2qz"]
Jul 23 09:55:45.146329 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:45.146268    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96cceed0_f182_475b_9410_18f174240014.slice/crio-f574f51ec60abf5ef757b10b51ca29c229940417f40c70c4050c727d32512b66 WatchSource:0}: Error finding container f574f51ec60abf5ef757b10b51ca29c229940417f40c70c4050c727d32512b66: Status 404 returned error can't find the container with id f574f51ec60abf5ef757b10b51ca29c229940417f40c70c4050c727d32512b66
Jul 23 09:55:45.162507 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.162443    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw"]
Jul 23 09:55:45.166060 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:45.166035    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d64ea9_f7cc_4292_947a_f905ff9f039a.slice/crio-31f9fe53e4f4609e1ceb212ab8983b2b8739df44dd95e34a810801716c73e9d7 WatchSource:0}: Error finding container 31f9fe53e4f4609e1ceb212ab8983b2b8739df44dd95e34a810801716c73e9d7: Status 404 returned error can't find the container with id 31f9fe53e4f4609e1ceb212ab8983b2b8739df44dd95e34a810801716c73e9d7
Jul 23 09:55:45.183015 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.182991    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fd85f8dd7-kff2d"]
Jul 23 09:55:45.185224 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:55:45.185202    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb097844c_2178_407b_b429_3a83390e0261.slice/crio-98aa49c3ad5a5a8a784780f77deee5ab2c55c8c0161eb640fb6db5465e3fe205 WatchSource:0}: Error finding container 98aa49c3ad5a5a8a784780f77deee5ab2c55c8c0161eb640fb6db5465e3fe205: Status 404 returned error can't find the container with id 98aa49c3ad5a5a8a784780f77deee5ab2c55c8c0161eb640fb6db5465e3fe205
Jul 23 09:55:45.620780 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.620742    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d" event={"ID":"b097844c-2178-407b-b429-3a83390e0261","Type":"ContainerStarted","Data":"8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596"}
Jul 23 09:55:45.620942 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.620855    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d" event={"ID":"b097844c-2178-407b-b429-3a83390e0261","Type":"ContainerStarted","Data":"98aa49c3ad5a5a8a784780f77deee5ab2c55c8c0161eb640fb6db5465e3fe205"}
Jul 23 09:55:45.621399 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.621335    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:55:45.623191 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.623164    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xn2qz" event={"ID":"96cceed0-f182-475b-9410-18f174240014","Type":"ContainerStarted","Data":"f574f51ec60abf5ef757b10b51ca29c229940417f40c70c4050c727d32512b66"}
Jul 23 09:55:45.624929 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.624890    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg" event={"ID":"2b55c9a2-3b56-4a4f-823e-d63f3fad1631","Type":"ContainerStarted","Data":"deb8d2ee714c4d1e242c6c127cfc85250b6f1dd2c58a9f9bed801c4b8c138fae"}
Jul 23 09:55:45.625021 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.624956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg" event={"ID":"2b55c9a2-3b56-4a4f-823e-d63f3fad1631","Type":"ContainerStarted","Data":"c3062fbc2b8c14c595fbccb853277ee4bef869b6ef805f24b0f9aa6407ce64b6"}
Jul 23 09:55:45.627523 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.627497    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw" event={"ID":"59d64ea9-f7cc-4292-947a-f905ff9f039a","Type":"ContainerStarted","Data":"31f9fe53e4f4609e1ceb212ab8983b2b8739df44dd95e34a810801716c73e9d7"}
Jul 23 09:55:45.629024 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.629002    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr" event={"ID":"f5a119f2-7f76-4498-81fd-1c9574666ec2","Type":"ContainerStarted","Data":"54e6dc6e90956f50b5f9a3244538d703c90d0f5455b0d0900683959f297603bd"}
Jul 23 09:55:45.630719 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.630695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f" event={"ID":"d4fc16e2-347d-4676-afe3-7b39abdf7a5f","Type":"ContainerStarted","Data":"76ad62f399a704b2d35b85c5e542a10a0880f2e284fa278a433415d38d2df220"}
Jul 23 09:55:45.634528 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.634498    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fd85f8dd7-kff2d"]
Jul 23 09:55:45.741067 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.741011    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d" podStartSLOduration=56.740989972 podStartE2EDuration="56.740989972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:45.678919925 +0000 UTC m=+69.917115184" watchObservedRunningTime="2026-07-23 09:55:45.740989972 +0000 UTC m=+69.979185227"
Jul 23 09:55:45.741497 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.741464    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg" podStartSLOduration=56.741453591 podStartE2EDuration="56.741453591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:45.74109274 +0000 UTC m=+69.979287992" watchObservedRunningTime="2026-07-23 09:55:45.741453591 +0000 UTC m=+69.979648845"
Jul 23 09:55:45.827431 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.827369    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:45.830307 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:45.830085    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:46.641081 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:46.641049    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsrb2" event={"ID":"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41","Type":"ContainerStarted","Data":"6b7b0112b4c9b0662f1cb5c1d70ac179a93a2e691f70d550f65fe521bd88dac2"}
Jul 23 09:55:46.641579 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:46.641107    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bsrb2" event={"ID":"87e4cb8a-8ecb-4829-b778-dc8fc8d75d41","Type":"ContainerStarted","Data":"55a8c94ac9f39e7b2aa2287195b3972a6263518176844cdf69f55d5683e00adc"}
Jul 23 09:55:46.642273 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:46.642251    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:46.643384 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:46.643365    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b6fb8b4bb-rcggg"
Jul 23 09:55:46.658915 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:46.658863    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bsrb2" podStartSLOduration=67.70326074 podStartE2EDuration="1m9.658844561s" totalImagesPullingTime="1.955583821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:46.655832965 +0000 UTC m=+70.894028238" watchObservedRunningTime="2026-07-23 09:55:46.658844561 +0000 UTC m=+70.897039811"
Jul 23 09:55:53.667931 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.667884    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xn2qz" event={"ID":"96cceed0-f182-475b-9410-18f174240014","Type":"ContainerStarted","Data":"6a02ae3f2c950f8d3eda0e77b00f67949372186efe2782bcfade35f8e8002005"}
Jul 23 09:55:53.668439 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.668080    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:55:53.668439 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.668113    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xn2qz" event={"ID":"96cceed0-f182-475b-9410-18f174240014","Type":"ContainerStarted","Data":"9ab8085d09e8f91ecbca08274568fc7fc90c955d03198fb2d9feae64459f8ac7"}
Jul 23 09:55:53.669386 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.669342    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw" event={"ID":"59d64ea9-f7cc-4292-947a-f905ff9f039a","Type":"ContainerStarted","Data":"a3cd8594e34c44e737bd5f88bd2f82818571db32acf2209fdb8f9de10b452816"}
Jul 23 09:55:53.671070 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.671033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr" event={"ID":"f5a119f2-7f76-4498-81fd-1c9574666ec2","Type":"ContainerStarted","Data":"660e42f56248786025cab1cfc83c35da05111a6a907539d09d69e6a8d0ebf3f1"}
Jul 23 09:55:53.671202 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.671098    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr" event={"ID":"f5a119f2-7f76-4498-81fd-1c9574666ec2","Type":"ContainerStarted","Data":"67223977cc839063a4d4814de332e3d4350d4f548bd91e6ee1434c6379743e69"}
Jul 23 09:55:53.672861 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.672836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f" event={"ID":"d4fc16e2-347d-4676-afe3-7b39abdf7a5f","Type":"ContainerStarted","Data":"335a183f2754b8ee30e226126c66873546bb1ba6906b422c6d73c6a8f170f879"}
Jul 23 09:55:53.675122 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.675099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjhk5" event={"ID":"7bed865b-e7a5-420d-ac41-9fab6d00035b","Type":"ContainerStarted","Data":"d406cff21112e7e283c33a9e6466d269317f8b42e449a23f2c980a80bf2e7a1b"}
Jul 23 09:55:53.676501 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.676480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-469fj" event={"ID":"1946fb9c-00aa-446d-be1e-cecb14f56b61","Type":"ContainerStarted","Data":"63a83a652ad3d15477bf38a93ef13ad4d47283e46372c72ff335c13d95cb071d"}
Jul 23 09:55:53.685821 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.685775    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xn2qz" podStartSLOduration=34.064527254 podStartE2EDuration="41.685760426s" totalImagesPullingTime="7.621233172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:53.68480032 +0000 UTC m=+77.922995576" watchObservedRunningTime="2026-07-23 09:55:53.685760426 +0000 UTC m=+77.923955678"
Jul 23 09:55:53.699983 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.699938    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-8wlsw" podStartSLOduration=37.104420484 podStartE2EDuration="44.699924083s" totalImagesPullingTime="7.595503599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:53.699168114 +0000 UTC m=+77.937363367" watchObservedRunningTime="2026-07-23 09:55:53.699924083 +0000 UTC m=+77.938119396"
Jul 23 09:55:53.714862 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.714811    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-hrp9f" podStartSLOduration=56.948761817 podStartE2EDuration="1m4.71479168s" totalImagesPullingTime="7.766029863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:53.714364694 +0000 UTC m=+77.952559971" watchObservedRunningTime="2026-07-23 09:55:53.71479168 +0000 UTC m=+77.952986934"
Jul 23 09:55:53.734512 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.734469    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-g4rnr" podStartSLOduration=57.165340254 podStartE2EDuration="1m4.734456145s" totalImagesPullingTime="7.569115891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:53.732996451 +0000 UTC m=+77.971191730" watchObservedRunningTime="2026-07-23 09:55:53.734456145 +0000 UTC m=+77.972651397"
Jul 23 09:55:53.749399 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:53.749348    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-469fj" podStartSLOduration=68.35548147 podStartE2EDuration="1m16.749331254s" totalImagesPullingTime="8.393849784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:53.748108514 +0000 UTC m=+77.986303766" watchObservedRunningTime="2026-07-23 09:55:53.749331254 +0000 UTC m=+77.987526507"
Jul 23 09:55:57.226090 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:57.225982    2567 scope.go:117] "RemoveContainer" containerID="8a6a12e8843bb8a95f059c68233ce4657f4718a7d57c8bd37fe5d8220bd8fa76"
Jul 23 09:55:57.226453 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:55:57.226181    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-2hvdb_openshift-console-operator(7750c8de-1209-4e09-a4ba-720eb375f07b)\"" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" podUID="7750c8de-1209-4e09-a4ba-720eb375f07b"
Jul 23 09:55:57.696222 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:57.696187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjhk5" event={"ID":"7bed865b-e7a5-420d-ac41-9fab6d00035b","Type":"ContainerStarted","Data":"cb3b587808d8c8a9cd0b12a0cbfedfd8b570bbdacf6eaabcd3c69223878c1432"}
Jul 23 09:55:57.713867 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:55:57.713821    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vjhk5" podStartSLOduration=17.370623137 podStartE2EDuration="35.71380497s" totalImagesPullingTime="18.343181833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:55:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:57.712697325 +0000 UTC m=+81.950892576" watchObservedRunningTime="2026-07-23 09:55:57.71380497 +0000 UTC m=+81.952000238"
Jul 23 09:56:03.682700 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:03.682669    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xn2qz"
Jul 23 09:56:05.808678 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.808645    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"]
Jul 23 09:56:05.811914 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.811895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.814536 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.814509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 09:56:05.814671 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.814555    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mjwn8\""
Jul 23 09:56:05.814744 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.814683    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 09:56:05.815588 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.815574    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 09:56:05.829351 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.829325    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"]
Jul 23 09:56:05.853228 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.853197    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nwzjw"]
Jul 23 09:56:05.855933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.855917    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.858588 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.858570    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 09:56:05.858705 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.858621    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4ftdv\""
Jul 23 09:56:05.858705 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.858625    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 09:56:05.858895 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.858881    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 09:56:05.888036 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-sys\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.888036 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888037    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-metrics-client-ca\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.888230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888056    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.888230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmff6\" (UniqueName: \"kubernetes.io/projected/f682521f-36cb-4fb1-a409-9392e9d9286f-kube-api-access-vmff6\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.888230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-textfile\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.888230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888194    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f682521f-36cb-4fb1-a409-9392e9d9286f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.888230 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f682521f-36cb-4fb1-a409-9392e9d9286f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.888423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888265    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-tls\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.888423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f682521f-36cb-4fb1-a409-9392e9d9286f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.888423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-wtmp\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.888423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888352    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.888423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-root\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.888423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.888388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc6jg\" (UniqueName: \"kubernetes.io/projected/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-kube-api-access-vc6jg\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.988897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.988859    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f682521f-36cb-4fb1-a409-9392e9d9286f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.988897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.988898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f682521f-36cb-4fb1-a409-9392e9d9286f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.989146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.988918    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-tls\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.988944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f682521f-36cb-4fb1-a409-9392e9d9286f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.989146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-wtmp\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989047    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989076    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-root\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc6jg\" (UniqueName: \"kubernetes.io/projected/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-kube-api-access-vc6jg\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-sys\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989146 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-metrics-client-ca\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989204    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989214    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-wtmp\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmff6\" (UniqueName: \"kubernetes.io/projected/f682521f-36cb-4fb1-a409-9392e9d9286f-kube-api-access-vmff6\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.989921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-textfile\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-textfile\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.989921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f682521f-36cb-4fb1-a409-9392e9d9286f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.989921 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.989790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-root\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.990395 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.990370    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-metrics-client-ca\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.990450 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.990414    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-sys\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.990579 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:56:05.990562    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 09:56:05.990678 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:56:05.990661    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-tls podName:570ebf96-4a6e-45b0-bbe1-03b33c1ce06a nodeName:}" failed. No retries permitted until 2026-07-23 09:56:06.490639252 +0000 UTC m=+90.728834487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-tls") pod "node-exporter-nwzjw" (UID: "570ebf96-4a6e-45b0-bbe1-03b33c1ce06a") : secret "node-exporter-tls" not found
Jul 23 09:56:05.990876 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.990651    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-accelerators-collector-config\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.991869 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.991844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:05.991957 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.991919    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f682521f-36cb-4fb1-a409-9392e9d9286f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:05.992017 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:05.992002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f682521f-36cb-4fb1-a409-9392e9d9286f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:06.003304 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.003271    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmff6\" (UniqueName: \"kubernetes.io/projected/f682521f-36cb-4fb1-a409-9392e9d9286f-kube-api-access-vmff6\") pod \"openshift-state-metrics-79f6958cdf-twgs4\" (UID: \"f682521f-36cb-4fb1-a409-9392e9d9286f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:06.003650 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.003630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc6jg\" (UniqueName: \"kubernetes.io/projected/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-kube-api-access-vc6jg\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:06.121820 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.121783    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"
Jul 23 09:56:06.266993 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.266967    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4"]
Jul 23 09:56:06.269373 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:56:06.269348    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf682521f_36cb_4fb1_a409_9392e9d9286f.slice/crio-caa2546f334ef91e25cca5c572b87d0a510850de6cb3d8fd99842c8c5e24f1df WatchSource:0}: Error finding container caa2546f334ef91e25cca5c572b87d0a510850de6cb3d8fd99842c8c5e24f1df: Status 404 returned error can't find the container with id caa2546f334ef91e25cca5c572b87d0a510850de6cb3d8fd99842c8c5e24f1df
Jul 23 09:56:06.492934 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.492888    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-tls\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:06.495396 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.495377    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570ebf96-4a6e-45b0-bbe1-03b33c1ce06a-node-exporter-tls\") pod \"node-exporter-nwzjw\" (UID: \"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a\") " pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:06.731379 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.731283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4" event={"ID":"f682521f-36cb-4fb1-a409-9392e9d9286f","Type":"ContainerStarted","Data":"f5694608eb7edd70e4eb3a7465e5db74b36ff9d74913833cb130b85fb3dff6b3"}
Jul 23 09:56:06.731530 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.731385    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4" event={"ID":"f682521f-36cb-4fb1-a409-9392e9d9286f","Type":"ContainerStarted","Data":"fa73eb490cec80e339163231b60b4128740459e492dd7e1de8a3ce418bba525c"}
Jul 23 09:56:06.731530 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.731413    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4" event={"ID":"f682521f-36cb-4fb1-a409-9392e9d9286f","Type":"ContainerStarted","Data":"caa2546f334ef91e25cca5c572b87d0a510850de6cb3d8fd99842c8c5e24f1df"}
Jul 23 09:56:06.765034 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.764996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nwzjw"
Jul 23 09:56:06.775280 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:56:06.775214    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570ebf96_4a6e_45b0_bbe1_03b33c1ce06a.slice/crio-e28b2f63be40be80758bc4ceb8cfc82ddc956962859b45f9c15774179061eab9 WatchSource:0}: Error finding container e28b2f63be40be80758bc4ceb8cfc82ddc956962859b45f9c15774179061eab9: Status 404 returned error can't find the container with id e28b2f63be40be80758bc4ceb8cfc82ddc956962859b45f9c15774179061eab9
Jul 23 09:56:06.876554 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.876516    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:56:06.880275 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.880258    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.883145 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.883119    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 09:56:06.883292 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.883119    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 09:56:06.883292 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.883171    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 09:56:06.883426 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.883407    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 09:56:06.896202 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896178    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896324 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896324 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896394 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896394 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896459 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qlpb\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-kube-api-access-8qlpb\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896459 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896516 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-web-config\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896516 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896577 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896577 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896636 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896587    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.896636 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.896624    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-out\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.924826 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.924797    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 09:56:06.924983 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.924805    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 09:56:06.927033 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.926997    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 09:56:06.927177 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.927062    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 09:56:06.927177 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.927105    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 09:56:06.928046 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.928027    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m8ptk\""
Jul 23 09:56:06.928992 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.928970    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:56:06.997845 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.997845 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.997845 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.997845 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qlpb\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-kube-api-access-8qlpb\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997951    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997971    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-web-config\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.997993    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.998022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.998047    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.998078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.998120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-out\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998617 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.998382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:06.998617 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:56:06.998559    2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 23 09:56:06.998617 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:56:06.998615    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls podName:946ee93d-9f80-4f08-9c24-da47e1befaaa nodeName:}" failed. No retries permitted until 2026-07-23 09:56:07.498596165 +0000 UTC m=+91.736791395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa") : secret "alertmanager-main-tls" not found
Jul 23 09:56:06.999478 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:06.999447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.000597 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:56:07.000573    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle podName:946ee93d-9f80-4f08-9c24-da47e1befaaa nodeName:}" failed. No retries permitted until 2026-07-23 09:56:07.500552207 +0000 UTC m=+91.738747462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa") : configmap references non-existent config key: ca-bundle.crt
Jul 23 09:56:07.000931 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.000902    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.001075 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.001049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.001618 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.001586    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.001759 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.001736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-out\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.002820 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.002797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.003256 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.003205    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-web-config\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.003559 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.003536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.003737 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.003715    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.016047 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.016018    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qlpb\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-kube-api-access-8qlpb\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.503325 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.503290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.503519 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.503345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.503519 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:56:07.503476    2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 23 09:56:07.503651 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:56:07.503561    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls podName:946ee93d-9f80-4f08-9c24-da47e1befaaa nodeName:}" failed. No retries permitted until 2026-07-23 09:56:08.503538571 +0000 UTC m=+92.741733805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa") : secret "alertmanager-main-tls" not found
Jul 23 09:56:07.504434 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.504403    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:07.651314 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.651283    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:56:07.738190 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:07.738113    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwzjw" event={"ID":"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a","Type":"ContainerStarted","Data":"e28b2f63be40be80758bc4ceb8cfc82ddc956962859b45f9c15774179061eab9"}
Jul 23 09:56:08.511832 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:08.511734    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:08.514334 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:08.514310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:08.689895 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:08.689860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:56:08.746061 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:08.746022    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4" event={"ID":"f682521f-36cb-4fb1-a409-9392e9d9286f","Type":"ContainerStarted","Data":"1f9b2b7ea466a0f01f7be36ad8e03aad05f12d4995631fa336aa4a28f1b3f2ea"}
Jul 23 09:56:08.750323 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:08.748698    2567 generic.go:356] "Generic (PLEG): container finished" podID="570ebf96-4a6e-45b0-bbe1-03b33c1ce06a" containerID="6a6ff4483bb3b57f183678df25edcb81b66ee8e66e0e27d33a64b779bf9dbd19" exitCode=0
Jul 23 09:56:08.750323 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:08.748785    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwzjw" event={"ID":"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a","Type":"ContainerDied","Data":"6a6ff4483bb3b57f183678df25edcb81b66ee8e66e0e27d33a64b779bf9dbd19"}
Jul 23 09:56:08.767156 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:08.766991    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-twgs4" podStartSLOduration=2.355314212 podStartE2EDuration="3.766957834s" totalImagesPullingTime="1.411643622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:08.765551408 +0000 UTC m=+93.003746662" watchObservedRunningTime="2026-07-23 09:56:08.766957834 +0000 UTC m=+93.005153089"
Jul 23 09:56:08.853040 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:08.853017    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:56:08.855574 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:56:08.855548    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946ee93d_9f80_4f08_9c24_da47e1befaaa.slice/crio-98a880d93b09713c8c54160fb7de99929bde2792c25847b1f4259effea52ae50 WatchSource:0}: Error finding container 98a880d93b09713c8c54160fb7de99929bde2792c25847b1f4259effea52ae50: Status 404 returned error can't find the container with id 98a880d93b09713c8c54160fb7de99929bde2792c25847b1f4259effea52ae50
Jul 23 09:56:09.226114 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.226078    2567 scope.go:117] "RemoveContainer" containerID="8a6a12e8843bb8a95f059c68233ce4657f4718a7d57c8bd37fe5d8220bd8fa76"
Jul 23 09:56:09.754927 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.754896    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 09:56:09.755372 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.755018    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" event={"ID":"7750c8de-1209-4e09-a4ba-720eb375f07b","Type":"ContainerStarted","Data":"1ce0bccbb6693572e62de624c8ed53b67173453900758c452d6811582ecf2a0a"}
Jul 23 09:56:09.755477 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.755435    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:56:09.757557 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.757531    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwzjw" event={"ID":"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a","Type":"ContainerStarted","Data":"e74057e1c7a1d816cfe278e831c8d2fe427e74d5040bd600363c677fb79ba6c9"}
Jul 23 09:56:09.757699 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.757583    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nwzjw" event={"ID":"570ebf96-4a6e-45b0-bbe1-03b33c1ce06a","Type":"ContainerStarted","Data":"8e795f5d6f645e87a2ecf4951eefa4adbedd2551969db4764473186a5af76e77"}
Jul 23 09:56:09.758903 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.758880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerStarted","Data":"98a880d93b09713c8c54160fb7de99929bde2792c25847b1f4259effea52ae50"}
Jul 23 09:56:09.773093 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.773046    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb" podStartSLOduration=72.899942702 podStartE2EDuration="1m20.77303136s" totalImagesPullingTime="7.873088658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:09.772140496 +0000 UTC m=+94.010335749" watchObservedRunningTime="2026-07-23 09:56:09.77303136 +0000 UTC m=+94.011226650"
Jul 23 09:56:09.798298 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.798214    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nwzjw" podStartSLOduration=3.693810388 podStartE2EDuration="4.798194999s" totalImagesPullingTime="1.027661163s" totalInitContainerRuntime="76.723448ms" isStatefulPod=true podCreationTimestamp="2026-07-23 09:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:09.796927014 +0000 UTC m=+94.035122320" watchObservedRunningTime="2026-07-23 09:56:09.798194999 +0000 UTC m=+94.036390251"
Jul 23 09:56:09.823753 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:09.823714    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-2hvdb"
Jul 23 09:56:10.580966 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.580929    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"]
Jul 23 09:56:10.583291 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.583254    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:10.585698 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.585676    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lljpw\""
Jul 23 09:56:10.585698 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.585696    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 09:56:10.591829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.591803    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"]
Jul 23 09:56:10.631591 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.631553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0feff49-89d4-4e59-83b8-963e565b7466-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5stpl\" (UID: \"e0feff49-89d4-4e59-83b8-963e565b7466\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:10.631591 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.631588    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsptd\" (UniqueName: \"kubernetes.io/projected/e0feff49-89d4-4e59-83b8-963e565b7466-kube-api-access-lsptd\") pod \"monitoring-plugin-7b7b7bc8bf-5stpl\" (UID: \"e0feff49-89d4-4e59-83b8-963e565b7466\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:10.732885 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.732843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0feff49-89d4-4e59-83b8-963e565b7466-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5stpl\" (UID: \"e0feff49-89d4-4e59-83b8-963e565b7466\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:10.732885 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.732882    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsptd\" (UniqueName: \"kubernetes.io/projected/e0feff49-89d4-4e59-83b8-963e565b7466-kube-api-access-lsptd\") pod \"monitoring-plugin-7b7b7bc8bf-5stpl\" (UID: \"e0feff49-89d4-4e59-83b8-963e565b7466\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:10.735640 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.735619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0feff49-89d4-4e59-83b8-963e565b7466-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5stpl\" (UID: \"e0feff49-89d4-4e59-83b8-963e565b7466\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:10.745665 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.745593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsptd\" (UniqueName: \"kubernetes.io/projected/e0feff49-89d4-4e59-83b8-963e565b7466-kube-api-access-lsptd\") pod \"monitoring-plugin-7b7b7bc8bf-5stpl\" (UID: \"e0feff49-89d4-4e59-83b8-963e565b7466\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:10.764592 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.764558    2567 generic.go:356] "Generic (PLEG): container finished" podID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerID="7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677" exitCode=0
Jul 23 09:56:10.764939 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.764651    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerDied","Data":"7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677"}
Jul 23 09:56:10.952274 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:10.952215    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:11.037946 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.037915    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6974b7cf9b-bn496"]
Jul 23 09:56:11.041647 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.041603    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.044788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.044512    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 23 09:56:11.044788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.044526    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 23 09:56:11.044788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.044626    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t464n\""
Jul 23 09:56:11.044788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.044627    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 23 09:56:11.044788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.044720    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 23 09:56:11.045206 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.044804    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 23 09:56:11.054819 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.054593    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 23 09:56:11.063985 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.063953    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6974b7cf9b-bn496"]
Jul 23 09:56:11.096693 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.096657    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"]
Jul 23 09:56:11.098842 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:56:11.098817    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0feff49_89d4_4e59_83b8_963e565b7466.slice/crio-d6c4e1ff85709c6da95c1506c1d43629d6f167455a21bc17870d05a9a6372638 WatchSource:0}: Error finding container d6c4e1ff85709c6da95c1506c1d43629d6f167455a21bc17870d05a9a6372638: Status 404 returned error can't find the container with id d6c4e1ff85709c6da95c1506c1d43629d6f167455a21bc17870d05a9a6372638
Jul 23 09:56:11.136447 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.136409    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-secret-telemeter-client\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.136447 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.136451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-serving-certs-ca-bundle\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.136653 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.136517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4khp\" (UniqueName: \"kubernetes.io/projected/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-kube-api-access-c4khp\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.136653 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.136574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.136653 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.136605    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-metrics-client-ca\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.136745 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.136658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-telemeter-client-tls\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.136745 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.136681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.136745 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.136734    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-federate-client-tls\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.237716 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.237677    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-telemeter-client-tls\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.237897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.237728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.237897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.237752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-federate-client-tls\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.238023 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.238003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-secret-telemeter-client\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.238109 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.238058    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-serving-certs-ca-bundle\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.238163 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.238111    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4khp\" (UniqueName: \"kubernetes.io/projected/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-kube-api-access-c4khp\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.238219 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.238176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.238219 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.238202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-metrics-client-ca\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.238976 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.238921    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.239134 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.239068    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-serving-certs-ca-bundle\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.239285 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.239261    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-metrics-client-ca\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.240655 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.240633    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-secret-telemeter-client\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.240765 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.240679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.240862 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.240846    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-federate-client-tls\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.240896 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.240878    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-telemeter-client-tls\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.245988 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.245962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4khp\" (UniqueName: \"kubernetes.io/projected/64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed-kube-api-access-c4khp\") pod \"telemeter-client-6974b7cf9b-bn496\" (UID: \"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed\") " pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.364301 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.364269    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496"
Jul 23 09:56:11.507676 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.507634    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6974b7cf9b-bn496"]
Jul 23 09:56:11.511748 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:56:11.511716    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64790b8e_9e9d_4e67_b1b6_30e98e0fe0ed.slice/crio-c7bd9af86d768e1ebee857d00f11419f9028f3964d20f7e09cfa24d3803dc733 WatchSource:0}: Error finding container c7bd9af86d768e1ebee857d00f11419f9028f3964d20f7e09cfa24d3803dc733: Status 404 returned error can't find the container with id c7bd9af86d768e1ebee857d00f11419f9028f3964d20f7e09cfa24d3803dc733
Jul 23 09:56:11.771888 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.771802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496" event={"ID":"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed","Type":"ContainerStarted","Data":"c7bd9af86d768e1ebee857d00f11419f9028f3964d20f7e09cfa24d3803dc733"}
Jul 23 09:56:11.773897 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:11.773862    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl" event={"ID":"e0feff49-89d4-4e59-83b8-963e565b7466","Type":"ContainerStarted","Data":"d6c4e1ff85709c6da95c1506c1d43629d6f167455a21bc17870d05a9a6372638"}
Jul 23 09:56:12.670623 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:12.670573    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d" podUID="b097844c-2178-407b-b429-3a83390e0261" containerName="registry" containerID="cri-o://8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596" gracePeriod=30
Jul 23 09:56:12.953671 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:12.953638    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:56:13.057926 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.057900    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-trusted-ca\") pod \"b097844c-2178-407b-b429-3a83390e0261\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") "
Jul 23 09:56:13.058052 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.057981    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-installation-pull-secrets\") pod \"b097844c-2178-407b-b429-3a83390e0261\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") "
Jul 23 09:56:13.058052 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.058005    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b097844c-2178-407b-b429-3a83390e0261-ca-trust-extracted\") pod \"b097844c-2178-407b-b429-3a83390e0261\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") "
Jul 23 09:56:13.058052 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.058023    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-bound-sa-token\") pod \"b097844c-2178-407b-b429-3a83390e0261\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") "
Jul 23 09:56:13.058052 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.058045    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") pod \"b097844c-2178-407b-b429-3a83390e0261\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") "
Jul 23 09:56:13.058179 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.058067    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-registry-certificates\") pod \"b097844c-2178-407b-b429-3a83390e0261\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") "
Jul 23 09:56:13.058179 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.058096    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-image-registry-private-configuration\") pod \"b097844c-2178-407b-b429-3a83390e0261\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") "
Jul 23 09:56:13.058179 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.058123    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ksx6\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-kube-api-access-2ksx6\") pod \"b097844c-2178-407b-b429-3a83390e0261\" (UID: \"b097844c-2178-407b-b429-3a83390e0261\") "
Jul 23 09:56:13.058557 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.058366    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b097844c-2178-407b-b429-3a83390e0261" (UID: "b097844c-2178-407b-b429-3a83390e0261"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:56:13.059015 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.058659    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b097844c-2178-407b-b429-3a83390e0261" (UID: "b097844c-2178-407b-b429-3a83390e0261"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:56:13.062565 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.062015    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b097844c-2178-407b-b429-3a83390e0261" (UID: "b097844c-2178-407b-b429-3a83390e0261"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:56:13.062774 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.062629    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b097844c-2178-407b-b429-3a83390e0261" (UID: "b097844c-2178-407b-b429-3a83390e0261"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:56:13.063040 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.062996    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b097844c-2178-407b-b429-3a83390e0261" (UID: "b097844c-2178-407b-b429-3a83390e0261"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:56:13.063162 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.063086    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-kube-api-access-2ksx6" (OuterVolumeSpecName: "kube-api-access-2ksx6") pod "b097844c-2178-407b-b429-3a83390e0261" (UID: "b097844c-2178-407b-b429-3a83390e0261"). InnerVolumeSpecName "kube-api-access-2ksx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:56:13.063227 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.063182    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b097844c-2178-407b-b429-3a83390e0261" (UID: "b097844c-2178-407b-b429-3a83390e0261"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:56:13.070329 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.070293    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b097844c-2178-407b-b429-3a83390e0261-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b097844c-2178-407b-b429-3a83390e0261" (UID: "b097844c-2178-407b-b429-3a83390e0261"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:56:13.159032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.159000    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-trusted-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:56:13.159032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.159028    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-installation-pull-secrets\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:56:13.159032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.159038    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b097844c-2178-407b-b429-3a83390e0261-ca-trust-extracted\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:56:13.159253 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.159048    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-bound-sa-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:56:13.159253 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.159056    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-registry-tls\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:56:13.159253 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.159065    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b097844c-2178-407b-b429-3a83390e0261-registry-certificates\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:56:13.159253 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.159073    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b097844c-2178-407b-b429-3a83390e0261-image-registry-private-configuration\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:56:13.159253 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.159082    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ksx6\" (UniqueName: \"kubernetes.io/projected/b097844c-2178-407b-b429-3a83390e0261-kube-api-access-2ksx6\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:56:13.785927 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.785882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl" event={"ID":"e0feff49-89d4-4e59-83b8-963e565b7466","Type":"ContainerStarted","Data":"71e8b271ece918037d5465adddba77e5a0c387a0b58466c70fbabd1c7a38c797"}
Jul 23 09:56:13.786114 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.785986    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:13.787428 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.787394    2567 generic.go:356] "Generic (PLEG): container finished" podID="b097844c-2178-407b-b429-3a83390e0261" containerID="8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596" exitCode=0
Jul 23 09:56:13.787551 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.787490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d" event={"ID":"b097844c-2178-407b-b429-3a83390e0261","Type":"ContainerDied","Data":"8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596"}
Jul 23 09:56:13.787551 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.787524    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d"
Jul 23 09:56:13.787551 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.787535    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fd85f8dd7-kff2d" event={"ID":"b097844c-2178-407b-b429-3a83390e0261","Type":"ContainerDied","Data":"98aa49c3ad5a5a8a784780f77deee5ab2c55c8c0161eb640fb6db5465e3fe205"}
Jul 23 09:56:13.787694 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.787563    2567 scope.go:117] "RemoveContainer" containerID="8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596"
Jul 23 09:56:13.793353 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.793025    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerStarted","Data":"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf"}
Jul 23 09:56:13.793353 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.793105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerStarted","Data":"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e"}
Jul 23 09:56:13.793353 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.793145    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerStarted","Data":"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946"}
Jul 23 09:56:13.793353 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.793220    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl"
Jul 23 09:56:13.793353 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.793266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerStarted","Data":"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf"}
Jul 23 09:56:13.793353 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.793306    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerStarted","Data":"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f"}
Jul 23 09:56:13.806409 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.806358    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5stpl" podStartSLOduration=2.148510581 podStartE2EDuration="3.806338677s" totalImagesPullingTime="1.657828096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:13.804672628 +0000 UTC m=+98.042867879" watchObservedRunningTime="2026-07-23 09:56:13.806338677 +0000 UTC m=+98.044533968"
Jul 23 09:56:13.838089 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.838061    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fd85f8dd7-kff2d"]
Jul 23 09:56:13.844466 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.844423    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fd85f8dd7-kff2d"]
Jul 23 09:56:13.992052 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.992017    2567 scope.go:117] "RemoveContainer" containerID="8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596"
Jul 23 09:56:13.992510 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:56:13.992480    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596\": container with ID starting with 8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596 not found: ID does not exist" containerID="8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596"
Jul 23 09:56:13.992601 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:13.992525    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596"} err="failed to get container status \"8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596\": rpc error: code = NotFound desc = could not find container \"8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596\": container with ID starting with 8568507f1c7ea3e73049cdad461f786c53c171fa214ad61f1bde0b68ccc25596 not found: ID does not exist"
Jul 23 09:56:14.231645 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:14.231616    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b097844c-2178-407b-b429-3a83390e0261" path="/var/lib/kubelet/pods/b097844c-2178-407b-b429-3a83390e0261/volumes"
Jul 23 09:56:14.800398 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:14.800359    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496" event={"ID":"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed","Type":"ContainerStarted","Data":"56acde015aa672e64e2a0525451f751766ea1bf1fecf06e44c723794563f452b"}
Jul 23 09:56:14.800648 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:14.800429    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496" event={"ID":"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed","Type":"ContainerStarted","Data":"30e34649d31e2c60c432a697584dfbdf7a380d4a829cd6b0e5f17b9fad09c225"}
Jul 23 09:56:14.800648 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:14.800458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496" event={"ID":"64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed","Type":"ContainerStarted","Data":"c66b83f5c3ae7b3cea73867207e22a40d4264ccb2ace498fa65f74aec0126d1d"}
Jul 23 09:56:14.823365 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:14.823230    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6974b7cf9b-bn496" podStartSLOduration=1.17781728 podStartE2EDuration="3.823212605s" totalImagesPullingTime="2.645395325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:14.821498584 +0000 UTC m=+99.059693848" watchObservedRunningTime="2026-07-23 09:56:14.823212605 +0000 UTC m=+99.061407856"
Jul 23 09:56:15.633470 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:15.633435    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d9tj9"
Jul 23 09:56:15.808065 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:15.807971    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerStarted","Data":"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207"}
Jul 23 09:56:15.839883 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:15.839491    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.496658712 podStartE2EDuration="9.839468738s" totalImagesPullingTime="5.325444289s" totalInitContainerRuntime="17.365737ms" isStatefulPod=false podCreationTimestamp="2026-07-23 09:56:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:15.836531724 +0000 UTC m=+100.074726977" watchObservedRunningTime="2026-07-23 09:56:15.839468738 +0000 UTC m=+100.077663990"
Jul 23 09:56:17.644899 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.644861    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f89b8dcb5-lpjn9"]
Jul 23 09:56:17.645334 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.645193    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b097844c-2178-407b-b429-3a83390e0261" containerName="registry"
Jul 23 09:56:17.645334 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.645204    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b097844c-2178-407b-b429-3a83390e0261" containerName="registry"
Jul 23 09:56:17.645334 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.645287    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b097844c-2178-407b-b429-3a83390e0261" containerName="registry"
Jul 23 09:56:17.648718 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.648698    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.651555 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.651524    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2wlzg\""
Jul 23 09:56:17.651689 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.651554    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 09:56:17.652558 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.652542    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 09:56:17.652873 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.652857    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 09:56:17.652974 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.652882    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 09:56:17.652974 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.652912    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 09:56:17.653087 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.652970    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 09:56:17.653087 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.653027    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 09:56:17.658612 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.658592    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f89b8dcb5-lpjn9"]
Jul 23 09:56:17.701389 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.701348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-oauth-serving-cert\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.701389 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.701388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-serving-cert\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.701654 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.701411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-service-ca\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.701654 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.701498    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-oauth-config\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.701654 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.701537    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf8xl\" (UniqueName: \"kubernetes.io/projected/5c7fff27-765a-4280-a51d-a7fd92d46e6a-kube-api-access-kf8xl\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.701654 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.701618    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-config\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.802222 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.802180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-oauth-config\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.802222 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.802228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf8xl\" (UniqueName: \"kubernetes.io/projected/5c7fff27-765a-4280-a51d-a7fd92d46e6a-kube-api-access-kf8xl\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.802467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.802288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-config\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.802467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.802361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-oauth-serving-cert\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.802467 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.802389    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-serving-cert\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.802616 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.802528    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-service-ca\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.803085 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.803062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-config\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.803085 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.803079    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-service-ca\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.803339 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.803316    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-oauth-serving-cert\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.804798 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.804781    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-oauth-config\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.804885 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.804868    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-serving-cert\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.810563 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.810533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf8xl\" (UniqueName: \"kubernetes.io/projected/5c7fff27-765a-4280-a51d-a7fd92d46e6a-kube-api-access-kf8xl\") pod \"console-5f89b8dcb5-lpjn9\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") " pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:17.959026 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:17.958929    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:18.099276 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:18.099107    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f89b8dcb5-lpjn9"]
Jul 23 09:56:18.103642 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:56:18.103608    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7fff27_765a_4280_a51d_a7fd92d46e6a.slice/crio-5e585060aae9d14c3814604d4d7b1acc4615c50caa45c5634f217eeb38e12204 WatchSource:0}: Error finding container 5e585060aae9d14c3814604d4d7b1acc4615c50caa45c5634f217eeb38e12204: Status 404 returned error can't find the container with id 5e585060aae9d14c3814604d4d7b1acc4615c50caa45c5634f217eeb38e12204
Jul 23 09:56:18.827869 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:18.827824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f89b8dcb5-lpjn9" event={"ID":"5c7fff27-765a-4280-a51d-a7fd92d46e6a","Type":"ContainerStarted","Data":"5e585060aae9d14c3814604d4d7b1acc4615c50caa45c5634f217eeb38e12204"}
Jul 23 09:56:21.844081 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:21.844046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f89b8dcb5-lpjn9" event={"ID":"5c7fff27-765a-4280-a51d-a7fd92d46e6a","Type":"ContainerStarted","Data":"071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1"}
Jul 23 09:56:21.865416 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:21.865355    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f89b8dcb5-lpjn9" podStartSLOduration=1.9910061140000002 podStartE2EDuration="4.865335629s" totalImagesPullingTime="2.874329515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:21.863942239 +0000 UTC m=+106.102137519" watchObservedRunningTime="2026-07-23 09:56:21.865335629 +0000 UTC m=+106.103530882"
Jul 23 09:56:27.959409 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:27.959364    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:27.959888 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:27.959446    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:27.964253 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:27.964210    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:28.882065 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:28.882037    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:56:31.890767 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:31.890735    2567 generic.go:356] "Generic (PLEG): container finished" podID="f117bef5-3c98-4c4f-a337-9459f67cd78f" containerID="c8a47ea665cdce31b2afeee4e003f7643acc74e71b5fa5bd7bdaa6357ff56aff" exitCode=0
Jul 23 09:56:31.891265 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:31.890814    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw" event={"ID":"f117bef5-3c98-4c4f-a337-9459f67cd78f","Type":"ContainerDied","Data":"c8a47ea665cdce31b2afeee4e003f7643acc74e71b5fa5bd7bdaa6357ff56aff"}
Jul 23 09:56:31.891265 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:31.891261    2567 scope.go:117] "RemoveContainer" containerID="c8a47ea665cdce31b2afeee4e003f7643acc74e71b5fa5bd7bdaa6357ff56aff"
Jul 23 09:56:32.896977 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:32.896945    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-w9gfw" event={"ID":"f117bef5-3c98-4c4f-a337-9459f67cd78f","Type":"ContainerStarted","Data":"2c141de48cddaf25cfba240044bf81db9fc2bf4efaed370c81d6f618d6f1397a"}
Jul 23 09:56:38.970168 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:38.970133    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f89b8dcb5-lpjn9"]
Jul 23 09:56:42.937565 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:42.937535    2567 generic.go:356] "Generic (PLEG): container finished" podID="8ab152ad-c1e0-43a3-907b-6db993bbabf7" containerID="2ea256da132dfda20ceddebce11d867b0327763a06ebb627c21a5fbf1083df42" exitCode=0
Jul 23 09:56:42.937979 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:42.937611    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-dpdjn" event={"ID":"8ab152ad-c1e0-43a3-907b-6db993bbabf7","Type":"ContainerDied","Data":"2ea256da132dfda20ceddebce11d867b0327763a06ebb627c21a5fbf1083df42"}
Jul 23 09:56:42.937979 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:42.937970    2567 scope.go:117] "RemoveContainer" containerID="2ea256da132dfda20ceddebce11d867b0327763a06ebb627c21a5fbf1083df42"
Jul 23 09:56:43.943858 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:43.943822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-dpdjn" event={"ID":"8ab152ad-c1e0-43a3-907b-6db993bbabf7","Type":"ContainerStarted","Data":"f7f852ddf8ab52323278c96ad960e7dda4e77a6750d5be0299ef771f9ed8a7a3"}
Jul 23 09:56:52.980288 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:52.980229    2567 generic.go:356] "Generic (PLEG): container finished" podID="b1596cdd-d541-44ce-82b1-7523cc9b7345" containerID="609351bde54ad325338f12d8077f7197ecad0f28e238da57d9510950733b9827" exitCode=0
Jul 23 09:56:52.980288 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:52.980275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl" event={"ID":"b1596cdd-d541-44ce-82b1-7523cc9b7345","Type":"ContainerDied","Data":"609351bde54ad325338f12d8077f7197ecad0f28e238da57d9510950733b9827"}
Jul 23 09:56:52.980746 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:52.980583    2567 scope.go:117] "RemoveContainer" containerID="609351bde54ad325338f12d8077f7197ecad0f28e238da57d9510950733b9827"
Jul 23 09:56:53.987302 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:56:53.987266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-qhjcl" event={"ID":"b1596cdd-d541-44ce-82b1-7523cc9b7345","Type":"ContainerStarted","Data":"13a4a1a2f2992f9e75e7956bb204bb6b2bc0ec82e8cb948d49d116e796f86165"}
Jul 23 09:57:03.993839 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:03.993774    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f89b8dcb5-lpjn9" podUID="5c7fff27-765a-4280-a51d-a7fd92d46e6a" containerName="console" containerID="cri-o://071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1" gracePeriod=15
Jul 23 09:57:04.246380 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.246322    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:57:04.309194 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309162    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-service-ca\") pod \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") "
Jul 23 09:57:04.309386 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309213    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-serving-cert\") pod \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") "
Jul 23 09:57:04.309386 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309265    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf8xl\" (UniqueName: \"kubernetes.io/projected/5c7fff27-765a-4280-a51d-a7fd92d46e6a-kube-api-access-kf8xl\") pod \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") "
Jul 23 09:57:04.309386 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309323    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-oauth-serving-cert\") pod \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") "
Jul 23 09:57:04.309386 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309352    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-config\") pod \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") "
Jul 23 09:57:04.309553 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309387    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-oauth-config\") pod \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\" (UID: \"5c7fff27-765a-4280-a51d-a7fd92d46e6a\") "
Jul 23 09:57:04.309734 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309701    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c7fff27-765a-4280-a51d-a7fd92d46e6a" (UID: "5c7fff27-765a-4280-a51d-a7fd92d46e6a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:04.309734 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309714    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c7fff27-765a-4280-a51d-a7fd92d46e6a" (UID: "5c7fff27-765a-4280-a51d-a7fd92d46e6a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:04.309899 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.309831    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-config" (OuterVolumeSpecName: "console-config") pod "5c7fff27-765a-4280-a51d-a7fd92d46e6a" (UID: "5c7fff27-765a-4280-a51d-a7fd92d46e6a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:04.311715 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.311693    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c7fff27-765a-4280-a51d-a7fd92d46e6a" (UID: "5c7fff27-765a-4280-a51d-a7fd92d46e6a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:04.311804 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.311742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c7fff27-765a-4280-a51d-a7fd92d46e6a" (UID: "5c7fff27-765a-4280-a51d-a7fd92d46e6a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:04.311804 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.311751    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7fff27-765a-4280-a51d-a7fd92d46e6a-kube-api-access-kf8xl" (OuterVolumeSpecName: "kube-api-access-kf8xl") pod "5c7fff27-765a-4280-a51d-a7fd92d46e6a" (UID: "5c7fff27-765a-4280-a51d-a7fd92d46e6a"). InnerVolumeSpecName "kube-api-access-kf8xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:57:04.410096 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.410058    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-oauth-serving-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:04.410096 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.410085    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-config\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:04.410096 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.410095    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-oauth-config\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:04.410096 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.410103    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7fff27-765a-4280-a51d-a7fd92d46e6a-service-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:04.410405 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.410112    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c7fff27-765a-4280-a51d-a7fd92d46e6a-console-serving-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:04.410405 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:04.410120    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf8xl\" (UniqueName: \"kubernetes.io/projected/5c7fff27-765a-4280-a51d-a7fd92d46e6a-kube-api-access-kf8xl\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:05.042731 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.042686    2567 generic.go:356] "Generic (PLEG): container finished" podID="5c7fff27-765a-4280-a51d-a7fd92d46e6a" containerID="071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1" exitCode=0
Jul 23 09:57:05.042731 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.042737    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f89b8dcb5-lpjn9"
Jul 23 09:57:05.043192 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.042768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f89b8dcb5-lpjn9" event={"ID":"5c7fff27-765a-4280-a51d-a7fd92d46e6a","Type":"ContainerDied","Data":"071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1"}
Jul 23 09:57:05.043192 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.042825    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f89b8dcb5-lpjn9" event={"ID":"5c7fff27-765a-4280-a51d-a7fd92d46e6a","Type":"ContainerDied","Data":"5e585060aae9d14c3814604d4d7b1acc4615c50caa45c5634f217eeb38e12204"}
Jul 23 09:57:05.043192 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.042847    2567 scope.go:117] "RemoveContainer" containerID="071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1"
Jul 23 09:57:05.052150 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.052134    2567 scope.go:117] "RemoveContainer" containerID="071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1"
Jul 23 09:57:05.052502 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:57:05.052485    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1\": container with ID starting with 071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1 not found: ID does not exist" containerID="071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1"
Jul 23 09:57:05.052550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.052514    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1"} err="failed to get container status \"071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1\": rpc error: code = NotFound desc = could not find container \"071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1\": container with ID starting with 071dd57e18b454931ccf61377cf2e43479d08eef3ac5a08c9fbf98eb068332e1 not found: ID does not exist"
Jul 23 09:57:05.063608 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.063583    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f89b8dcb5-lpjn9"]
Jul 23 09:57:05.068790 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:05.068768    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f89b8dcb5-lpjn9"]
Jul 23 09:57:06.231142 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:06.231107    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7fff27-765a-4280-a51d-a7fd92d46e6a" path="/var/lib/kubelet/pods/5c7fff27-765a-4280-a51d-a7fd92d46e6a/volumes"
Jul 23 09:57:23.375788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.375753    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7f9f58cd-hkd58"]
Jul 23 09:57:23.376259 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.376060    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7fff27-765a-4280-a51d-a7fd92d46e6a" containerName="console"
Jul 23 09:57:23.376259 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.376071    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7fff27-765a-4280-a51d-a7fd92d46e6a" containerName="console"
Jul 23 09:57:23.376259 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.376168    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7fff27-765a-4280-a51d-a7fd92d46e6a" containerName="console"
Jul 23 09:57:23.380799 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.380775    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.383766 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.383739    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 09:57:23.383766 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.383762    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 09:57:23.385201 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.385181    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 09:57:23.385354 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.385283    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 09:57:23.385354 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.385253    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 09:57:23.385475 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.385390    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2wlzg\""
Jul 23 09:57:23.385617 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.385601    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 09:57:23.385705 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.385638    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 09:57:23.390468 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.390447    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 09:57:23.391010 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.390987    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7f9f58cd-hkd58"]
Jul 23 09:57:23.473390 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.473350    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-oauth-config\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.473390 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.473391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtgw7\" (UniqueName: \"kubernetes.io/projected/78220961-8219-4139-8563-124c0d623ff1-kube-api-access-dtgw7\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.473600 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.473426    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-serving-cert\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.473600 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.473456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-oauth-serving-cert\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.473600 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.473499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-service-ca\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.473600 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.473583    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-console-config\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.473737 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.473619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-trusted-ca-bundle\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.574722 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.574669    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-service-ca\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.574722 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.574725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-console-config\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.574992 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.574748    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-trusted-ca-bundle\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.574992 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.574926    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-oauth-config\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.574992 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.574961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtgw7\" (UniqueName: \"kubernetes.io/projected/78220961-8219-4139-8563-124c0d623ff1-kube-api-access-dtgw7\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.575162 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.574997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-serving-cert\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.575162 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.575034    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-oauth-serving-cert\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.575546 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.575511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-service-ca\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.575670 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.575615    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-console-config\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.575799 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.575679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-oauth-serving-cert\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.575799 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.575686    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-trusted-ca-bundle\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.577714 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.577675    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-serving-cert\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.577814 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.577799    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-oauth-config\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.584694 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.584675    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtgw7\" (UniqueName: \"kubernetes.io/projected/78220961-8219-4139-8563-124c0d623ff1-kube-api-access-dtgw7\") pod \"console-5d7f9f58cd-hkd58\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") " pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.692913 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.692822    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:23.842273 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:23.842227    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7f9f58cd-hkd58"]
Jul 23 09:57:23.844363 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:57:23.844334    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78220961_8219_4139_8563_124c0d623ff1.slice/crio-a0229029a8677bf5a878060e0afb67a7ab56b49bff84b111221d7875a74f19f1 WatchSource:0}: Error finding container a0229029a8677bf5a878060e0afb67a7ab56b49bff84b111221d7875a74f19f1: Status 404 returned error can't find the container with id a0229029a8677bf5a878060e0afb67a7ab56b49bff84b111221d7875a74f19f1
Jul 23 09:57:24.121037 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:24.121003    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7f9f58cd-hkd58" event={"ID":"78220961-8219-4139-8563-124c0d623ff1","Type":"ContainerStarted","Data":"0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6"}
Jul 23 09:57:24.121212 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:24.121054    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7f9f58cd-hkd58" event={"ID":"78220961-8219-4139-8563-124c0d623ff1","Type":"ContainerStarted","Data":"a0229029a8677bf5a878060e0afb67a7ab56b49bff84b111221d7875a74f19f1"}
Jul 23 09:57:24.140575 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:24.140525    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7f9f58cd-hkd58" podStartSLOduration=1.140509078 podStartE2EDuration="1.140509078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:57:24.140505924 +0000 UTC m=+168.378701198" watchObservedRunningTime="2026-07-23 09:57:24.140509078 +0000 UTC m=+168.378704330"
Jul 23 09:57:26.174860 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:26.174809    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:57:26.175384 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:26.175196    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="alertmanager" containerID="cri-o://18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f" gracePeriod=120
Jul 23 09:57:26.175384 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:26.175268    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy-web" containerID="cri-o://5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946" gracePeriod=120
Jul 23 09:57:26.175384 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:26.175270    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy-metric" containerID="cri-o://b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf" gracePeriod=120
Jul 23 09:57:26.175384 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:26.175313    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="prom-label-proxy" containerID="cri-o://d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207" gracePeriod=120
Jul 23 09:57:26.175384 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:26.175303    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="config-reloader" containerID="cri-o://d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf" gracePeriod=120
Jul 23 09:57:26.175384 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:26.175281    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy" containerID="cri-o://dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e" gracePeriod=120
Jul 23 09:57:27.138044 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.137961    2567 generic.go:356] "Generic (PLEG): container finished" podID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerID="d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207" exitCode=0
Jul 23 09:57:27.138044 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.137987    2567 generic.go:356] "Generic (PLEG): container finished" podID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerID="dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e" exitCode=0
Jul 23 09:57:27.138044 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.137993    2567 generic.go:356] "Generic (PLEG): container finished" podID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerID="d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf" exitCode=0
Jul 23 09:57:27.138044 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.137998    2567 generic.go:356] "Generic (PLEG): container finished" podID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerID="18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f" exitCode=0
Jul 23 09:57:27.138044 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.138030    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerDied","Data":"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207"}
Jul 23 09:57:27.138340 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.138117    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerDied","Data":"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e"}
Jul 23 09:57:27.138340 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.138146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerDied","Data":"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf"}
Jul 23 09:57:27.138340 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.138171    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerDied","Data":"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f"}
Jul 23 09:57:27.424667 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.424644    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:27.510109 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510073    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-web-config\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510302 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510118    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510302 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510145    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-metrics-client-ca\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510302 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510168    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-volume\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510302 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510186    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qlpb\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-kube-api-access-8qlpb\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510302 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510204    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-tls-assets\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510302 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510254    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510640    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:27.510829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510666    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510722    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-cluster-tls-config\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510638    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:27.510829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510749    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510790    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-out\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.510829 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510822    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.511418 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.510852    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-main-db\") pod \"946ee93d-9f80-4f08-9c24-da47e1befaaa\" (UID: \"946ee93d-9f80-4f08-9c24-da47e1befaaa\") "
Jul 23 09:57:27.511418 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.511266    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.511418 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.511285    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/946ee93d-9f80-4f08-9c24-da47e1befaaa-metrics-client-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.511633 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.511598    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:57:27.513676 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.513651    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-kube-api-access-8qlpb" (OuterVolumeSpecName: "kube-api-access-8qlpb") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "kube-api-access-8qlpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:57:27.513894 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.513870    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-volume" (OuterVolumeSpecName: "config-volume") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:27.514229 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.514192    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:27.514229 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.514214    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:27.514419 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.514396    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:27.514477 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.514396    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:57:27.514788 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.514764    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-out" (OuterVolumeSpecName: "config-out") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:57:27.515638 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.515614    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:27.518081 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.518057    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:27.524777 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.524757    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-web-config" (OuterVolumeSpecName: "web-config") pod "946ee93d-9f80-4f08-9c24-da47e1befaaa" (UID: "946ee93d-9f80-4f08-9c24-da47e1befaaa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:27.612531 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612497    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-cluster-tls-config\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612531 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612526    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-main-tls\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612531 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612537    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-out\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612548    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612557    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/946ee93d-9f80-4f08-9c24-da47e1befaaa-alertmanager-main-db\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612565    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-web-config\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612572    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-config-volume\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612580    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qlpb\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-kube-api-access-8qlpb\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612588    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/946ee93d-9f80-4f08-9c24-da47e1befaaa-tls-assets\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612597    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:27.612749 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:27.612606    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/946ee93d-9f80-4f08-9c24-da47e1befaaa-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:57:28.144445 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.144408    2567 generic.go:356] "Generic (PLEG): container finished" podID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerID="b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf" exitCode=0
Jul 23 09:57:28.144445 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.144439    2567 generic.go:356] "Generic (PLEG): container finished" podID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerID="5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946" exitCode=0
Jul 23 09:57:28.144648 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.144484    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerDied","Data":"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf"}
Jul 23 09:57:28.144648 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.144500    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.144648 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.144551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerDied","Data":"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946"}
Jul 23 09:57:28.144648 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.144580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"946ee93d-9f80-4f08-9c24-da47e1befaaa","Type":"ContainerDied","Data":"98a880d93b09713c8c54160fb7de99929bde2792c25847b1f4259effea52ae50"}
Jul 23 09:57:28.144648 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.144613    2567 scope.go:117] "RemoveContainer" containerID="d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207"
Jul 23 09:57:28.152721 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.152704    2567 scope.go:117] "RemoveContainer" containerID="b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf"
Jul 23 09:57:28.159939 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.159921    2567 scope.go:117] "RemoveContainer" containerID="dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e"
Jul 23 09:57:28.167023 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.167000    2567 scope.go:117] "RemoveContainer" containerID="5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946"
Jul 23 09:57:28.168260 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.168224    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:57:28.172393 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.172366    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:57:28.174378 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.174365    2567 scope.go:117] "RemoveContainer" containerID="d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf"
Jul 23 09:57:28.181423 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.181407    2567 scope.go:117] "RemoveContainer" containerID="18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f"
Jul 23 09:57:28.188528 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.188506    2567 scope.go:117] "RemoveContainer" containerID="7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677"
Jul 23 09:57:28.195649 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.195628    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:57:28.196022 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.195975    2567 scope.go:117] "RemoveContainer" containerID="d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207"
Jul 23 09:57:28.196092 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.195978    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="init-config-reloader"
Jul 23 09:57:28.196092 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196068    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="init-config-reloader"
Jul 23 09:57:28.196092 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196087    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy-metric"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196097    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy-metric"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196110    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="alertmanager"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196118    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="alertmanager"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196127    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy-web"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196135    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy-web"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196144    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196152    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196173    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="prom-label-proxy"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196183    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="prom-label-proxy"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196195    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="config-reloader"
Jul 23 09:57:28.196207 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196204    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="config-reloader"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:57:28.196281    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207\": container with ID starting with d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207 not found: ID does not exist" containerID="d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196327    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="alertmanager"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196349    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="config-reloader"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196359    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="prom-label-proxy"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196369    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196379    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy-metric"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196389    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" containerName="kube-rbac-proxy-web"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196316    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207"} err="failed to get container status \"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207\": rpc error: code = NotFound desc = could not find container \"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207\": container with ID starting with d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207 not found: ID does not exist"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196425    2567 scope.go:117] "RemoveContainer" containerID="b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:57:28.196654    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf\": container with ID starting with b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf not found: ID does not exist" containerID="b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf"
Jul 23 09:57:28.196679 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196676    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf"} err="failed to get container status \"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf\": rpc error: code = NotFound desc = could not find container \"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf\": container with ID starting with b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf not found: ID does not exist"
Jul 23 09:57:28.197067 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196695    2567 scope.go:117] "RemoveContainer" containerID="dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e"
Jul 23 09:57:28.197067 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:57:28.196908    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e\": container with ID starting with dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e not found: ID does not exist" containerID="dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e"
Jul 23 09:57:28.197067 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196928    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e"} err="failed to get container status \"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e\": rpc error: code = NotFound desc = could not find container \"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e\": container with ID starting with dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e not found: ID does not exist"
Jul 23 09:57:28.197067 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.196946    2567 scope.go:117] "RemoveContainer" containerID="5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946"
Jul 23 09:57:28.197204 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:57:28.197156    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946\": container with ID starting with 5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946 not found: ID does not exist" containerID="5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946"
Jul 23 09:57:28.197204 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.197174    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946"} err="failed to get container status \"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946\": rpc error: code = NotFound desc = could not find container \"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946\": container with ID starting with 5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946 not found: ID does not exist"
Jul 23 09:57:28.197204 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.197188    2567 scope.go:117] "RemoveContainer" containerID="d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf"
Jul 23 09:57:28.197447 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:57:28.197430    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf\": container with ID starting with d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf not found: ID does not exist" containerID="d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf"
Jul 23 09:57:28.197485 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.197451    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf"} err="failed to get container status \"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf\": rpc error: code = NotFound desc = could not find container \"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf\": container with ID starting with d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf not found: ID does not exist"
Jul 23 09:57:28.197485 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.197466    2567 scope.go:117] "RemoveContainer" containerID="18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f"
Jul 23 09:57:28.197692 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:57:28.197667    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f\": container with ID starting with 18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f not found: ID does not exist" containerID="18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f"
Jul 23 09:57:28.197743 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.197710    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f"} err="failed to get container status \"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f\": rpc error: code = NotFound desc = could not find container \"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f\": container with ID starting with 18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f not found: ID does not exist"
Jul 23 09:57:28.197743 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.197732    2567 scope.go:117] "RemoveContainer" containerID="7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677"
Jul 23 09:57:28.197948 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:57:28.197933    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677\": container with ID starting with 7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677 not found: ID does not exist" containerID="7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677"
Jul 23 09:57:28.197987 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.197954    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677"} err="failed to get container status \"7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677\": rpc error: code = NotFound desc = could not find container \"7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677\": container with ID starting with 7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677 not found: ID does not exist"
Jul 23 09:57:28.197987 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.197967    2567 scope.go:117] "RemoveContainer" containerID="d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207"
Jul 23 09:57:28.198142 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198122    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207"} err="failed to get container status \"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207\": rpc error: code = NotFound desc = could not find container \"d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207\": container with ID starting with d5ee4c1b1f98b8fc45bc78ef27effcc135bab689fa1091860fb8b2c3c10fc207 not found: ID does not exist"
Jul 23 09:57:28.198218 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198145    2567 scope.go:117] "RemoveContainer" containerID="b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf"
Jul 23 09:57:28.198412 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198398    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf"} err="failed to get container status \"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf\": rpc error: code = NotFound desc = could not find container \"b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf\": container with ID starting with b3954002d083744e071f8c14d686d992db8beb7be6740dd4659657165e39deaf not found: ID does not exist"
Jul 23 09:57:28.198456 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198412    2567 scope.go:117] "RemoveContainer" containerID="dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e"
Jul 23 09:57:28.198592 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198572    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e"} err="failed to get container status \"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e\": rpc error: code = NotFound desc = could not find container \"dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e\": container with ID starting with dbd965ff3bfef36c0fb31d4ce829b90b84d4b3fc90f149ef7b2b83d5ccd3be2e not found: ID does not exist"
Jul 23 09:57:28.198654 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198593    2567 scope.go:117] "RemoveContainer" containerID="5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946"
Jul 23 09:57:28.198805 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198790    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946"} err="failed to get container status \"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946\": rpc error: code = NotFound desc = could not find container \"5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946\": container with ID starting with 5e2509b497b4f6a13cdb4ca9fb53cb7a204face631d18abf41eac74a4fbe3946 not found: ID does not exist"
Jul 23 09:57:28.198805 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198805    2567 scope.go:117] "RemoveContainer" containerID="d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf"
Jul 23 09:57:28.198993 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198969    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf"} err="failed to get container status \"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf\": rpc error: code = NotFound desc = could not find container \"d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf\": container with ID starting with d39b9aae70dff9eaa10dba53d37056894986a3b94de23d81e3a682c08edf2aaf not found: ID does not exist"
Jul 23 09:57:28.199078 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.198996    2567 scope.go:117] "RemoveContainer" containerID="18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f"
Jul 23 09:57:28.199226 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.199204    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f"} err="failed to get container status \"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f\": rpc error: code = NotFound desc = could not find container \"18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f\": container with ID starting with 18dcf07cdda4e809417b0dfe77708146ea569c107a86b741e6ab468b8163182f not found: ID does not exist"
Jul 23 09:57:28.199286 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.199228    2567 scope.go:117] "RemoveContainer" containerID="7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677"
Jul 23 09:57:28.199459 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.199443    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677"} err="failed to get container status \"7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677\": rpc error: code = NotFound desc = could not find container \"7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677\": container with ID starting with 7bd5fa22d5116cff2536f50e884ccd68987b5df2e716d87ec8d5d52fb0ea1677 not found: ID does not exist"
Jul 23 09:57:28.201636 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.201620    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.204461 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.204443    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m8ptk\""
Jul 23 09:57:28.204461 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.204447    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 09:57:28.204620 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.204520    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 09:57:28.204674 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.204620    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 09:57:28.204820 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.204787    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 09:57:28.204820 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.204806    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 09:57:28.204962 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.204823    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 09:57:28.205114 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.205084    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 09:57:28.205347 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.205320    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 09:57:28.209359 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.209343    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 09:57:28.213326 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.213307    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:57:28.230717 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.230694    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="946ee93d-9f80-4f08-9c24-da47e1befaaa" path="/var/lib/kubelet/pods/946ee93d-9f80-4f08-9c24-da47e1befaaa/volumes"
Jul 23 09:57:28.317608 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317789 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-config-out\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317789 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317789 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317789 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317789 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317768    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317965 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317798    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317965 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92r6x\" (UniqueName: \"kubernetes.io/projected/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-kube-api-access-92r6x\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317965 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317965 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317866    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317965 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317915    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317965 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.317965 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.317945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-web-config\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419078 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.418995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419078 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419067    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-config-out\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419281 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419281 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419126    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419422 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419422 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419422 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419371    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419422 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92r6x\" (UniqueName: \"kubernetes.io/projected/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-kube-api-access-92r6x\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419605 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419605 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419605 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419605 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.419605 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.419571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-web-config\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.421142 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.420560    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.421142 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.420689    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.421142 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.420825    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.422377 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.422255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-config-out\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.422377 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.422360    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.422602 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.422574    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.422706 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.422624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-web-config\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.422896 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.422876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.423346 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.423320    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-config-volume\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.423429 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.423371    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.423691 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.423667    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.424605 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.424590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.427888 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.427869    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92r6x\" (UniqueName: \"kubernetes.io/projected/64a7b292-66be-4ab1-8295-2b7cc9bc86b3-kube-api-access-92r6x\") pod \"alertmanager-main-0\" (UID: \"64a7b292-66be-4ab1-8295-2b7cc9bc86b3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.511519 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.511487    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 09:57:28.654436 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:28.654403    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 09:57:28.657310 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:57:28.657288    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a7b292_66be_4ab1_8295_2b7cc9bc86b3.slice/crio-4b928e04733f2ca93d137b8f19346cb58e201783346a0ec6f9d1eeffc6d83721 WatchSource:0}: Error finding container 4b928e04733f2ca93d137b8f19346cb58e201783346a0ec6f9d1eeffc6d83721: Status 404 returned error can't find the container with id 4b928e04733f2ca93d137b8f19346cb58e201783346a0ec6f9d1eeffc6d83721
Jul 23 09:57:29.150551 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:29.150516    2567 generic.go:356] "Generic (PLEG): container finished" podID="64a7b292-66be-4ab1-8295-2b7cc9bc86b3" containerID="4ce6d179398a8d3325a60444a0e12d4773b50c0a0e763be64ce0ceb496d7150f" exitCode=0
Jul 23 09:57:29.150719 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:29.150565    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64a7b292-66be-4ab1-8295-2b7cc9bc86b3","Type":"ContainerDied","Data":"4ce6d179398a8d3325a60444a0e12d4773b50c0a0e763be64ce0ceb496d7150f"}
Jul 23 09:57:29.150719 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:29.150640    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64a7b292-66be-4ab1-8295-2b7cc9bc86b3","Type":"ContainerStarted","Data":"4b928e04733f2ca93d137b8f19346cb58e201783346a0ec6f9d1eeffc6d83721"}
Jul 23 09:57:30.159164 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:30.159127    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64a7b292-66be-4ab1-8295-2b7cc9bc86b3","Type":"ContainerStarted","Data":"aa69f43e5c8d1f19ecbcc6448020fb2173c9e39724443ddedb5d95291c0353ef"}
Jul 23 09:57:30.159566 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:30.159196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64a7b292-66be-4ab1-8295-2b7cc9bc86b3","Type":"ContainerStarted","Data":"67dc3ce3bea8038d5f66d8e15c4d9f7c02a833b10636593500699019b61ae09c"}
Jul 23 09:57:30.159566 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:30.159253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64a7b292-66be-4ab1-8295-2b7cc9bc86b3","Type":"ContainerStarted","Data":"f56606122f31c06e89ad10b4ecc3a707d006164072b59c9f00d93306e7f9503d"}
Jul 23 09:57:30.159566 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:30.159283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64a7b292-66be-4ab1-8295-2b7cc9bc86b3","Type":"ContainerStarted","Data":"8a74bfbef9735c8b8d12f6a85efb4774bafbd7305c7d82a18b8a3cd9597f51d8"}
Jul 23 09:57:30.159566 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:30.159313    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64a7b292-66be-4ab1-8295-2b7cc9bc86b3","Type":"ContainerStarted","Data":"405dd3a50ffa5aca407053080b0ab9e51e7437141b080e7879c6fde045e1bb10"}
Jul 23 09:57:30.159566 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:30.159350    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64a7b292-66be-4ab1-8295-2b7cc9bc86b3","Type":"ContainerStarted","Data":"a0075554be1e249dabbf92cdbc92da4ce55f443c0438cb65132df71c61a400e3"}
Jul 23 09:57:30.186971 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:30.186921    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.169677888 podStartE2EDuration="2.186905299s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.227411ms" isStatefulPod=false podCreationTimestamp="2026-07-23 09:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:57:30.184284827 +0000 UTC m=+174.422480090" watchObservedRunningTime="2026-07-23 09:57:30.186905299 +0000 UTC m=+174.425100550"
Jul 23 09:57:33.693709 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:33.693665    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:33.694082 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:33.693736    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:33.698407 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:33.698384    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:57:34.181646 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:57:34.181619    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 09:58:44.286114 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.286080    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mk9b9"]
Jul 23 09:58:44.289439 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.289424    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:44.292856 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.292836    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 09:58:44.293007 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.292929    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 09:58:44.294079 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.294055    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2lxch\""
Jul 23 09:58:44.301712 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.301694    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mk9b9"]
Jul 23 09:58:44.355736 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.355698    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76486344-383f-47c1-9cf0-c2a146f1233b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mk9b9\" (UID: \"76486344-383f-47c1-9cf0-c2a146f1233b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:44.355736 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.355737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrxk8\" (UniqueName: \"kubernetes.io/projected/76486344-383f-47c1-9cf0-c2a146f1233b-kube-api-access-wrxk8\") pod \"cert-manager-webhook-6486ffd997-mk9b9\" (UID: \"76486344-383f-47c1-9cf0-c2a146f1233b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:44.456168 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.456136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76486344-383f-47c1-9cf0-c2a146f1233b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mk9b9\" (UID: \"76486344-383f-47c1-9cf0-c2a146f1233b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:44.456168 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.456171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrxk8\" (UniqueName: \"kubernetes.io/projected/76486344-383f-47c1-9cf0-c2a146f1233b-kube-api-access-wrxk8\") pod \"cert-manager-webhook-6486ffd997-mk9b9\" (UID: \"76486344-383f-47c1-9cf0-c2a146f1233b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:44.468161 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.468130    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrxk8\" (UniqueName: \"kubernetes.io/projected/76486344-383f-47c1-9cf0-c2a146f1233b-kube-api-access-wrxk8\") pod \"cert-manager-webhook-6486ffd997-mk9b9\" (UID: \"76486344-383f-47c1-9cf0-c2a146f1233b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:44.468346 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.468144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76486344-383f-47c1-9cf0-c2a146f1233b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mk9b9\" (UID: \"76486344-383f-47c1-9cf0-c2a146f1233b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:44.614905 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.614872    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:44.746766 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:44.746736    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mk9b9"]
Jul 23 09:58:44.750436 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:58:44.750409    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76486344_383f_47c1_9cf0_c2a146f1233b.slice/crio-4b7e338e275652a001ffe56a185da591d31af8e4973d78159590794187a19224 WatchSource:0}: Error finding container 4b7e338e275652a001ffe56a185da591d31af8e4973d78159590794187a19224: Status 404 returned error can't find the container with id 4b7e338e275652a001ffe56a185da591d31af8e4973d78159590794187a19224
Jul 23 09:58:45.479134 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:45.479093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9" event={"ID":"76486344-383f-47c1-9cf0-c2a146f1233b","Type":"ContainerStarted","Data":"4b7e338e275652a001ffe56a185da591d31af8e4973d78159590794187a19224"}
Jul 23 09:58:46.363637 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.363605    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mwbqx"]
Jul 23 09:58:46.372892 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.372861    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mwbqx"
Jul 23 09:58:46.375872 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.375770    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mwbqx"]
Jul 23 09:58:46.376116 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.376090    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mfvwc\""
Jul 23 09:58:46.467862 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.467826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47ed3be2-3431-48eb-9995-4b353aebd6cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-mwbqx\" (UID: \"47ed3be2-3431-48eb-9995-4b353aebd6cf\") " pod="cert-manager/cert-manager-55b4d954d5-mwbqx"
Jul 23 09:58:46.468086 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.467909    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmmv8\" (UniqueName: \"kubernetes.io/projected/47ed3be2-3431-48eb-9995-4b353aebd6cf-kube-api-access-xmmv8\") pod \"cert-manager-55b4d954d5-mwbqx\" (UID: \"47ed3be2-3431-48eb-9995-4b353aebd6cf\") " pod="cert-manager/cert-manager-55b4d954d5-mwbqx"
Jul 23 09:58:46.568945 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.568914    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmmv8\" (UniqueName: \"kubernetes.io/projected/47ed3be2-3431-48eb-9995-4b353aebd6cf-kube-api-access-xmmv8\") pod \"cert-manager-55b4d954d5-mwbqx\" (UID: \"47ed3be2-3431-48eb-9995-4b353aebd6cf\") " pod="cert-manager/cert-manager-55b4d954d5-mwbqx"
Jul 23 09:58:46.569405 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.569012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47ed3be2-3431-48eb-9995-4b353aebd6cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-mwbqx\" (UID: \"47ed3be2-3431-48eb-9995-4b353aebd6cf\") " pod="cert-manager/cert-manager-55b4d954d5-mwbqx"
Jul 23 09:58:46.577569 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.577543    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47ed3be2-3431-48eb-9995-4b353aebd6cf-bound-sa-token\") pod \"cert-manager-55b4d954d5-mwbqx\" (UID: \"47ed3be2-3431-48eb-9995-4b353aebd6cf\") " pod="cert-manager/cert-manager-55b4d954d5-mwbqx"
Jul 23 09:58:46.577742 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.577661    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmmv8\" (UniqueName: \"kubernetes.io/projected/47ed3be2-3431-48eb-9995-4b353aebd6cf-kube-api-access-xmmv8\") pod \"cert-manager-55b4d954d5-mwbqx\" (UID: \"47ed3be2-3431-48eb-9995-4b353aebd6cf\") " pod="cert-manager/cert-manager-55b4d954d5-mwbqx"
Jul 23 09:58:46.685913 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:46.685830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mwbqx"
Jul 23 09:58:47.854189 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:47.854168    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mwbqx"]
Jul 23 09:58:47.858096 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:58:47.858072    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47ed3be2_3431_48eb_9995_4b353aebd6cf.slice/crio-5272733da2e0368ea4230716b87f2d0f0db373e15a3373367e5edcb93fddcccf WatchSource:0}: Error finding container 5272733da2e0368ea4230716b87f2d0f0db373e15a3373367e5edcb93fddcccf: Status 404 returned error can't find the container with id 5272733da2e0368ea4230716b87f2d0f0db373e15a3373367e5edcb93fddcccf
Jul 23 09:58:48.496031 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:48.495990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mwbqx" event={"ID":"47ed3be2-3431-48eb-9995-4b353aebd6cf","Type":"ContainerStarted","Data":"b428b40d8b80a539d49e2518f71716568ddbd3669d1d952b95684f3ad6afce6c"}
Jul 23 09:58:48.496264 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:48.496039    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mwbqx" event={"ID":"47ed3be2-3431-48eb-9995-4b353aebd6cf","Type":"ContainerStarted","Data":"5272733da2e0368ea4230716b87f2d0f0db373e15a3373367e5edcb93fddcccf"}
Jul 23 09:58:48.497633 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:48.497611    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9" event={"ID":"76486344-383f-47c1-9cf0-c2a146f1233b","Type":"ContainerStarted","Data":"19dadde294f473da8712a4a3f0446ba093a75fdd582cec3022a593622d738cda"}
Jul 23 09:58:48.497726 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:48.497644    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:58:48.512877 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:48.512829    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mwbqx" podStartSLOduration=2.512816321 podStartE2EDuration="2.512816321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:58:48.51218756 +0000 UTC m=+252.750382813" watchObservedRunningTime="2026-07-23 09:58:48.512816321 +0000 UTC m=+252.751011573"
Jul 23 09:58:48.538282 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:48.538210    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9" podStartSLOduration=1.495723791 podStartE2EDuration="4.538193645s" totalImagesPullingTime="3.042469854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:58:48.536631876 +0000 UTC m=+252.774827144" watchObservedRunningTime="2026-07-23 09:58:48.538193645 +0000 UTC m=+252.776388897"
Jul 23 09:58:54.504446 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:58:54.504415    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mk9b9"
Jul 23 09:59:10.390971 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.390890    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"]
Jul 23 09:59:10.394364 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.394349    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.398587 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.398565    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 09:59:10.398840 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.398824    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 09:59:10.398940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.398888    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 09:59:10.398999 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.398959    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5pgqj\""
Jul 23 09:59:10.399174 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.399155    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 09:59:10.411714 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.411691    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"]
Jul 23 09:59:10.460936 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.460903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d110948b-a9a5-48bb-8b83-84cb34b56c49-manifests\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.461121 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.460962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d110948b-a9a5-48bb-8b83-84cb34b56c49-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.461121 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.461018    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc8cz\" (UniqueName: \"kubernetes.io/projected/d110948b-a9a5-48bb-8b83-84cb34b56c49-kube-api-access-mc8cz\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.461121 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.461051    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d110948b-a9a5-48bb-8b83-84cb34b56c49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.461121 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.461081    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d110948b-a9a5-48bb-8b83-84cb34b56c49-tmp\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.561728 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.561691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d110948b-a9a5-48bb-8b83-84cb34b56c49-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.561728 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.561732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc8cz\" (UniqueName: \"kubernetes.io/projected/d110948b-a9a5-48bb-8b83-84cb34b56c49-kube-api-access-mc8cz\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.561990 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.561771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d110948b-a9a5-48bb-8b83-84cb34b56c49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.561990 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.561808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d110948b-a9a5-48bb-8b83-84cb34b56c49-tmp\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.561990 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.561862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d110948b-a9a5-48bb-8b83-84cb34b56c49-manifests\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.562269 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.562223    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d110948b-a9a5-48bb-8b83-84cb34b56c49-manifests\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.564183 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.564161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d110948b-a9a5-48bb-8b83-84cb34b56c49-tmp\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.564290 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.564208    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d110948b-a9a5-48bb-8b83-84cb34b56c49-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.564290 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.564267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d110948b-a9a5-48bb-8b83-84cb34b56c49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.570209 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.570189    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc8cz\" (UniqueName: \"kubernetes.io/projected/d110948b-a9a5-48bb-8b83-84cb34b56c49-kube-api-access-mc8cz\") pod \"opendatahub-operator-controller-manager-86bc8b458c-xpkjw\" (UID: \"d110948b-a9a5-48bb-8b83-84cb34b56c49\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.703883 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.703786    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:10.850554 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:10.850523    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"]
Jul 23 09:59:10.854458 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:59:10.854433    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd110948b_a9a5_48bb_8b83_84cb34b56c49.slice/crio-ed47f11bf40eb1fe6e3a7fa80d647c2f4cccad37a6f82db3d21372f1362df03c WatchSource:0}: Error finding container ed47f11bf40eb1fe6e3a7fa80d647c2f4cccad37a6f82db3d21372f1362df03c: Status 404 returned error can't find the container with id ed47f11bf40eb1fe6e3a7fa80d647c2f4cccad37a6f82db3d21372f1362df03c
Jul 23 09:59:11.591952 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:11.591913    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw" event={"ID":"d110948b-a9a5-48bb-8b83-84cb34b56c49","Type":"ContainerStarted","Data":"ed47f11bf40eb1fe6e3a7fa80d647c2f4cccad37a6f82db3d21372f1362df03c"}
Jul 23 09:59:14.607032 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:14.606994    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw" event={"ID":"d110948b-a9a5-48bb-8b83-84cb34b56c49","Type":"ContainerStarted","Data":"ccac86bd015d8eb425765fdd87ca79710101ca510dff4adf10814d4d8da7343f"}
Jul 23 09:59:15.613556 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:15.613526    2567 generic.go:356] "Generic (PLEG): container finished" podID="d110948b-a9a5-48bb-8b83-84cb34b56c49" containerID="ccac86bd015d8eb425765fdd87ca79710101ca510dff4adf10814d4d8da7343f" exitCode=0
Jul 23 09:59:15.613984 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:15.613614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw" event={"ID":"d110948b-a9a5-48bb-8b83-84cb34b56c49","Type":"ContainerDied","Data":"ccac86bd015d8eb425765fdd87ca79710101ca510dff4adf10814d4d8da7343f"}
Jul 23 09:59:16.620620 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:16.620577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw" event={"ID":"d110948b-a9a5-48bb-8b83-84cb34b56c49","Type":"ContainerStarted","Data":"5cc78c342f691e67f04ba4450829b619d69c73ed191876fcb930a6db12abe0fb"}
Jul 23 09:59:16.621026 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:16.620672    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:16.643382 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:16.643324    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw" podStartSLOduration=1.97557105 podStartE2EDuration="6.643303921s" totalImagesPullingTime="3.657307061s" totalInitContainerRuntime="1.01042581s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:16.641807932 +0000 UTC m=+280.880003210" watchObservedRunningTime="2026-07-23 09:59:16.643303921 +0000 UTC m=+280.881499174"
Jul 23 09:59:27.626564 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.626537    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-xpkjw"
Jul 23 09:59:27.759541 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.759503    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"]
Jul 23 09:59:27.762515 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.762498    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:27.765109 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.765083    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:59:27.765228 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.765162    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 09:59:27.765228 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.765213    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r6wxx\""
Jul 23 09:59:27.765368 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.765213    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 09:59:27.765427 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.765396    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 09:59:27.765550 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.765530    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 09:59:27.770277 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.770255    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"]
Jul 23 09:59:27.925565 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.925467    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f497a3d1-789e-425a-82ad-9b5d5947d0f7-cert\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:27.925565 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.925519    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f497a3d1-789e-425a-82ad-9b5d5947d0f7-manager-config\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:27.925565 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.925553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrlhj\" (UniqueName: \"kubernetes.io/projected/f497a3d1-789e-425a-82ad-9b5d5947d0f7-kube-api-access-zrlhj\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:27.925804 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:27.925632    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f497a3d1-789e-425a-82ad-9b5d5947d0f7-metrics-cert\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.026458 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.026414    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f497a3d1-789e-425a-82ad-9b5d5947d0f7-manager-config\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.026458 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.026466    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrlhj\" (UniqueName: \"kubernetes.io/projected/f497a3d1-789e-425a-82ad-9b5d5947d0f7-kube-api-access-zrlhj\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.026722 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.026544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f497a3d1-789e-425a-82ad-9b5d5947d0f7-metrics-cert\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.026722 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.026592    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f497a3d1-789e-425a-82ad-9b5d5947d0f7-cert\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.027082 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.027058    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f497a3d1-789e-425a-82ad-9b5d5947d0f7-manager-config\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.029135 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.029111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f497a3d1-789e-425a-82ad-9b5d5947d0f7-metrics-cert\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.029271 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.029230    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f497a3d1-789e-425a-82ad-9b5d5947d0f7-cert\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.034518 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.034493    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrlhj\" (UniqueName: \"kubernetes.io/projected/f497a3d1-789e-425a-82ad-9b5d5947d0f7-kube-api-access-zrlhj\") pod \"lws-controller-manager-6d6fb6dcb8-fg6d8\" (UID: \"f497a3d1-789e-425a-82ad-9b5d5947d0f7\") " pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.072748 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.072702    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:28.206401 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.206378    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"]
Jul 23 09:59:28.208993 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:59:28.208967    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf497a3d1_789e_425a_82ad_9b5d5947d0f7.slice/crio-e65a3be197208eaaeb9cd7e112f4ad9a6f5441ec9d57efeb694cd4d5c3ebe693 WatchSource:0}: Error finding container e65a3be197208eaaeb9cd7e112f4ad9a6f5441ec9d57efeb694cd4d5c3ebe693: Status 404 returned error can't find the container with id e65a3be197208eaaeb9cd7e112f4ad9a6f5441ec9d57efeb694cd4d5c3ebe693
Jul 23 09:59:28.676075 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:28.676042    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8" event={"ID":"f497a3d1-789e-425a-82ad-9b5d5947d0f7","Type":"ContainerStarted","Data":"e65a3be197208eaaeb9cd7e112f4ad9a6f5441ec9d57efeb694cd4d5c3ebe693"}
Jul 23 09:59:31.414867 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.414830    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hmngd"]
Jul 23 09:59:31.418345 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.418326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:31.420831 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.420804    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 23 09:59:31.429166 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.429144    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hmngd"]
Jul 23 09:59:31.560400 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.560353    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66bee048-f2c2-49c1-bf31-b1421dc5ab15-tls-certs\") pod \"model-serving-api-54d89bd5fc-hmngd\" (UID: \"66bee048-f2c2-49c1-bf31-b1421dc5ab15\") " pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:31.560580 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.560488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck96j\" (UniqueName: \"kubernetes.io/projected/66bee048-f2c2-49c1-bf31-b1421dc5ab15-kube-api-access-ck96j\") pod \"model-serving-api-54d89bd5fc-hmngd\" (UID: \"66bee048-f2c2-49c1-bf31-b1421dc5ab15\") " pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:31.661138 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.661100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck96j\" (UniqueName: \"kubernetes.io/projected/66bee048-f2c2-49c1-bf31-b1421dc5ab15-kube-api-access-ck96j\") pod \"model-serving-api-54d89bd5fc-hmngd\" (UID: \"66bee048-f2c2-49c1-bf31-b1421dc5ab15\") " pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:31.661351 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.661150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66bee048-f2c2-49c1-bf31-b1421dc5ab15-tls-certs\") pod \"model-serving-api-54d89bd5fc-hmngd\" (UID: \"66bee048-f2c2-49c1-bf31-b1421dc5ab15\") " pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:31.663809 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.663789    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66bee048-f2c2-49c1-bf31-b1421dc5ab15-tls-certs\") pod \"model-serving-api-54d89bd5fc-hmngd\" (UID: \"66bee048-f2c2-49c1-bf31-b1421dc5ab15\") " pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:31.673814 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.673748    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck96j\" (UniqueName: \"kubernetes.io/projected/66bee048-f2c2-49c1-bf31-b1421dc5ab15-kube-api-access-ck96j\") pod \"model-serving-api-54d89bd5fc-hmngd\" (UID: \"66bee048-f2c2-49c1-bf31-b1421dc5ab15\") " pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:31.693036 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.692999    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8" event={"ID":"f497a3d1-789e-425a-82ad-9b5d5947d0f7","Type":"ContainerStarted","Data":"0adf6dcbbaa9d1afa410a028a01b259bbe155737f275a80991907c1951cf6da5"}
Jul 23 09:59:31.693186 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.693132    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:31.711787 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.711735    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8" podStartSLOduration=2.225463105 podStartE2EDuration="4.711718833s" totalImagesPullingTime="2.486255728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:31.710329911 +0000 UTC m=+295.948525185" watchObservedRunningTime="2026-07-23 09:59:31.711718833 +0000 UTC m=+295.949914085"
Jul 23 09:59:31.728573 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.728540    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:31.866127 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:31.866098    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hmngd"]
Jul 23 09:59:31.868550 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:59:31.868522    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66bee048_f2c2_49c1_bf31_b1421dc5ab15.slice/crio-af49faf9db81747d8d5190968a3ec3347d62c23d3d905d630d4eb796b5fbe6ca WatchSource:0}: Error finding container af49faf9db81747d8d5190968a3ec3347d62c23d3d905d630d4eb796b5fbe6ca: Status 404 returned error can't find the container with id af49faf9db81747d8d5190968a3ec3347d62c23d3d905d630d4eb796b5fbe6ca
Jul 23 09:59:32.699552 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:32.699516    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hmngd" event={"ID":"66bee048-f2c2-49c1-bf31-b1421dc5ab15","Type":"ContainerStarted","Data":"af49faf9db81747d8d5190968a3ec3347d62c23d3d905d630d4eb796b5fbe6ca"}
Jul 23 09:59:33.704933 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:33.704899    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hmngd" event={"ID":"66bee048-f2c2-49c1-bf31-b1421dc5ab15","Type":"ContainerStarted","Data":"c0e1419170b69eac986ad315b75af458398720f35fa7ad2f97cc4b0a869bd89e"}
Jul 23 09:59:33.705388 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:33.704997    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:33.721215 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:33.721163    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hmngd" podStartSLOduration=1.057566447 podStartE2EDuration="2.721148167s" totalImagesPullingTime="1.66358172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:33.719809095 +0000 UTC m=+297.958004365" watchObservedRunningTime="2026-07-23 09:59:33.721148167 +0000 UTC m=+297.959343449"
Jul 23 09:59:36.144252 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:36.144206    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 09:59:36.148502 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:36.148483    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 09:59:36.156064 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:36.156045    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 09:59:36.953735 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:36.953704    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"]
Jul 23 09:59:36.956912 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:36.956895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:36.959680 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:36.959663    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 09:59:36.959793 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:36.959771    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-p24j9\""
Jul 23 09:59:36.970987 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:36.970954    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"]
Jul 23 09:59:37.109793 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.109757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.109793 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.109793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.110015 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.109817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm4j9\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-kube-api-access-rm4j9\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.110015 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.109907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.110015 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.109947    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.110015 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.109999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.110137 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.110022    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.110137 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.110044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.110137 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.110085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.151791 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.151753    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"]
Jul 23 09:59:37.154994 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.154976    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.165905 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.165881    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"]
Jul 23 09:59:37.210721 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.210721 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.210721 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.210993 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210750    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.210993 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210776    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.210993 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210807    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm4j9\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-kube-api-access-rm4j9\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.210993 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210854    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.210993 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.210993 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.210944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.211258 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.211102    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.211258 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.211207    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.211258 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.211216    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.211567 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.211547    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.211650 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.211573    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.213370 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.213353    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.213531 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.213511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.218959 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.218936    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.219486 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.219466    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm4j9\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-kube-api-access-rm4j9\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-s95jf\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.267624 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.267586    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:37.312071 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.312248 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.312248 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.312248 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312165    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.312248 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312195    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.312407 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.312407 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312297    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghdds\" (UniqueName: \"kubernetes.io/projected/1a44011e-4093-4f3c-bc5a-5049ff4faaed-kube-api-access-ghdds\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.312407 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.312518 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.312417    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.413378 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.413340    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"]
Jul 23 09:59:37.414263 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.414215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghdds\" (UniqueName: \"kubernetes.io/projected/1a44011e-4093-4f3c-bc5a-5049ff4faaed-kube-api-access-ghdds\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.414528 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.414508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.414651 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.414637    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.414813 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.414799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.414928 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.414914    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.415053 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.415041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.415151 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.415139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.415272 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.415255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.415395 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.415382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.417009 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.416986    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.417500 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.417450    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.417798 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.417770    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.418016 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.417782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.418152 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.418127    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.420879 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.420854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.421337 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.421314    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.421982 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:59:37.421954    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8beaaf11_89e0_4da0_bdd9_fd26bb5b1334.slice/crio-b148561ef66670dd65200d0cfda60ae44f20d06e9e5bc4bf33bc652822d84501 WatchSource:0}: Error finding container b148561ef66670dd65200d0cfda60ae44f20d06e9e5bc4bf33bc652822d84501: Status 404 returned error can't find the container with id b148561ef66670dd65200d0cfda60ae44f20d06e9e5bc4bf33bc652822d84501
Jul 23 09:59:37.425476 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.424806    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 09:59:37.426328 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.425881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghdds\" (UniqueName: \"kubernetes.io/projected/1a44011e-4093-4f3c-bc5a-5049ff4faaed-kube-api-access-ghdds\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.429932 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.429902    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a44011e-4093-4f3c-bc5a-5049ff4faaed-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48qbkd\" (UID: \"1a44011e-4093-4f3c-bc5a-5049ff4faaed\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.464275 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.464170    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:37.610637 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.610459    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"]
Jul 23 09:59:37.613384 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:59:37.613357    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a44011e_4093_4f3c_bc5a_5049ff4faaed.slice/crio-f526ab05ec585e3589a71e78fe1e5007a6a750d5cac3c87abfb09ae6076a1eb4 WatchSource:0}: Error finding container f526ab05ec585e3589a71e78fe1e5007a6a750d5cac3c87abfb09ae6076a1eb4: Status 404 returned error can't find the container with id f526ab05ec585e3589a71e78fe1e5007a6a750d5cac3c87abfb09ae6076a1eb4
Jul 23 09:59:37.723295 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.723165    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd" event={"ID":"1a44011e-4093-4f3c-bc5a-5049ff4faaed","Type":"ContainerStarted","Data":"f526ab05ec585e3589a71e78fe1e5007a6a750d5cac3c87abfb09ae6076a1eb4"}
Jul 23 09:59:37.724326 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.724299    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" event={"ID":"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334","Type":"ContainerStarted","Data":"b148561ef66670dd65200d0cfda60ae44f20d06e9e5bc4bf33bc652822d84501"}
Jul 23 09:59:37.863746 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.863711    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"]
Jul 23 09:59:37.868253 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.868222    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:37.871165 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.871143    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 09:59:37.871165 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.871162    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 09:59:37.871386 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.871140    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 09:59:37.871386 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.871153    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sd76z\""
Jul 23 09:59:37.882697 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:37.882676    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"]
Jul 23 09:59:38.020996 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.020911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.020996 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.020946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.021180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.021065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.021180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.021113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.021180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.021135    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.021295 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.021178    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.021295 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.021197    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn2k8\" (UniqueName: \"kubernetes.io/projected/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-kube-api-access-jn2k8\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.122262 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.122198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.122438 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.122288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.122438 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.122309    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.122438 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.122346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.122438 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.122370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn2k8\" (UniqueName: \"kubernetes.io/projected/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-kube-api-access-jn2k8\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.122640 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.122510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.122640 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.122554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.123587 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.123553    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.124892 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.124868    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.124987 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.124915    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.124987 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.124913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.124987 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.124955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.135153 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.135117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.135301 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.135285    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn2k8\" (UniqueName: \"kubernetes.io/projected/29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57-kube-api-access-jn2k8\") pod \"istiod-openshift-gateway-94bb8fbfd-qks6l\" (UID: \"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.177831 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.177804    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:38.384229 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.381364    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"]
Jul 23 09:59:38.384229 ip-10-0-141-125 kubenswrapper[2567]: W0723 09:59:38.383781    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29400b28_3f7c_4cd0_8dd7_c3d7ea9bed57.slice/crio-96a25128b9860411c488d4b4e4fe4c83c7ae8de1a495160f418430d90ddc48ec WatchSource:0}: Error finding container 96a25128b9860411c488d4b4e4fe4c83c7ae8de1a495160f418430d90ddc48ec: Status 404 returned error can't find the container with id 96a25128b9860411c488d4b4e4fe4c83c7ae8de1a495160f418430d90ddc48ec
Jul 23 09:59:38.732596 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:38.732554    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l" event={"ID":"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57","Type":"ContainerStarted","Data":"96a25128b9860411c488d4b4e4fe4c83c7ae8de1a495160f418430d90ddc48ec"}
Jul 23 09:59:41.472997 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.472953    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 09:59:41.473424 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.473043    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 09:59:41.473424 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.473075    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 09:59:41.473424 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.473170    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 09:59:41.473424 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.473258    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 09:59:41.480057 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.480029    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 09:59:41.480135 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.480088    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 09:59:41.480135 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.480118    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 09:59:41.753329 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.753216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" event={"ID":"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334","Type":"ContainerStarted","Data":"2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131"}
Jul 23 09:59:41.755039 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.755008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l" event={"ID":"29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57","Type":"ContainerStarted","Data":"e4bd2b106028412cbf04618cbf6f8496154a8b53d40a10d24fb367c749f8e12e"}
Jul 23 09:59:41.755182 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.755064    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:41.756488 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.756467    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd" event={"ID":"1a44011e-4093-4f3c-bc5a-5049ff4faaed","Type":"ContainerStarted","Data":"a7da66292623164f6af29473100416e687fd1405702ea5dff867d407bea2eab0"}
Jul 23 09:59:41.786180 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.786128    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" podStartSLOduration=1.731298125 podStartE2EDuration="5.786108114s" totalImagesPullingTime="4.054809989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:41.784503847 +0000 UTC m=+306.022699098" watchObservedRunningTime="2026-07-23 09:59:41.786108114 +0000 UTC m=+306.024303366"
Jul 23 09:59:41.817479 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.817412    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l" podStartSLOduration=1.731825758 podStartE2EDuration="4.817387271s" totalImagesPullingTime="3.085561513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:41.813971711 +0000 UTC m=+306.052166964" watchObservedRunningTime="2026-07-23 09:59:41.817387271 +0000 UTC m=+306.055582523"
Jul 23 09:59:41.850718 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:41.850655    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd" podStartSLOduration=0.993404488 podStartE2EDuration="4.850632389s" totalImagesPullingTime="3.857227901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:41.850184094 +0000 UTC m=+306.088379345" watchObservedRunningTime="2026-07-23 09:59:41.850632389 +0000 UTC m=+306.088827645"
Jul 23 09:59:42.268615 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:42.268573    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:42.270287 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:42.270254    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 23 09:59:42.270463 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:42.270318    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" podUID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 23 09:59:42.464800 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:42.464761    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:42.466283 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:42.466261    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6576859cf48qbkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 23 09:59:42.466404 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:42.466316    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd" podUID="1a44011e-4093-4f3c-bc5a-5049ff4faaed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 23 09:59:42.702064 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:42.702033    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d6fb6dcb8-fg6d8"
Jul 23 09:59:42.765353 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:42.765321    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qks6l"
Jul 23 09:59:43.268382 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:43.268345    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 23 09:59:43.268562 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:43.268414    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" podUID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 23 09:59:43.468586 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:43.468552    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:43.768396 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:43.768366    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:43.769222 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:43.769204    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48qbkd"
Jul 23 09:59:43.819427 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:43.819393    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"]
Jul 23 09:59:44.268750 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:44.268716    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 23 09:59:44.268995 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:44.268767    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" podUID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 23 09:59:44.713370 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:44.713342    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hmngd"
Jul 23 09:59:44.773577 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:44.773543    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" podUID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" containerName="istio-proxy" containerID="cri-o://2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131" gracePeriod=30
Jul 23 09:59:50.026875 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.026849    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:50.120118 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120085    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-podinfo\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120118 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120125    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-data\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120157    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-credential-socket\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120202    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-token\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120261    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-envoy\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120309    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm4j9\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-kube-api-access-rm4j9\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120342    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-certs\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120417 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120398    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-socket\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120712 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120454    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istiod-ca-cert\") pod \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\" (UID: \"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334\") "
Jul 23 09:59:50.120712 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120473    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-data" (OuterVolumeSpecName: "istio-data") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:59:50.120712 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120564    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:59:50.120712 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120632    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:59:50.120904 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120710    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:59:50.120904 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120825    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.120904 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120844    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.120904 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120857    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.120904 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.120873    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.121152 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.121008    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:59:50.122816 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.122788    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-token" (OuterVolumeSpecName: "istio-token") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:59:50.122816 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.122812    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:59:50.122991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.122858    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 09:59:50.122991 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.122912    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-kube-api-access-rm4j9" (OuterVolumeSpecName: "kube-api-access-rm4j9") pod "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" (UID: "8beaaf11-89e0-4da0-bdd9-fd26bb5b1334"). InnerVolumeSpecName "kube-api-access-rm4j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:59:50.221849 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.221816    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.221849 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.221847    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.221849 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.221857    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.221849 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.221865    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.222124 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.221875    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm4j9\" (UniqueName: \"kubernetes.io/projected/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334-kube-api-access-rm4j9\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 09:59:50.803116 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.803079    2567 generic.go:356] "Generic (PLEG): container finished" podID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" containerID="2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131" exitCode=0
Jul 23 09:59:50.803315 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.803130    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"
Jul 23 09:59:50.803315 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.803169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" event={"ID":"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334","Type":"ContainerDied","Data":"2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131"}
Jul 23 09:59:50.803315 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.803225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf" event={"ID":"8beaaf11-89e0-4da0-bdd9-fd26bb5b1334","Type":"ContainerDied","Data":"b148561ef66670dd65200d0cfda60ae44f20d06e9e5bc4bf33bc652822d84501"}
Jul 23 09:59:50.803315 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.803263    2567 scope.go:117] "RemoveContainer" containerID="2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131"
Jul 23 09:59:50.811989 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.811969    2567 scope.go:117] "RemoveContainer" containerID="2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131"
Jul 23 09:59:50.812296 ip-10-0-141-125 kubenswrapper[2567]: E0723 09:59:50.812259    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131\": container with ID starting with 2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131 not found: ID does not exist" containerID="2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131"
Jul 23 09:59:50.812363 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.812306    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131"} err="failed to get container status \"2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131\": rpc error: code = NotFound desc = could not find container \"2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131\": container with ID starting with 2b07ee924242914225d26cb8af72cb1cc074903950aec84df2ba45994fae3131 not found: ID does not exist"
Jul 23 09:59:50.820940 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.820916    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"]
Jul 23 09:59:50.824777 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:50.824757    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-s95jf"]
Jul 23 09:59:52.231578 ip-10-0-141-125 kubenswrapper[2567]: I0723 09:59:52.231533    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" path="/var/lib/kubelet/pods/8beaaf11-89e0-4da0-bdd9-fd26bb5b1334/volumes"
Jul 23 10:01:29.278862 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:29.278825    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7f9f58cd-hkd58"]
Jul 23 10:01:54.304949 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.304900    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d7f9f58cd-hkd58" podUID="78220961-8219-4139-8563-124c0d623ff1" containerName="console" containerID="cri-o://0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6" gracePeriod=15
Jul 23 10:01:54.547806 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.547783    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 10:01:54.650950 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.650917    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-oauth-serving-cert\") pod \"78220961-8219-4139-8563-124c0d623ff1\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") "
Jul 23 10:01:54.651171 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.650977    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-console-config\") pod \"78220961-8219-4139-8563-124c0d623ff1\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") "
Jul 23 10:01:54.651171 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651021    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-service-ca\") pod \"78220961-8219-4139-8563-124c0d623ff1\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") "
Jul 23 10:01:54.651171 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651045    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtgw7\" (UniqueName: \"kubernetes.io/projected/78220961-8219-4139-8563-124c0d623ff1-kube-api-access-dtgw7\") pod \"78220961-8219-4139-8563-124c0d623ff1\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") "
Jul 23 10:01:54.651171 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651142    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-oauth-config\") pod \"78220961-8219-4139-8563-124c0d623ff1\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") "
Jul 23 10:01:54.651171 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651165    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-serving-cert\") pod \"78220961-8219-4139-8563-124c0d623ff1\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") "
Jul 23 10:01:54.651457 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651188    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-trusted-ca-bundle\") pod \"78220961-8219-4139-8563-124c0d623ff1\" (UID: \"78220961-8219-4139-8563-124c0d623ff1\") "
Jul 23 10:01:54.651457 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651393    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78220961-8219-4139-8563-124c0d623ff1" (UID: "78220961-8219-4139-8563-124c0d623ff1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:01:54.651457 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651423    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-console-config" (OuterVolumeSpecName: "console-config") pod "78220961-8219-4139-8563-124c0d623ff1" (UID: "78220961-8219-4139-8563-124c0d623ff1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:01:54.651674 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651651    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-oauth-serving-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:01:54.651746 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651678    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-console-config\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:01:54.651746 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651677    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-service-ca" (OuterVolumeSpecName: "service-ca") pod "78220961-8219-4139-8563-124c0d623ff1" (UID: "78220961-8219-4139-8563-124c0d623ff1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:01:54.651746 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.651686    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78220961-8219-4139-8563-124c0d623ff1" (UID: "78220961-8219-4139-8563-124c0d623ff1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:01:54.653632 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.653604    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78220961-8219-4139-8563-124c0d623ff1-kube-api-access-dtgw7" (OuterVolumeSpecName: "kube-api-access-dtgw7") pod "78220961-8219-4139-8563-124c0d623ff1" (UID: "78220961-8219-4139-8563-124c0d623ff1"). InnerVolumeSpecName "kube-api-access-dtgw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:01:54.653744 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.653624    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78220961-8219-4139-8563-124c0d623ff1" (UID: "78220961-8219-4139-8563-124c0d623ff1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:01:54.653744 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.653642    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78220961-8219-4139-8563-124c0d623ff1" (UID: "78220961-8219-4139-8563-124c0d623ff1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:01:54.752416 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.752377    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-service-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:01:54.752416 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.752413    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtgw7\" (UniqueName: \"kubernetes.io/projected/78220961-8219-4139-8563-124c0d623ff1-kube-api-access-dtgw7\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:01:54.752416 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.752424    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-oauth-config\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:01:54.752648 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.752434    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78220961-8219-4139-8563-124c0d623ff1-console-serving-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:01:54.752648 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:54.752467    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78220961-8219-4139-8563-124c0d623ff1-trusted-ca-bundle\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:01:55.394704 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.394672    2567 generic.go:356] "Generic (PLEG): container finished" podID="78220961-8219-4139-8563-124c0d623ff1" containerID="0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6" exitCode=0
Jul 23 10:01:55.395132 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.394714    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7f9f58cd-hkd58"
Jul 23 10:01:55.395132 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.394755    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7f9f58cd-hkd58" event={"ID":"78220961-8219-4139-8563-124c0d623ff1","Type":"ContainerDied","Data":"0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6"}
Jul 23 10:01:55.395132 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.394799    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7f9f58cd-hkd58" event={"ID":"78220961-8219-4139-8563-124c0d623ff1","Type":"ContainerDied","Data":"a0229029a8677bf5a878060e0afb67a7ab56b49bff84b111221d7875a74f19f1"}
Jul 23 10:01:55.395132 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.394820    2567 scope.go:117] "RemoveContainer" containerID="0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6"
Jul 23 10:01:55.404797 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.404778    2567 scope.go:117] "RemoveContainer" containerID="0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6"
Jul 23 10:01:55.405094 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:01:55.405076    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6\": container with ID starting with 0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6 not found: ID does not exist" containerID="0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6"
Jul 23 10:01:55.405145 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.405102    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6"} err="failed to get container status \"0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6\": rpc error: code = NotFound desc = could not find container \"0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6\": container with ID starting with 0123631de6f31ae251a91f35dc8159fd1c361b48de3e0fd48a000ce6c46df0a6 not found: ID does not exist"
Jul 23 10:01:55.417554 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.417525    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7f9f58cd-hkd58"]
Jul 23 10:01:55.422295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:55.422271    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7f9f58cd-hkd58"]
Jul 23 10:01:56.231412 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:01:56.231382    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78220961-8219-4139-8563-124c0d623ff1" path="/var/lib/kubelet/pods/78220961-8219-4139-8563-124c0d623ff1/volumes"
Jul 23 10:02:15.783440 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.783353    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"]
Jul 23 10:02:15.783911 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.783728    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78220961-8219-4139-8563-124c0d623ff1" containerName="console"
Jul 23 10:02:15.783911 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.783739    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="78220961-8219-4139-8563-124c0d623ff1" containerName="console"
Jul 23 10:02:15.783911 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.783773    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" containerName="istio-proxy"
Jul 23 10:02:15.783911 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.783779    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" containerName="istio-proxy"
Jul 23 10:02:15.783911 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.783833    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="78220961-8219-4139-8563-124c0d623ff1" containerName="console"
Jul 23 10:02:15.783911 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.783846    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8beaaf11-89e0-4da0-bdd9-fd26bb5b1334" containerName="istio-proxy"
Jul 23 10:02:15.787318 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.787298    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.790192 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.790175    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-f5z8m\""
Jul 23 10:02:15.796935 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.796905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"]
Jul 23 10:02:15.822726 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.822694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.822899 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.822746    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.822899 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.822792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ee7728-74b0-44f9-8571-5312875dbc60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.822899 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.822830    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.822899 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.822862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.823047 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.822925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp2d4\" (UniqueName: \"kubernetes.io/projected/a7ee7728-74b0-44f9-8571-5312875dbc60-kube-api-access-zp2d4\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.823047 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.822960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.823047 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.822990    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.823194 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.823082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924086 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924086 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924367 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924132    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924367 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ee7728-74b0-44f9-8571-5312875dbc60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924367 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924367 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924347    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp2d4\" (UniqueName: \"kubernetes.io/projected/a7ee7728-74b0-44f9-8571-5312875dbc60-kube-api-access-zp2d4\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924764 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924585    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924764 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924724    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924877 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.924947 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.924896    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7ee7728-74b0-44f9-8571-5312875dbc60-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.926801 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.926781    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.927019 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.926998    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.934874 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.934847    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7ee7728-74b0-44f9-8571-5312875dbc60-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:15.934989 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:15.934875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp2d4\" (UniqueName: \"kubernetes.io/projected/a7ee7728-74b0-44f9-8571-5312875dbc60-kube-api-access-zp2d4\") pod \"maas-default-gateway-openshift-default-56654dcf7-qbb77\" (UID: \"a7ee7728-74b0-44f9-8571-5312875dbc60\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:16.098287 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:16.098163    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:16.245655 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:16.245621    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"]
Jul 23 10:02:16.248720 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:02:16.248691    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7ee7728_74b0_44f9_8571_5312875dbc60.slice/crio-37b498ef3ececfc9ee60457da73aaaece7ffae0174325460457f64c335182ea1 WatchSource:0}: Error finding container 37b498ef3ececfc9ee60457da73aaaece7ffae0174325460457f64c335182ea1: Status 404 returned error can't find the container with id 37b498ef3ececfc9ee60457da73aaaece7ffae0174325460457f64c335182ea1
Jul 23 10:02:16.250966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:16.250934    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:02:16.251042 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:16.251009    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:02:16.251042 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:16.251038    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:02:16.499832 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:16.499802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" event={"ID":"a7ee7728-74b0-44f9-8571-5312875dbc60","Type":"ContainerStarted","Data":"264fdc55cd825fc0694650a5c0269011a359d6b58a241f1fd9aa0fd4457f6355"}
Jul 23 10:02:16.500006 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:16.499850    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" event={"ID":"a7ee7728-74b0-44f9-8571-5312875dbc60","Type":"ContainerStarted","Data":"37b498ef3ececfc9ee60457da73aaaece7ffae0174325460457f64c335182ea1"}
Jul 23 10:02:16.526260 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:16.520512    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" podStartSLOduration=1.520490987 podStartE2EDuration="1.520490987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:02:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:02:16.519356679 +0000 UTC m=+460.757551929" watchObservedRunningTime="2026-07-23 10:02:16.520490987 +0000 UTC m=+460.758686231"
Jul 23 10:02:17.098766 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:17.098725    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:17.103885 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:17.103857    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:17.504515 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:17.504485    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:02:17.505527 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:02:17.505500    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:03:42.913317 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:42.913285    2567 generic.go:356] "Generic (PLEG): container finished" podID="a7ee7728-74b0-44f9-8571-5312875dbc60" containerID="264fdc55cd825fc0694650a5c0269011a359d6b58a241f1fd9aa0fd4457f6355" exitCode=0
Jul 23 10:03:42.913836 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:42.913324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" event={"ID":"a7ee7728-74b0-44f9-8571-5312875dbc60","Type":"ContainerDied","Data":"264fdc55cd825fc0694650a5c0269011a359d6b58a241f1fd9aa0fd4457f6355"}
Jul 23 10:03:42.913836 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:42.913768    2567 scope.go:117] "RemoveContainer" containerID="264fdc55cd825fc0694650a5c0269011a359d6b58a241f1fd9aa0fd4457f6355"
Jul 23 10:03:42.914794 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:42.914770    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:03:42.914848 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:42.914833    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:03:42.914888 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:42.914866    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:03:43.924510 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:43.924463    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" event={"ID":"a7ee7728-74b0-44f9-8571-5312875dbc60","Type":"ContainerStarted","Data":"7725336df7cfe928d419ccb58ebd1b8ddf5ab01fcf5613c4b988c5a8f18344f5"}
Jul 23 10:03:44.098500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:44.098463    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:03:44.099592 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:44.099563    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qbb77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 23 10:03:44.099716 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:44.099612    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" podUID="a7ee7728-74b0-44f9-8571-5312875dbc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 23 10:03:45.098772 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:45.098735    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qbb77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 23 10:03:45.099138 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:45.098803    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" podUID="a7ee7728-74b0-44f9-8571-5312875dbc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 23 10:03:46.099400 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:46.099365    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qbb77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 23 10:03:46.099811 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:46.099428    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" podUID="a7ee7728-74b0-44f9-8571-5312875dbc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 23 10:03:47.098911 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:47.098875    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qbb77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 23 10:03:47.099105 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:47.098934    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77" podUID="a7ee7728-74b0-44f9-8571-5312875dbc60" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 23 10:03:47.505265 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:47.505215    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:03:48.102813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:48.102785    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:03:48.103663 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:03:48.103641    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qbb77"
Jul 23 10:04:16.677565 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.677534    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"]
Jul 23 10:04:16.681043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.681024    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.683512 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.683493    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 10:04:16.684620 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.684601    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 23 10:04:16.684716 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.684644    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 10:04:16.684778 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.684649    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qxbzn\""
Jul 23 10:04:16.690223 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.690201    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"]
Jul 23 10:04:16.813094 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.813062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.813284 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.813104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a98ecb1-4714-4cf1-891b-7d38f33168c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.813284 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.813138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrtrg\" (UniqueName: \"kubernetes.io/projected/5a98ecb1-4714-4cf1-891b-7d38f33168c7-kube-api-access-xrtrg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.813284 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.813184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.813284 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.813230    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.813423 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.813307    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.913990 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.913955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.914165 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.914021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.914165 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.914049    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.914165 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.914094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.914165 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.914127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a98ecb1-4714-4cf1-891b-7d38f33168c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.914165 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.914158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrtrg\" (UniqueName: \"kubernetes.io/projected/5a98ecb1-4714-4cf1-891b-7d38f33168c7-kube-api-access-xrtrg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.914528 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.914502    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.914610 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.914511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.914610 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.914551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.916527 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.916505    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a98ecb1-4714-4cf1-891b-7d38f33168c7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.916671 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.916655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a98ecb1-4714-4cf1-891b-7d38f33168c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.921902 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.921881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrtrg\" (UniqueName: \"kubernetes.io/projected/5a98ecb1-4714-4cf1-891b-7d38f33168c7-kube-api-access-xrtrg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bnfd2\" (UID: \"5a98ecb1-4714-4cf1-891b-7d38f33168c7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:16.992620 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:16.992549    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:17.131497 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:17.131389    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"]
Jul 23 10:04:17.133596 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:04:17.133567    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a98ecb1_4714_4cf1_891b_7d38f33168c7.slice/crio-b4564a64671bdc375632b4efb240c5f4cf473517c932bcb17c9a1cfffd715760 WatchSource:0}: Error finding container b4564a64671bdc375632b4efb240c5f4cf473517c932bcb17c9a1cfffd715760: Status 404 returned error can't find the container with id b4564a64671bdc375632b4efb240c5f4cf473517c932bcb17c9a1cfffd715760
Jul 23 10:04:18.084578 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:18.084544    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2" event={"ID":"5a98ecb1-4714-4cf1-891b-7d38f33168c7","Type":"ContainerStarted","Data":"b4564a64671bdc375632b4efb240c5f4cf473517c932bcb17c9a1cfffd715760"}
Jul 23 10:04:19.091327 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:19.091287    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2" event={"ID":"5a98ecb1-4714-4cf1-891b-7d38f33168c7","Type":"ContainerStarted","Data":"e3ddbf971ab4891a3e7d100985f91f2a29cd042e3887b11a68007f691c0bdae9"}
Jul 23 10:04:19.108055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:19.108002    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2" podStartSLOduration=2.074328817 podStartE2EDuration="3.10798682s" totalImagesPullingTime="1.033658003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:04:19.107167565 +0000 UTC m=+583.345362818" watchObservedRunningTime="2026-07-23 10:04:19.10798682 +0000 UTC m=+583.346182073"
Jul 23 10:04:26.993608 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:26.993574    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:26.994065 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:26.993637    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:27.006153 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:27.006132    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:27.139227 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:27.139198    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bnfd2"
Jul 23 10:04:36.180454 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:36.180422    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:04:36.180869 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:04:36.180422    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:09:36.208508 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:09:36.208425    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:09:36.209923 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:09:36.209902    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:14:36.243252 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:14:36.243217    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:14:36.245615 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:14:36.245377    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:15:00.142154 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:00.142124    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d"]
Jul 23 10:15:00.145493 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:00.145478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d"
Jul 23 10:15:00.148425 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:00.148406    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2vbpd\""
Jul 23 10:15:00.153019 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:00.152968    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d"]
Jul 23 10:15:00.156332 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:00.156315    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d"
Jul 23 10:15:00.294858 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:00.294834    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d"]
Jul 23 10:15:00.296620 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:15:00.296590    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8eaf5f_2692_418a_8d82_8c375996ef06.slice/crio-b16a539b2dc8fff25cd888ec0dd1b43e87952675cf291f12dd72b563157712df WatchSource:0}: Error finding container b16a539b2dc8fff25cd888ec0dd1b43e87952675cf291f12dd72b563157712df: Status 404 returned error can't find the container with id b16a539b2dc8fff25cd888ec0dd1b43e87952675cf291f12dd72b563157712df
Jul 23 10:15:00.298466 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:00.298451    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 10:15:01.104409 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:01.104374    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d" event={"ID":"0a8eaf5f-2692-418a-8d82-8c375996ef06","Type":"ContainerStarted","Data":"b16a539b2dc8fff25cd888ec0dd1b43e87952675cf291f12dd72b563157712df"}
Jul 23 10:15:03.116546 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:03.116509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d" event={"ID":"0a8eaf5f-2692-418a-8d82-8c375996ef06","Type":"ContainerStarted","Data":"da9036feed029c4f252c814440e27d5dfabe34307329572682ae14b6d386c9dc"}
Jul 23 10:15:03.132387 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:03.132334    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d" podStartSLOduration=0.948119311 podStartE2EDuration="3.132320713s" totalImagesPullingTime="2.184201402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:15:03.131991654 +0000 UTC m=+1227.370186905" watchObservedRunningTime="2026-07-23 10:15:03.132320713 +0000 UTC m=+1227.370515964"
Jul 23 10:15:04.122966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:04.122934    2567 generic.go:356] "Generic (PLEG): container finished" podID="0a8eaf5f-2692-418a-8d82-8c375996ef06" containerID="da9036feed029c4f252c814440e27d5dfabe34307329572682ae14b6d386c9dc" exitCode=0
Jul 23 10:15:04.123359 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:04.123007    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d" event={"ID":"0a8eaf5f-2692-418a-8d82-8c375996ef06","Type":"ContainerDied","Data":"da9036feed029c4f252c814440e27d5dfabe34307329572682ae14b6d386c9dc"}
Jul 23 10:15:05.257142 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:05.257117    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d"
Jul 23 10:15:06.134491 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:06.134454    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d" event={"ID":"0a8eaf5f-2692-418a-8d82-8c375996ef06","Type":"ContainerDied","Data":"b16a539b2dc8fff25cd888ec0dd1b43e87952675cf291f12dd72b563157712df"}
Jul 23 10:15:06.134734 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:06.134516    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b16a539b2dc8fff25cd888ec0dd1b43e87952675cf291f12dd72b563157712df"
Jul 23 10:15:06.134734 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:15:06.134455    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746695-4mp2d"
Jul 23 10:16:46.188182 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.188150    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"]
Jul 23 10:16:46.188672 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.188546    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a8eaf5f-2692-418a-8d82-8c375996ef06" containerName="cleanup"
Jul 23 10:16:46.188672 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.188559    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a8eaf5f-2692-418a-8d82-8c375996ef06" containerName="cleanup"
Jul 23 10:16:46.188672 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.188646    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a8eaf5f-2692-418a-8d82-8c375996ef06" containerName="cleanup"
Jul 23 10:16:46.199665 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.199628    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.202436 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.202416    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-74f8816a-kserve-self-signed-certs\""
Jul 23 10:16:46.206454 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.206407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"]
Jul 23 10:16:46.373683 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.373651    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-home\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.373683 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.373682    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-model-cache\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.373902 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.373714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-dshm\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.373902 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.373737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-tmp-dir\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.373902 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.373758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frm5z\" (UniqueName: \"kubernetes.io/projected/2a42f178-4c55-4889-86e2-b568999a96de-kube-api-access-frm5z\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.373902 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.373782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a42f178-4c55-4889-86e2-b568999a96de-tls-certs\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.474836 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.474757    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-home\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.474836 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.474788    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-model-cache\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.474836 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.474821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-dshm\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.475094 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.474842    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-tmp-dir\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.475094 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.474858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frm5z\" (UniqueName: \"kubernetes.io/projected/2a42f178-4c55-4889-86e2-b568999a96de-kube-api-access-frm5z\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.475094 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.474879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a42f178-4c55-4889-86e2-b568999a96de-tls-certs\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.475264 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.475210    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-home\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.475264 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.475224    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-model-cache\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.475378 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.475332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-tmp-dir\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.477430 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.477400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-dshm\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.477555 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.477515    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a42f178-4c55-4889-86e2-b568999a96de-tls-certs\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.482809 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.482786    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frm5z\" (UniqueName: \"kubernetes.io/projected/2a42f178-4c55-4889-86e2-b568999a96de-kube-api-access-frm5z\") pod \"e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") " pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.509870 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.509828    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:46.651606 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:46.651579    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"]
Jul 23 10:16:46.654363 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:16:46.654331    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a42f178_4c55_4889_86e2_b568999a96de.slice/crio-658bd655e2ddeeaaa2b5d363082cfcb7f0f018bfde92ede851da13b75c57d9e1 WatchSource:0}: Error finding container 658bd655e2ddeeaaa2b5d363082cfcb7f0f018bfde92ede851da13b75c57d9e1: Status 404 returned error can't find the container with id 658bd655e2ddeeaaa2b5d363082cfcb7f0f018bfde92ede851da13b75c57d9e1
Jul 23 10:16:47.606188 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:47.606153    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd" event={"ID":"2a42f178-4c55-4889-86e2-b568999a96de","Type":"ContainerStarted","Data":"a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8"}
Jul 23 10:16:47.606608 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:47.606194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd" event={"ID":"2a42f178-4c55-4889-86e2-b568999a96de","Type":"ContainerStarted","Data":"658bd655e2ddeeaaa2b5d363082cfcb7f0f018bfde92ede851da13b75c57d9e1"}
Jul 23 10:16:47.624485 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:47.624436    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd" podStartSLOduration=1.624419458 podStartE2EDuration="1.624419458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:16:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:16:47.623587643 +0000 UTC m=+1331.861782896" watchObservedRunningTime="2026-07-23 10:16:47.624419458 +0000 UTC m=+1331.862614709"
Jul 23 10:16:56.510740 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:56.510651    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:56.510740 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:56.510716    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:56.523272 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:56.523216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:16:56.660440 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:16:56.660404    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:17:18.404511 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:18.404419    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"]
Jul 23 10:17:33.426115 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.426054    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd" podUID="2a42f178-4c55-4889-86e2-b568999a96de" containerName="main" containerID="cri-o://a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8" gracePeriod=45
Jul 23 10:17:33.666850 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.666826    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:17:33.817038 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.816938    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-home\") pod \"2a42f178-4c55-4889-86e2-b568999a96de\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") "
Jul 23 10:17:33.817038 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817006    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a42f178-4c55-4889-86e2-b568999a96de-tls-certs\") pod \"2a42f178-4c55-4889-86e2-b568999a96de\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") "
Jul 23 10:17:33.817298 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817078    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-model-cache\") pod \"2a42f178-4c55-4889-86e2-b568999a96de\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") "
Jul 23 10:17:33.817298 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817107    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-dshm\") pod \"2a42f178-4c55-4889-86e2-b568999a96de\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") "
Jul 23 10:17:33.817298 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817187    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frm5z\" (UniqueName: \"kubernetes.io/projected/2a42f178-4c55-4889-86e2-b568999a96de-kube-api-access-frm5z\") pod \"2a42f178-4c55-4889-86e2-b568999a96de\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") "
Jul 23 10:17:33.817298 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817267    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-tmp-dir\") pod \"2a42f178-4c55-4889-86e2-b568999a96de\" (UID: \"2a42f178-4c55-4889-86e2-b568999a96de\") "
Jul 23 10:17:33.817813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817289    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-home" (OuterVolumeSpecName: "home") pod "2a42f178-4c55-4889-86e2-b568999a96de" (UID: "2a42f178-4c55-4889-86e2-b568999a96de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:17:33.817813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817306    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a42f178-4c55-4889-86e2-b568999a96de" (UID: "2a42f178-4c55-4889-86e2-b568999a96de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:17:33.817813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817482    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a42f178-4c55-4889-86e2-b568999a96de" (UID: "2a42f178-4c55-4889-86e2-b568999a96de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:17:33.817813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817627    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-model-cache\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:17:33.817813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817650    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-tmp-dir\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:17:33.817813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.817662    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-home\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:17:33.819503 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.819485    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-dshm" (OuterVolumeSpecName: "dshm") pod "2a42f178-4c55-4889-86e2-b568999a96de" (UID: "2a42f178-4c55-4889-86e2-b568999a96de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:17:33.819582 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.819528    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a42f178-4c55-4889-86e2-b568999a96de-kube-api-access-frm5z" (OuterVolumeSpecName: "kube-api-access-frm5z") pod "2a42f178-4c55-4889-86e2-b568999a96de" (UID: "2a42f178-4c55-4889-86e2-b568999a96de"). InnerVolumeSpecName "kube-api-access-frm5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:17:33.819637 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.819587    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a42f178-4c55-4889-86e2-b568999a96de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a42f178-4c55-4889-86e2-b568999a96de" (UID: "2a42f178-4c55-4889-86e2-b568999a96de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:17:33.842163 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.842134    2567 generic.go:356] "Generic (PLEG): container finished" podID="2a42f178-4c55-4889-86e2-b568999a96de" containerID="a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8" exitCode=0
Jul 23 10:17:33.842333 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.842181    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"
Jul 23 10:17:33.842333 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.842216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd" event={"ID":"2a42f178-4c55-4889-86e2-b568999a96de","Type":"ContainerDied","Data":"a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8"}
Jul 23 10:17:33.842333 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.842275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd" event={"ID":"2a42f178-4c55-4889-86e2-b568999a96de","Type":"ContainerDied","Data":"658bd655e2ddeeaaa2b5d363082cfcb7f0f018bfde92ede851da13b75c57d9e1"}
Jul 23 10:17:33.842333 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.842292    2567 scope.go:117] "RemoveContainer" containerID="a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8"
Jul 23 10:17:33.851614 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.851591    2567 scope.go:117] "RemoveContainer" containerID="a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8"
Jul 23 10:17:33.851874 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:17:33.851853    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8\": container with ID starting with a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8 not found: ID does not exist" containerID="a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8"
Jul 23 10:17:33.851942 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.851887    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8"} err="failed to get container status \"a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8\": rpc error: code = NotFound desc = could not find container \"a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8\": container with ID starting with a03e8fed846ac661dc234417df7c33575b45ad0197664d3f4161354e659a44a8 not found: ID does not exist"
Jul 23 10:17:33.863481 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.863450    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"]
Jul 23 10:17:33.867020 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.866998    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-74f8816a-kserve-76c7f9b887-pwnwd"]
Jul 23 10:17:33.918217 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.918189    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a42f178-4c55-4889-86e2-b568999a96de-tls-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:17:33.918217 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.918210    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a42f178-4c55-4889-86e2-b568999a96de-dshm\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:17:33.918217 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:33.918218    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frm5z\" (UniqueName: \"kubernetes.io/projected/2a42f178-4c55-4889-86e2-b568999a96de-kube-api-access-frm5z\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:17:34.230966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:17:34.230937    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a42f178-4c55-4889-86e2-b568999a96de" path="/var/lib/kubelet/pods/2a42f178-4c55-4889-86e2-b568999a96de/volumes"
Jul 23 10:19:36.272750 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:19:36.272641    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:19:36.276694 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:19:36.274784    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:20:57.691111 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.691078    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"]
Jul 23 10:20:57.691601 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.691468    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a42f178-4c55-4889-86e2-b568999a96de" containerName="main"
Jul 23 10:20:57.691601 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.691480    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a42f178-4c55-4889-86e2-b568999a96de" containerName="main"
Jul 23 10:20:57.691601 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.691552    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a42f178-4c55-4889-86e2-b568999a96de" containerName="main"
Jul 23 10:20:57.694433 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.694417    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.697042 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.697027    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-fc7ad5db-openshift-default-dockercfg-tgkfk\""
Jul 23 10:20:57.713653 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.713627    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"]
Jul 23 10:20:57.720087 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720045    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-certs\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.720218 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720114    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-token\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.720218 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkkd6\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-kube-api-access-lkkd6\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.720218 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-credential-socket\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.720218 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-envoy\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.720417 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-podinfo\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.720417 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istiod-ca-cert\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.720417 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720323    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-socket\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.720417 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.720367    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-data\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821034 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkkd6\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-kube-api-access-lkkd6\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821262 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-credential-socket\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821262 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821092    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-envoy\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821262 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-podinfo\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821262 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821145    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istiod-ca-cert\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821262 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821195    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-socket\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821262 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821227    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-data\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821292    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-certs\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821338    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-token\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821726 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821664    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-credential-socket\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821783 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821716    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-socket\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.821783 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821753    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-certs\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.822055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821878    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-data\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.822055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.821969    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istiod-ca-cert\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.823611 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.823591    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-envoy\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.823839 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.823821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-podinfo\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.833969 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.833948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkkd6\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-kube-api-access-lkkd6\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:57.837402 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:57.837380    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-token\") pod \"e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") " pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:58.003971 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:58.003889    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:58.154273 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:58.154229    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"]
Jul 23 10:20:58.156520 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:20:58.156494    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689eaf6a_ef7b_4b33_b6e3_727f70486f11.slice/crio-dc11bcfe949245fbc0de2f7c274bdc3706bacafdafe13d4d13b45e4a0331a9b3 WatchSource:0}: Error finding container dc11bcfe949245fbc0de2f7c274bdc3706bacafdafe13d4d13b45e4a0331a9b3: Status 404 returned error can't find the container with id dc11bcfe949245fbc0de2f7c274bdc3706bacafdafe13d4d13b45e4a0331a9b3
Jul 23 10:20:58.158993 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:58.158962    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:20:58.159075 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:58.159025    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:20:58.159075 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:58.159052    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:20:58.811136 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:58.811094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" event={"ID":"689eaf6a-ef7b-4b33-b6e3-727f70486f11","Type":"ContainerStarted","Data":"febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4"}
Jul 23 10:20:58.811631 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:58.811157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" event={"ID":"689eaf6a-ef7b-4b33-b6e3-727f70486f11","Type":"ContainerStarted","Data":"dc11bcfe949245fbc0de2f7c274bdc3706bacafdafe13d4d13b45e4a0331a9b3"}
Jul 23 10:20:58.837460 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:58.837411    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" podStartSLOduration=1.837396804 podStartE2EDuration="1.837396804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:20:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:20:58.835654687 +0000 UTC m=+1583.073849952" watchObservedRunningTime="2026-07-23 10:20:58.837396804 +0000 UTC m=+1583.075592056"
Jul 23 10:20:59.004985 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:59.004947    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:59.009962 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:59.009936    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:59.816315 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:59.816281    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:20:59.817335 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:20:59.817313    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:21:13.886688 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:13.886655    2567 generic.go:356] "Generic (PLEG): container finished" podID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerID="febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4" exitCode=0
Jul 23 10:21:13.887154 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:13.886738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" event={"ID":"689eaf6a-ef7b-4b33-b6e3-727f70486f11","Type":"ContainerDied","Data":"febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4"}
Jul 23 10:21:13.887154 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:13.887140    2567 scope.go:117] "RemoveContainer" containerID="febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4"
Jul 23 10:21:13.888198 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:13.888168    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:13.888320 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:13.888258    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:13.888320 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:13.888300    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:14.816639 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:14.816601    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:21:14.893780 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:14.893743    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" event={"ID":"689eaf6a-ef7b-4b33-b6e3-727f70486f11","Type":"ContainerStarted","Data":"f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670"}
Jul 23 10:21:15.004534 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:15.004496    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:21:15.005496 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:15.005463    2567 patch_prober.go:28] interesting pod/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 23 10:21:15.005625 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:15.005538    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 23 10:21:16.004403 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:16.004362    2567 patch_prober.go:28] interesting pod/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 23 10:21:16.004905 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:16.004439    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 23 10:21:17.005188 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:17.005144    2567 patch_prober.go:28] interesting pod/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 23 10:21:17.005716 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:17.005218    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 23 10:21:18.005751 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:18.005201    2567 patch_prober.go:28] interesting pod/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 23 10:21:18.005751 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:18.005329    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 23 10:21:19.008211 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:19.008178    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:21:19.008614 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:19.008486    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:21:19.009083 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:19.009066    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:21:25.780859 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:25.780829    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"]
Jul 23 10:21:25.783332 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:25.783315    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"
Jul 23 10:21:25.785983 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:25.785955    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2vbpd\""
Jul 23 10:21:25.786122 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:25.786024    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 10:21:25.791728 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:25.791706    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"]
Jul 23 10:21:25.904119 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:25.904070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94a9e2b8-e426-4461-8ee6-1448c91d4bf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64\" (UID: \"94a9e2b8-e426-4461-8ee6-1448c91d4bf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"
Jul 23 10:21:26.004960 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:26.004927    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94a9e2b8-e426-4461-8ee6-1448c91d4bf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64\" (UID: \"94a9e2b8-e426-4461-8ee6-1448c91d4bf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"
Jul 23 10:21:26.005612 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:26.005585    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94a9e2b8-e426-4461-8ee6-1448c91d4bf5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64\" (UID: \"94a9e2b8-e426-4461-8ee6-1448c91d4bf5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"
Jul 23 10:21:26.094607 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:26.094498    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"
Jul 23 10:21:26.436366 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:26.436339    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"]
Jul 23 10:21:26.438409 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:21:26.438383    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a9e2b8_e426_4461_8ee6_1448c91d4bf5.slice/crio-75e02c7268071fee23e79f6795f8d29f7ef19219adacb3930366123e7a8764a9 WatchSource:0}: Error finding container 75e02c7268071fee23e79f6795f8d29f7ef19219adacb3930366123e7a8764a9: Status 404 returned error can't find the container with id 75e02c7268071fee23e79f6795f8d29f7ef19219adacb3930366123e7a8764a9
Jul 23 10:21:26.955827 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:26.955791    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64" event={"ID":"94a9e2b8-e426-4461-8ee6-1448c91d4bf5","Type":"ContainerStarted","Data":"726e245bafc652ff4b9116b1ffa67756e65a06664243640b576fff3b466baa76"}
Jul 23 10:21:26.956215 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:26.955849    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64" event={"ID":"94a9e2b8-e426-4461-8ee6-1448c91d4bf5","Type":"ContainerStarted","Data":"75e02c7268071fee23e79f6795f8d29f7ef19219adacb3930366123e7a8764a9"}
Jul 23 10:21:26.971500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:26.971412    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64" podStartSLOduration=1.971396955 podStartE2EDuration="1.971396955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:21:26.970127891 +0000 UTC m=+1611.208323142" watchObservedRunningTime="2026-07-23 10:21:26.971396955 +0000 UTC m=+1611.209592206"
Jul 23 10:21:27.961950 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:27.961919    2567 generic.go:356] "Generic (PLEG): container finished" podID="94a9e2b8-e426-4461-8ee6-1448c91d4bf5" containerID="726e245bafc652ff4b9116b1ffa67756e65a06664243640b576fff3b466baa76" exitCode=0
Jul 23 10:21:27.962388 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:27.961971    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64" event={"ID":"94a9e2b8-e426-4461-8ee6-1448c91d4bf5","Type":"ContainerDied","Data":"726e245bafc652ff4b9116b1ffa67756e65a06664243640b576fff3b466baa76"}
Jul 23 10:21:29.104745 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:29.104719    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"
Jul 23 10:21:29.132197 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:29.132171    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94a9e2b8-e426-4461-8ee6-1448c91d4bf5-maas-api-service-ca\") pod \"94a9e2b8-e426-4461-8ee6-1448c91d4bf5\" (UID: \"94a9e2b8-e426-4461-8ee6-1448c91d4bf5\") "
Jul 23 10:21:29.132540 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:29.132517    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94a9e2b8-e426-4461-8ee6-1448c91d4bf5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "94a9e2b8-e426-4461-8ee6-1448c91d4bf5" (UID: "94a9e2b8-e426-4461-8ee6-1448c91d4bf5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:21:29.233554 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:29.233461    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94a9e2b8-e426-4461-8ee6-1448c91d4bf5-maas-api-service-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:29.973422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:29.973391    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"
Jul 23 10:21:29.973422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:29.973406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64" event={"ID":"94a9e2b8-e426-4461-8ee6-1448c91d4bf5","Type":"ContainerDied","Data":"75e02c7268071fee23e79f6795f8d29f7ef19219adacb3930366123e7a8764a9"}
Jul 23 10:21:29.973649 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:29.973453    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75e02c7268071fee23e79f6795f8d29f7ef19219adacb3930366123e7a8764a9"
Jul 23 10:21:40.851923 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:40.851874    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"]
Jul 23 10:21:40.853824 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:40.853800    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fc7ad5db-vfw64"]
Jul 23 10:21:40.987298 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:40.987261    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"]
Jul 23 10:21:40.987533 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:40.987508    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy" containerID="cri-o://f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670" gracePeriod=30
Jul 23 10:21:42.023305 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.023272    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"]
Jul 23 10:21:42.023676 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.023632    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a9e2b8-e426-4461-8ee6-1448c91d4bf5" containerName="revoke-keys"
Jul 23 10:21:42.023676 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.023643    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a9e2b8-e426-4461-8ee6-1448c91d4bf5" containerName="revoke-keys"
Jul 23 10:21:42.023747 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.023718    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a9e2b8-e426-4461-8ee6-1448c91d4bf5" containerName="revoke-keys"
Jul 23 10:21:42.025897 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.025882    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.028614 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.028591    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c3044c8a-gw-openshift-default-dockercfg-g78sx\""
Jul 23 10:21:42.040277 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.040250    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"]
Jul 23 10:21:42.143061 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143025    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-certs\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.143061 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdng\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-kube-api-access-cmdng\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.143308 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143083    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-socket\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.143308 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-credential-socket\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.143308 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-token\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.143308 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-data\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.143308 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c629f02e-8e12-4fac-a81d-f4694046bde3-istiod-ca-cert\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.143468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-podinfo\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.143468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.143330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-envoy\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.231584 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.231550    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a9e2b8-e426-4461-8ee6-1448c91d4bf5" path="/var/lib/kubelet/pods/94a9e2b8-e426-4461-8ee6-1448c91d4bf5/volumes"
Jul 23 10:21:42.244032 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-data\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244159 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244034    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c629f02e-8e12-4fac-a81d-f4694046bde3-istiod-ca-cert\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244159 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-podinfo\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244159 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244091    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-envoy\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244369 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-certs\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244369 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdng\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-kube-api-access-cmdng\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244545 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-socket\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244545 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244432    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-credential-socket\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244545 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-token\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244545 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244496    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-data\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244814 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244791    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-credential-socket\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244907 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244887    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-socket\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.244951 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.244917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-certs\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.245164 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.245143    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c629f02e-8e12-4fac-a81d-f4694046bde3-istiod-ca-cert\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.246520 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.246502    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-envoy\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.246838 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.246817    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-podinfo\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.256542 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.256518    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-token\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.273950 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.273883    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdng\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-kube-api-access-cmdng\") pod \"e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") " pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.337054 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.337019    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:42.475633 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.475609    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"]
Jul 23 10:21:42.477395 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:21:42.477363    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc629f02e_8e12_4fac_a81d_f4694046bde3.slice/crio-199f4d9a924a1df444773d6ad38fed2fd2689ae46af08d81461b817752b8ff00 WatchSource:0}: Error finding container 199f4d9a924a1df444773d6ad38fed2fd2689ae46af08d81461b817752b8ff00: Status 404 returned error can't find the container with id 199f4d9a924a1df444773d6ad38fed2fd2689ae46af08d81461b817752b8ff00
Jul 23 10:21:42.479414 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.479380    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:42.479475 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.479448    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:42.479508 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:42.479474    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:43.041797 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:43.041762    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" event={"ID":"c629f02e-8e12-4fac-a81d-f4694046bde3","Type":"ContainerStarted","Data":"0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4"}
Jul 23 10:21:43.042266 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:43.041823    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" event={"ID":"c629f02e-8e12-4fac-a81d-f4694046bde3","Type":"ContainerStarted","Data":"199f4d9a924a1df444773d6ad38fed2fd2689ae46af08d81461b817752b8ff00"}
Jul 23 10:21:43.064887 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:43.064839    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" podStartSLOduration=1.064823413 podStartE2EDuration="1.064823413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:21:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:21:43.06215142 +0000 UTC m=+1627.300346672" watchObservedRunningTime="2026-07-23 10:21:43.064823413 +0000 UTC m=+1627.303018664"
Jul 23 10:21:43.337461 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:43.337374    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:43.342127 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:43.342101    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:44.046209 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:44.046175    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:44.047366 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:44.047346    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:46.242976 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.242956    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:21:46.284686 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284615    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-data\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.284842 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284702    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkkd6\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-kube-api-access-lkkd6\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.284842 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284723    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istiod-ca-cert\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.284842 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284746    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-podinfo\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.284842 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284774    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-socket\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.284842 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284800    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-token\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.284842 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284822    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-envoy\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.285137 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284859    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-certs\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.285137 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.284893    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-credential-socket\") pod \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\" (UID: \"689eaf6a-ef7b-4b33-b6e3-727f70486f11\") "
Jul 23 10:21:46.285268 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.285120    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:21:46.285268 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.285249    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:46.285395 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.285370    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:21:46.285585 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.285537    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:21:46.285585 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.285546    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-data" (OuterVolumeSpecName: "istio-data") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:21:46.285812 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.285649    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:21:46.287287 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.287211    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:21:46.287477 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.287454    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-token" (OuterVolumeSpecName: "istio-token") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:21:46.287730 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.287701    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:21:46.287807 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.287727    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-kube-api-access-lkkd6" (OuterVolumeSpecName: "kube-api-access-lkkd6") pod "689eaf6a-ef7b-4b33-b6e3-727f70486f11" (UID: "689eaf6a-ef7b-4b33-b6e3-727f70486f11"). InnerVolumeSpecName "kube-api-access-lkkd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:21:46.386468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.386429    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkkd6\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-kube-api-access-lkkd6\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:46.386468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.386462    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:46.386468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.386474    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:46.386719 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.386486    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:46.386719 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.386497    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:46.386719 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.386508    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:46.386719 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.386518    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:46.386719 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:46.386529    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/689eaf6a-ef7b-4b33-b6e3-727f70486f11-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:21:47.060958 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.060920    2567 generic.go:356] "Generic (PLEG): container finished" podID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerID="f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670" exitCode=0
Jul 23 10:21:47.061148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.060986    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"
Jul 23 10:21:47.061148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.061004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" event={"ID":"689eaf6a-ef7b-4b33-b6e3-727f70486f11","Type":"ContainerDied","Data":"f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670"}
Jul 23 10:21:47.061148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.061085    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc" event={"ID":"689eaf6a-ef7b-4b33-b6e3-727f70486f11","Type":"ContainerDied","Data":"dc11bcfe949245fbc0de2f7c274bdc3706bacafdafe13d4d13b45e4a0331a9b3"}
Jul 23 10:21:47.061148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.061108    2567 scope.go:117] "RemoveContainer" containerID="f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670"
Jul 23 10:21:47.070306 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.070284    2567 scope.go:117] "RemoveContainer" containerID="febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4"
Jul 23 10:21:47.078394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.078371    2567 scope.go:117] "RemoveContainer" containerID="f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670"
Jul 23 10:21:47.078648 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:21:47.078629    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670\": container with ID starting with f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670 not found: ID does not exist" containerID="f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670"
Jul 23 10:21:47.078737 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.078660    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670"} err="failed to get container status \"f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670\": rpc error: code = NotFound desc = could not find container \"f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670\": container with ID starting with f3b4d16fff9613ca341954a4433cc0dad7aec1d8366828530e181346ae8b9670 not found: ID does not exist"
Jul 23 10:21:47.078737 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.078683    2567 scope.go:117] "RemoveContainer" containerID="febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4"
Jul 23 10:21:47.078947 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:21:47.078930    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4\": container with ID starting with febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4 not found: ID does not exist" containerID="febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4"
Jul 23 10:21:47.078987 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.078953    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4"} err="failed to get container status \"febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4\": rpc error: code = NotFound desc = could not find container \"febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4\": container with ID starting with febb7c473c9301da3c5db29a7c410d48b3c54b12f7616ddb3e09681443581fe4 not found: ID does not exist"
Jul 23 10:21:47.084170 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.084149    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"]
Jul 23 10:21:47.088561 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:47.088539    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-fc7ad5db-openshift-default-5c7fd5ff47-rmgvc"]
Jul 23 10:21:48.231872 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:48.231832    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" path="/var/lib/kubelet/pods/689eaf6a-ef7b-4b33-b6e3-727f70486f11/volumes"
Jul 23 10:21:58.116694 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:58.116659    2567 generic.go:356] "Generic (PLEG): container finished" podID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerID="0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4" exitCode=0
Jul 23 10:21:58.116694 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:58.116700    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" event={"ID":"c629f02e-8e12-4fac-a81d-f4694046bde3","Type":"ContainerDied","Data":"0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4"}
Jul 23 10:21:58.117185 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:58.117095    2567 scope.go:117] "RemoveContainer" containerID="0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4"
Jul 23 10:21:58.118085 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:58.118061    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:58.118143 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:58.118128    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:58.118181 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:58.118162    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:21:59.046518 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:59.046481    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:59.127369 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:59.127335    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" event={"ID":"c629f02e-8e12-4fac-a81d-f4694046bde3","Type":"ContainerStarted","Data":"40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86"}
Jul 23 10:21:59.338078 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:59.337986    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:21:59.339023 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:59.339001    2567 patch_prober.go:28] interesting pod/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 23 10:21:59.339107 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:21:59.339048    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 23 10:22:00.338346 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:00.338308    2567 patch_prober.go:28] interesting pod/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 23 10:22:00.338756 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:00.338369    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 23 10:22:01.338256 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:01.338211    2567 patch_prober.go:28] interesting pod/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 23 10:22:01.338444 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:01.338292    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 23 10:22:02.338205 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:02.338173    2567 patch_prober.go:28] interesting pod/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 23 10:22:02.338428 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:02.338229    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 23 10:22:03.341005 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:03.340973    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:22:03.341426 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:03.341258    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:22:03.341865 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:03.341846    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:22:09.508294 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.508259    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"]
Jul 23 10:22:09.508675 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.508627    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy"
Jul 23 10:22:09.508675 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.508638    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy"
Jul 23 10:22:09.508748 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.508704    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy"
Jul 23 10:22:09.511681 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.511663    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"
Jul 23 10:22:09.514689 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.514668    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2vbpd\""
Jul 23 10:22:09.514803 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.514698    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 10:22:09.520813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.520783    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"]
Jul 23 10:22:09.621623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.621576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e154d09-73b2-4919-ac8d-053560c646af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn\" (UID: \"1e154d09-73b2-4919-ac8d-053560c646af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"
Jul 23 10:22:09.722863 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.722820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e154d09-73b2-4919-ac8d-053560c646af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn\" (UID: \"1e154d09-73b2-4919-ac8d-053560c646af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"
Jul 23 10:22:09.723486 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.723467    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e154d09-73b2-4919-ac8d-053560c646af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn\" (UID: \"1e154d09-73b2-4919-ac8d-053560c646af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"
Jul 23 10:22:09.823132 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.823030    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"
Jul 23 10:22:09.963475 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:09.963449    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"]
Jul 23 10:22:09.966225 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:22:09.966188    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e154d09_73b2_4919_ac8d_053560c646af.slice/crio-62af2ed60a37e8327604531308d6b0744e5915e7ca5bf0766142cfd23e616cfd WatchSource:0}: Error finding container 62af2ed60a37e8327604531308d6b0744e5915e7ca5bf0766142cfd23e616cfd: Status 404 returned error can't find the container with id 62af2ed60a37e8327604531308d6b0744e5915e7ca5bf0766142cfd23e616cfd
Jul 23 10:22:10.182492 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:10.182450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn" event={"ID":"1e154d09-73b2-4919-ac8d-053560c646af","Type":"ContainerStarted","Data":"62af2ed60a37e8327604531308d6b0744e5915e7ca5bf0766142cfd23e616cfd"}
Jul 23 10:22:11.188431 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:11.188396    2567 generic.go:356] "Generic (PLEG): container finished" podID="1e154d09-73b2-4919-ac8d-053560c646af" containerID="775077291dfc314f287ba6f40428c26ca63f1fb26d6da732e97b1b6280e558ed" exitCode=0
Jul 23 10:22:11.188832 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:11.188485    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn" event={"ID":"1e154d09-73b2-4919-ac8d-053560c646af","Type":"ContainerDied","Data":"775077291dfc314f287ba6f40428c26ca63f1fb26d6da732e97b1b6280e558ed"}
Jul 23 10:22:12.334529 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:12.334504    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"
Jul 23 10:22:12.349581 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:12.349542    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e154d09-73b2-4919-ac8d-053560c646af-maas-api-service-ca\") pod \"1e154d09-73b2-4919-ac8d-053560c646af\" (UID: \"1e154d09-73b2-4919-ac8d-053560c646af\") "
Jul 23 10:22:12.350041 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:12.350015    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e154d09-73b2-4919-ac8d-053560c646af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e154d09-73b2-4919-ac8d-053560c646af" (UID: "1e154d09-73b2-4919-ac8d-053560c646af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:22:12.450978 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:12.450889    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e154d09-73b2-4919-ac8d-053560c646af-maas-api-service-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:13.199346 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:13.199320    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"
Jul 23 10:22:13.199521 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:13.199362    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn" event={"ID":"1e154d09-73b2-4919-ac8d-053560c646af","Type":"ContainerDied","Data":"62af2ed60a37e8327604531308d6b0744e5915e7ca5bf0766142cfd23e616cfd"}
Jul 23 10:22:13.199521 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:13.199440    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62af2ed60a37e8327604531308d6b0744e5915e7ca5bf0766142cfd23e616cfd"
Jul 23 10:22:24.574969 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:24.574935    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"]
Jul 23 10:22:24.576666 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:24.576644    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c3044c8a-9mhfn"]
Jul 23 10:22:24.703859 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:24.703823    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"]
Jul 23 10:22:24.704060 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:24.704035    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy" containerID="cri-o://40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86" gracePeriod=30
Jul 23 10:22:25.479500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.479471    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"]
Jul 23 10:22:25.479845 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.479832    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy"
Jul 23 10:22:25.479893 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.479846    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy"
Jul 23 10:22:25.479893 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.479861    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e154d09-73b2-4919-ac8d-053560c646af" containerName="revoke-keys"
Jul 23 10:22:25.479893 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.479867    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e154d09-73b2-4919-ac8d-053560c646af" containerName="revoke-keys"
Jul 23 10:22:25.479994 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.479931    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e154d09-73b2-4919-ac8d-053560c646af" containerName="revoke-keys"
Jul 23 10:22:25.479994 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.479942    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="689eaf6a-ef7b-4b33-b6e3-727f70486f11" containerName="istio-proxy"
Jul 23 10:22:25.482966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.482948    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.485470 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.485448    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-07b9c24b-openshift-default-dockercfg-k94zh\""
Jul 23 10:22:25.497473 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.497448    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"]
Jul 23 10:22:25.581373 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.581324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-podinfo\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.581862 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.581407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istiod-ca-cert\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.581862 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.581432    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-token\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.581862 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.581465    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-credential-socket\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.581862 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.581495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-envoy\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.581862 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.581529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-socket\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.581862 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.581622    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-certs\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.582274 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.582219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-data\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.582422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.582309    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjcns\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-kube-api-access-zjcns\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683135 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-token\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683347 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683142    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-credential-socket\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683347 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-envoy\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683477 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-socket\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683477 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-certs\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683477 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-data\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683480    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjcns\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-kube-api-access-zjcns\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-podinfo\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683575    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-credential-socket\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istiod-ca-cert\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683831 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-certs\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683908 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-socket\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.683908 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.683894    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-data\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.684257 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.684220    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istiod-ca-cert\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.685736 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.685708    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-envoy\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.686275 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.686258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-podinfo\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.691062 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.691043    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-token\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.691323 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.691305    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjcns\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-kube-api-access-zjcns\") pod \"e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") " pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.796711 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.796618    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:25.931921 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.931897    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"]
Jul 23 10:22:25.933587 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:22:25.933545    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9eb6ec8_04b0_45a8_bc43_2af4fd776018.slice/crio-39a3229cad0ce96712ce3e5c2209c5ca604cac99fb6302d68c5ce34b72126fdd WatchSource:0}: Error finding container 39a3229cad0ce96712ce3e5c2209c5ca604cac99fb6302d68c5ce34b72126fdd: Status 404 returned error can't find the container with id 39a3229cad0ce96712ce3e5c2209c5ca604cac99fb6302d68c5ce34b72126fdd
Jul 23 10:22:25.935766 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.935735    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:22:25.935841 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.935795    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:22:25.935841 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:25.935823    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:22:26.232065 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:26.232036    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e154d09-73b2-4919-ac8d-053560c646af" path="/var/lib/kubelet/pods/1e154d09-73b2-4919-ac8d-053560c646af/volumes"
Jul 23 10:22:26.263037 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:26.262999    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" event={"ID":"a9eb6ec8-04b0-45a8-bc43-2af4fd776018","Type":"ContainerStarted","Data":"4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1"}
Jul 23 10:22:26.263193 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:26.263051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" event={"ID":"a9eb6ec8-04b0-45a8-bc43-2af4fd776018","Type":"ContainerStarted","Data":"39a3229cad0ce96712ce3e5c2209c5ca604cac99fb6302d68c5ce34b72126fdd"}
Jul 23 10:22:26.286012 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:26.285964    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" podStartSLOduration=1.285949681 podStartE2EDuration="1.285949681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:22:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:22:26.284267131 +0000 UTC m=+1670.522462384" watchObservedRunningTime="2026-07-23 10:22:26.285949681 +0000 UTC m=+1670.524144929"
Jul 23 10:22:26.797795 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:26.797767    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:26.802196 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:26.802176    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:27.267872 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:27.267844    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:27.268725 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:27.268709    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:29.950566 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:29.950543    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:22:30.025152 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025069    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-socket\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025152 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025109    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-certs\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025152 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025143    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-token\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025165    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-podinfo\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025230    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-credential-socket\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025276    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-data\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025333    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c629f02e-8e12-4fac-a81d-f4694046bde3-istiod-ca-cert\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025363    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmdng\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-kube-api-access-cmdng\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025393    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-envoy\") pod \"c629f02e-8e12-4fac-a81d-f4694046bde3\" (UID: \"c629f02e-8e12-4fac-a81d-f4694046bde3\") "
Jul 23 10:22:30.025468 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025410    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:22:30.025849 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025470    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:22:30.025849 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025730    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c629f02e-8e12-4fac-a81d-f4694046bde3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:22:30.025849 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025839    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.026010 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025859    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.026010 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025873    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c629f02e-8e12-4fac-a81d-f4694046bde3-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.026010 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.025986    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:22:30.026406 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.026381    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:22:30.027649 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.027621    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:22:30.027765 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.027701    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-kube-api-access-cmdng" (OuterVolumeSpecName: "kube-api-access-cmdng") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "kube-api-access-cmdng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:22:30.027923 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.027904    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:22:30.028018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.028000    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c629f02e-8e12-4fac-a81d-f4694046bde3" (UID: "c629f02e-8e12-4fac-a81d-f4694046bde3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:22:30.126640 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.126611    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.126640 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.126635    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.126640 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.126644    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.126845 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.126654    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.126845 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.126666    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmdng\" (UniqueName: \"kubernetes.io/projected/c629f02e-8e12-4fac-a81d-f4694046bde3-kube-api-access-cmdng\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.126845 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.126680    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c629f02e-8e12-4fac-a81d-f4694046bde3-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:30.283497 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.283416    2567 generic.go:356] "Generic (PLEG): container finished" podID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerID="40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86" exitCode=0
Jul 23 10:22:30.283497 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.283465    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"
Jul 23 10:22:30.283662 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.283504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" event={"ID":"c629f02e-8e12-4fac-a81d-f4694046bde3","Type":"ContainerDied","Data":"40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86"}
Jul 23 10:22:30.283662 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.283560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks" event={"ID":"c629f02e-8e12-4fac-a81d-f4694046bde3","Type":"ContainerDied","Data":"199f4d9a924a1df444773d6ad38fed2fd2689ae46af08d81461b817752b8ff00"}
Jul 23 10:22:30.283662 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.283590    2567 scope.go:117] "RemoveContainer" containerID="40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86"
Jul 23 10:22:30.292523 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.292507    2567 scope.go:117] "RemoveContainer" containerID="0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4"
Jul 23 10:22:30.300452 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.300435    2567 scope.go:117] "RemoveContainer" containerID="40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86"
Jul 23 10:22:30.300716 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:22:30.300697    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86\": container with ID starting with 40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86 not found: ID does not exist" containerID="40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86"
Jul 23 10:22:30.300785 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.300728    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86"} err="failed to get container status \"40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86\": rpc error: code = NotFound desc = could not find container \"40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86\": container with ID starting with 40c2992c635fdeb3d04f21b5961f446fd1d27c5fdba1ae4f74fa570ac6465d86 not found: ID does not exist"
Jul 23 10:22:30.300785 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.300749    2567 scope.go:117] "RemoveContainer" containerID="0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4"
Jul 23 10:22:30.300957 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:22:30.300937    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4\": container with ID starting with 0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4 not found: ID does not exist" containerID="0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4"
Jul 23 10:22:30.301001 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.300963    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4"} err="failed to get container status \"0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4\": rpc error: code = NotFound desc = could not find container \"0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4\": container with ID starting with 0dc9fac4dcc2ea9c57d930f7f376c62329f038a048d5a0384aa8a56937a22bd4 not found: ID does not exist"
Jul 23 10:22:30.305284 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.305259    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"]
Jul 23 10:22:30.312558 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:30.312534    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c3044c8a-gw-openshift-default-646987687-t5tks"]
Jul 23 10:22:32.231257 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:32.231207    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" path="/var/lib/kubelet/pods/c629f02e-8e12-4fac-a81d-f4694046bde3/volumes"
Jul 23 10:22:41.348063 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:41.348031    2567 generic.go:356] "Generic (PLEG): container finished" podID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerID="4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1" exitCode=0
Jul 23 10:22:41.348559 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:41.348081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" event={"ID":"a9eb6ec8-04b0-45a8-bc43-2af4fd776018","Type":"ContainerDied","Data":"4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1"}
Jul 23 10:22:41.348559 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:41.348469    2567 scope.go:117] "RemoveContainer" containerID="4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1"
Jul 23 10:22:41.349426 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:41.349397    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:22:41.349536 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:41.349461    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:22:41.349536 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:41.349492    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:22:42.268184 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:42.268151    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:42.354407 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:42.354370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" event={"ID":"a9eb6ec8-04b0-45a8-bc43-2af4fd776018","Type":"ContainerStarted","Data":"cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5"}
Jul 23 10:22:42.797689 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:42.797655    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:42.798860 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:42.798828    2567 patch_prober.go:28] interesting pod/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 23 10:22:42.799008 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:42.798875    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 23 10:22:43.797331 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:43.797293    2567 patch_prober.go:28] interesting pod/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 23 10:22:43.797819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:43.797354    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 23 10:22:44.797777 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:44.797740    2567 patch_prober.go:28] interesting pod/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 23 10:22:44.798153 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:44.797796    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 23 10:22:45.797897 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:45.797860    2567 patch_prober.go:28] interesting pod/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 23 10:22:45.798352 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:45.797918    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 23 10:22:46.800834 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:46.800802    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:46.801282 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:46.801267    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:46.801934 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:46.801911    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:22:53.494695 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.494654    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"]
Jul 23 10:22:53.495279 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.495259    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy"
Jul 23 10:22:53.495367 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.495281    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy"
Jul 23 10:22:53.495367 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.495292    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy"
Jul 23 10:22:53.495367 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.495299    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy"
Jul 23 10:22:53.495525 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.495386    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy"
Jul 23 10:22:53.498711 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.498689    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"
Jul 23 10:22:53.501463 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.501439    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 10:22:53.501559 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.501441    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2vbpd\""
Jul 23 10:22:53.505623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.505592    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"]
Jul 23 10:22:53.557365 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.557330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaba097-4fb7-4b83-8058-ad84dba75629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f\" (UID: \"cfaba097-4fb7-4b83-8058-ad84dba75629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"
Jul 23 10:22:53.657925 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.657890    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaba097-4fb7-4b83-8058-ad84dba75629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f\" (UID: \"cfaba097-4fb7-4b83-8058-ad84dba75629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"
Jul 23 10:22:53.658532 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.658513    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaba097-4fb7-4b83-8058-ad84dba75629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f\" (UID: \"cfaba097-4fb7-4b83-8058-ad84dba75629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"
Jul 23 10:22:53.810553 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:53.810472    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"
Jul 23 10:22:54.148631 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:54.148609    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"]
Jul 23 10:22:54.150641 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:22:54.150601    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfaba097_4fb7_4b83_8058_ad84dba75629.slice/crio-7a9ceb873c662519ff433dff7d2a2eb4f4ba2c2450fc0c164652b79ff9e58e96 WatchSource:0}: Error finding container 7a9ceb873c662519ff433dff7d2a2eb4f4ba2c2450fc0c164652b79ff9e58e96: Status 404 returned error can't find the container with id 7a9ceb873c662519ff433dff7d2a2eb4f4ba2c2450fc0c164652b79ff9e58e96
Jul 23 10:22:54.418036 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:54.417953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f" event={"ID":"cfaba097-4fb7-4b83-8058-ad84dba75629","Type":"ContainerStarted","Data":"610f2ec113010878001995f163ff16350736d8eea650c9aa86f9e1ce656c7400"}
Jul 23 10:22:54.418036 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:54.418020    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f" event={"ID":"cfaba097-4fb7-4b83-8058-ad84dba75629","Type":"ContainerStarted","Data":"7a9ceb873c662519ff433dff7d2a2eb4f4ba2c2450fc0c164652b79ff9e58e96"}
Jul 23 10:22:54.433923 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:54.433876    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f" podStartSLOduration=1.433858353 podStartE2EDuration="1.433858353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:22:54.432217025 +0000 UTC m=+1698.670412276" watchObservedRunningTime="2026-07-23 10:22:54.433858353 +0000 UTC m=+1698.672053642"
Jul 23 10:22:55.424379 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:55.424348    2567 generic.go:356] "Generic (PLEG): container finished" podID="cfaba097-4fb7-4b83-8058-ad84dba75629" containerID="610f2ec113010878001995f163ff16350736d8eea650c9aa86f9e1ce656c7400" exitCode=0
Jul 23 10:22:55.424727 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:55.424437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f" event={"ID":"cfaba097-4fb7-4b83-8058-ad84dba75629","Type":"ContainerDied","Data":"610f2ec113010878001995f163ff16350736d8eea650c9aa86f9e1ce656c7400"}
Jul 23 10:22:56.563603 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:56.563581    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"
Jul 23 10:22:56.585694 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:56.585668    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaba097-4fb7-4b83-8058-ad84dba75629-maas-api-service-ca\") pod \"cfaba097-4fb7-4b83-8058-ad84dba75629\" (UID: \"cfaba097-4fb7-4b83-8058-ad84dba75629\") "
Jul 23 10:22:56.586032 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:56.586009    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfaba097-4fb7-4b83-8058-ad84dba75629-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cfaba097-4fb7-4b83-8058-ad84dba75629" (UID: "cfaba097-4fb7-4b83-8058-ad84dba75629"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:22:56.686620 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:56.686549    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaba097-4fb7-4b83-8058-ad84dba75629-maas-api-service-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:22:57.436563 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:57.436479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f" event={"ID":"cfaba097-4fb7-4b83-8058-ad84dba75629","Type":"ContainerDied","Data":"7a9ceb873c662519ff433dff7d2a2eb4f4ba2c2450fc0c164652b79ff9e58e96"}
Jul 23 10:22:57.436563 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:57.436525    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a9ceb873c662519ff433dff7d2a2eb4f4ba2c2450fc0c164652b79ff9e58e96"
Jul 23 10:22:57.436563 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:22:57.436485    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"
Jul 23 10:23:08.552425 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:08.552392    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"]
Jul 23 10:23:08.554766 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:08.554743    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-07b9c24b-wzf2f"]
Jul 23 10:23:09.726215 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:09.726182    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"]
Jul 23 10:23:09.726745 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:09.726411    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy" containerID="cri-o://cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5" gracePeriod=30
Jul 23 10:23:10.231180 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.231150    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfaba097-4fb7-4b83-8058-ad84dba75629" path="/var/lib/kubelet/pods/cfaba097-4fb7-4b83-8058-ad84dba75629/volumes"
Jul 23 10:23:10.532185 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.532112    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"]
Jul 23 10:23:10.532514 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.532502    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfaba097-4fb7-4b83-8058-ad84dba75629" containerName="revoke-keys"
Jul 23 10:23:10.532562 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.532516    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfaba097-4fb7-4b83-8058-ad84dba75629" containerName="revoke-keys"
Jul 23 10:23:10.532598 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.532590    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c629f02e-8e12-4fac-a81d-f4694046bde3" containerName="istio-proxy"
Jul 23 10:23:10.532631 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.532601    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfaba097-4fb7-4b83-8058-ad84dba75629" containerName="revoke-keys"
Jul 23 10:23:10.535633 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.535617    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.538465 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.538447    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2ee93e9e-openshift-default-dockercfg-52n2c\""
Jul 23 10:23:10.550841 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.550815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"]
Jul 23 10:23:10.620741 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.620703    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74591601-8d78-46a6-a7c2-28cebed14d55-istiod-ca-cert\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.620956 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.620750    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl67h\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-kube-api-access-zl67h\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.620956 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.620873    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-socket\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.620956 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.620944    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-envoy\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.621150 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.620982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-credential-socket\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.621150 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.621019    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-istio-token\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.621150 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.621043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74591601-8d78-46a6-a7c2-28cebed14d55-istio-podinfo\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.621336 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.621149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-certs\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.621336 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.621175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-data\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.721900 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.721863    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-socket\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722098 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.721926    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-envoy\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722098 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.721954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-credential-socket\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722098 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.721980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-istio-token\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722098 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74591601-8d78-46a6-a7c2-28cebed14d55-istio-podinfo\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722098 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-certs\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722416 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-data\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722416 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74591601-8d78-46a6-a7c2-28cebed14d55-istiod-ca-cert\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722416 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl67h\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-kube-api-access-zl67h\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722416 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-socket\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722644 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722617    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-certs\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722774 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722751    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-data\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.722896 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.722752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-credential-socket\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.723875 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.723810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74591601-8d78-46a6-a7c2-28cebed14d55-istiod-ca-cert\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.724987 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.724968    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-envoy\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.725710 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.725692    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74591601-8d78-46a6-a7c2-28cebed14d55-istio-podinfo\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.730733 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.730703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-istio-token\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.731115 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.730797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl67h\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-kube-api-access-zl67h\") pod \"e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") " pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:10.846167 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:10.846075    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:11.031138 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:11.031110    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"]
Jul 23 10:23:11.032564 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:23:11.032533    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74591601_8d78_46a6_a7c2_28cebed14d55.slice/crio-e9513fe4d0569e025bc168196e82414c521d283d09ec10f4176580cdd003e999 WatchSource:0}: Error finding container e9513fe4d0569e025bc168196e82414c521d283d09ec10f4176580cdd003e999: Status 404 returned error can't find the container with id e9513fe4d0569e025bc168196e82414c521d283d09ec10f4176580cdd003e999
Jul 23 10:23:11.034814 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:11.034785    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:23:11.034874 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:11.034848    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:23:11.034917 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:11.034874    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:23:11.506522 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:11.506491    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" event={"ID":"74591601-8d78-46a6-a7c2-28cebed14d55","Type":"ContainerStarted","Data":"fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9"}
Jul 23 10:23:11.506694 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:11.506539    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" event={"ID":"74591601-8d78-46a6-a7c2-28cebed14d55","Type":"ContainerStarted","Data":"e9513fe4d0569e025bc168196e82414c521d283d09ec10f4176580cdd003e999"}
Jul 23 10:23:11.527603 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:11.527553    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" podStartSLOduration=1.527536032 podStartE2EDuration="1.527536032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:23:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:23:11.525523931 +0000 UTC m=+1715.763719183" watchObservedRunningTime="2026-07-23 10:23:11.527536032 +0000 UTC m=+1715.765731283"
Jul 23 10:23:11.846789 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:11.846708    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:12.851690 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:12.851657    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:13.517591 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:13.517565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:13.518534 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:13.518517    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:14.971370 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:14.971344    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:23:15.064227 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064150    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjcns\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-kube-api-access-zjcns\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064227 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064181    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-data\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064227 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064210    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-credential-socket\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064306    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-token\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064375    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-podinfo\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064422    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-envoy\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-socket\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064712 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064505    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-certs\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064712 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064534    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istiod-ca-cert\") pod \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\" (UID: \"a9eb6ec8-04b0-45a8-bc43-2af4fd776018\") "
Jul 23 10:23:15.064835 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064495    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:15.064940 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064911    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:15.065005 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.064705    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:15.065061 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.065025    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.065061 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.065043    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.065366 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.065171    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:23:15.065366 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.065226    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:15.066649 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.066615    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-kube-api-access-zjcns" (OuterVolumeSpecName: "kube-api-access-zjcns") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "kube-api-access-zjcns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:23:15.066768 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.066667    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:15.066768 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.066676    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:23:15.066898 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.066882    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9eb6ec8-04b0-45a8-bc43-2af4fd776018" (UID: "a9eb6ec8-04b0-45a8-bc43-2af4fd776018"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:23:15.165886 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.165833    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjcns\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-kube-api-access-zjcns\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.165886 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.165879    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.165886 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.165888    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.165886 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.165896    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.165886 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.165904    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.166225 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.165912    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.166225 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.165920    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9eb6ec8-04b0-45a8-bc43-2af4fd776018-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:15.528988 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.528950    2567 generic.go:356] "Generic (PLEG): container finished" podID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerID="cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5" exitCode=0
Jul 23 10:23:15.529163 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.529000    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"
Jul 23 10:23:15.529163 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.529036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" event={"ID":"a9eb6ec8-04b0-45a8-bc43-2af4fd776018","Type":"ContainerDied","Data":"cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5"}
Jul 23 10:23:15.529163 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.529090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p" event={"ID":"a9eb6ec8-04b0-45a8-bc43-2af4fd776018","Type":"ContainerDied","Data":"39a3229cad0ce96712ce3e5c2209c5ca604cac99fb6302d68c5ce34b72126fdd"}
Jul 23 10:23:15.529163 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.529115    2567 scope.go:117] "RemoveContainer" containerID="cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5"
Jul 23 10:23:15.538802 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.538785    2567 scope.go:117] "RemoveContainer" containerID="4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1"
Jul 23 10:23:15.547042 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.547026    2567 scope.go:117] "RemoveContainer" containerID="cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5"
Jul 23 10:23:15.547295 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:23:15.547276    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5\": container with ID starting with cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5 not found: ID does not exist" containerID="cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5"
Jul 23 10:23:15.547381 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.547307    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5"} err="failed to get container status \"cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5\": rpc error: code = NotFound desc = could not find container \"cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5\": container with ID starting with cd321f60e463ab09e23711790b5c808872148c0f230fb7886a2b7f216d7854d5 not found: ID does not exist"
Jul 23 10:23:15.547381 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.547332    2567 scope.go:117] "RemoveContainer" containerID="4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1"
Jul 23 10:23:15.547610 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:23:15.547593    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1\": container with ID starting with 4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1 not found: ID does not exist" containerID="4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1"
Jul 23 10:23:15.547649 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.547619    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1"} err="failed to get container status \"4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1\": rpc error: code = NotFound desc = could not find container \"4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1\": container with ID starting with 4dc0b26daaf3decd46381cadc65c270ea42fbf18bde27b1567a3a1363044c3e1 not found: ID does not exist"
Jul 23 10:23:15.551331 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.551310    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"]
Jul 23 10:23:15.555043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:15.555024    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-07b9c24b-openshift-default-7d5dcdf55c-p647p"]
Jul 23 10:23:16.237178 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:16.237145    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" path="/var/lib/kubelet/pods/a9eb6ec8-04b0-45a8-bc43-2af4fd776018/volumes"
Jul 23 10:23:26.587027 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:26.586930    2567 generic.go:356] "Generic (PLEG): container finished" podID="74591601-8d78-46a6-a7c2-28cebed14d55" containerID="fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9" exitCode=0
Jul 23 10:23:26.587027 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:26.587003    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" event={"ID":"74591601-8d78-46a6-a7c2-28cebed14d55","Type":"ContainerDied","Data":"fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9"}
Jul 23 10:23:26.587488 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:26.587403    2567 scope.go:117] "RemoveContainer" containerID="fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9"
Jul 23 10:23:26.588386 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:26.588361    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:23:26.588448 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:26.588426    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:23:26.588484 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:26.588459    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:23:27.593556 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:27.593522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" event={"ID":"74591601-8d78-46a6-a7c2-28cebed14d55","Type":"ContainerStarted","Data":"d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be"}
Jul 23 10:23:27.847347 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:27.847254    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:27.848558 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:27.848537    2567 patch_prober.go:28] interesting pod/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 10:23:27.848644 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:27.848584    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 10:23:28.518375 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:28.518333    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:28.847601 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:28.847507    2567 patch_prober.go:28] interesting pod/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 10:23:28.847601 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:28.847563    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 10:23:29.847140 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:29.847103    2567 patch_prober.go:28] interesting pod/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 10:23:29.847356 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:29.847178    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 10:23:30.847104 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:30.847061    2567 patch_prober.go:28] interesting pod/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 10:23:30.847532 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:30.847121    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 10:23:31.850083 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:31.850052    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:31.851062 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:31.851047    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:37.757265 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.757217    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"]
Jul 23 10:23:37.757711 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.757589    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy"
Jul 23 10:23:37.757711 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.757599    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy"
Jul 23 10:23:37.757711 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.757625    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy"
Jul 23 10:23:37.757711 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.757631    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy"
Jul 23 10:23:37.757711 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.757696    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy"
Jul 23 10:23:37.757711 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.757705    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9eb6ec8-04b0-45a8-bc43-2af4fd776018" containerName="istio-proxy"
Jul 23 10:23:37.761841 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.761824    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"
Jul 23 10:23:37.764614 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.764593    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2vbpd\""
Jul 23 10:23:37.764722 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.764596    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 10:23:37.769308 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.768975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"]
Jul 23 10:23:37.780357 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.780330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8044e-161d-4656-bf18-4cdd2cfa117e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp\" (UID: \"9cd8044e-161d-4656-bf18-4cdd2cfa117e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"
Jul 23 10:23:37.881683 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.881648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8044e-161d-4656-bf18-4cdd2cfa117e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp\" (UID: \"9cd8044e-161d-4656-bf18-4cdd2cfa117e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"
Jul 23 10:23:37.882275 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:37.882228    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8044e-161d-4656-bf18-4cdd2cfa117e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp\" (UID: \"9cd8044e-161d-4656-bf18-4cdd2cfa117e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"
Jul 23 10:23:38.073048 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:38.072964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"
Jul 23 10:23:38.216944 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:38.216917    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"]
Jul 23 10:23:38.219147 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:23:38.219111    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd8044e_161d_4656_bf18_4cdd2cfa117e.slice/crio-a2518f592af06368cfaed4a4885a30081a4b26277f63489b0ba1e9c3b09f669b WatchSource:0}: Error finding container a2518f592af06368cfaed4a4885a30081a4b26277f63489b0ba1e9c3b09f669b: Status 404 returned error can't find the container with id a2518f592af06368cfaed4a4885a30081a4b26277f63489b0ba1e9c3b09f669b
Jul 23 10:23:38.655576 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:38.655543    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp" event={"ID":"9cd8044e-161d-4656-bf18-4cdd2cfa117e","Type":"ContainerStarted","Data":"249afe242559b3f62af1fea61eeb954f090286f10d447538414602d17d4193de"}
Jul 23 10:23:38.655759 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:38.655598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp" event={"ID":"9cd8044e-161d-4656-bf18-4cdd2cfa117e","Type":"ContainerStarted","Data":"a2518f592af06368cfaed4a4885a30081a4b26277f63489b0ba1e9c3b09f669b"}
Jul 23 10:23:38.673384 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:38.673282    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp" podStartSLOduration=1.673262275 podStartE2EDuration="1.673262275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:23:38.672525929 +0000 UTC m=+1742.910721181" watchObservedRunningTime="2026-07-23 10:23:38.673262275 +0000 UTC m=+1742.911457527"
Jul 23 10:23:39.662407 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:39.662371    2567 generic.go:356] "Generic (PLEG): container finished" podID="9cd8044e-161d-4656-bf18-4cdd2cfa117e" containerID="249afe242559b3f62af1fea61eeb954f090286f10d447538414602d17d4193de" exitCode=0
Jul 23 10:23:39.662794 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:39.662448    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp" event={"ID":"9cd8044e-161d-4656-bf18-4cdd2cfa117e","Type":"ContainerDied","Data":"249afe242559b3f62af1fea61eeb954f090286f10d447538414602d17d4193de"}
Jul 23 10:23:40.803764 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:40.803737    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"
Jul 23 10:23:40.908550 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:40.908513    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8044e-161d-4656-bf18-4cdd2cfa117e-maas-api-service-ca\") pod \"9cd8044e-161d-4656-bf18-4cdd2cfa117e\" (UID: \"9cd8044e-161d-4656-bf18-4cdd2cfa117e\") "
Jul 23 10:23:40.908894 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:40.908871    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd8044e-161d-4656-bf18-4cdd2cfa117e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cd8044e-161d-4656-bf18-4cdd2cfa117e" (UID: "9cd8044e-161d-4656-bf18-4cdd2cfa117e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:23:41.009215 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:41.009135    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd8044e-161d-4656-bf18-4cdd2cfa117e-maas-api-service-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:41.674362 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:41.674338    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"
Jul 23 10:23:41.674536 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:41.674381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp" event={"ID":"9cd8044e-161d-4656-bf18-4cdd2cfa117e","Type":"ContainerDied","Data":"a2518f592af06368cfaed4a4885a30081a4b26277f63489b0ba1e9c3b09f669b"}
Jul 23 10:23:41.674536 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:41.674427    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2518f592af06368cfaed4a4885a30081a4b26277f63489b0ba1e9c3b09f669b"
Jul 23 10:23:52.853983 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:52.853946    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"]
Jul 23 10:23:52.857323 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:52.857299    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2ee93e9e-ghnjp"]
Jul 23 10:23:53.027377 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:53.027339    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"]
Jul 23 10:23:53.027595 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:53.027551    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy" containerID="cri-o://d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be" gracePeriod=30
Jul 23 10:23:54.231157 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:54.231123    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd8044e-161d-4656-bf18-4cdd2cfa117e" path="/var/lib/kubelet/pods/9cd8044e-161d-4656-bf18-4cdd2cfa117e/volumes"
Jul 23 10:23:58.283819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.283791    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:58.375936 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.375898    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74591601-8d78-46a6-a7c2-28cebed14d55-istio-podinfo\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376104 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.375948    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-certs\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376104 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376014    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-data\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376104 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376041    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-istio-token\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376104 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376060    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74591601-8d78-46a6-a7c2-28cebed14d55-istiod-ca-cert\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376104 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376094    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-envoy\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376408 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376115    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl67h\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-kube-api-access-zl67h\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376408 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376145    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-socket\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376408 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376182    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-credential-socket\") pod \"74591601-8d78-46a6-a7c2-28cebed14d55\" (UID: \"74591601-8d78-46a6-a7c2-28cebed14d55\") "
Jul 23 10:23:58.376408 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376315    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:58.376629 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376494    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.376629 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376490    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:58.376733 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376644    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74591601-8d78-46a6-a7c2-28cebed14d55-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:23:58.376793 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.376726    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:58.377357 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.377330    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-data" (OuterVolumeSpecName: "istio-data") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:58.378383 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.378354    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74591601-8d78-46a6-a7c2-28cebed14d55-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:23:58.378561 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.378542    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:23:58.378621 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.378554    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-kube-api-access-zl67h" (OuterVolumeSpecName: "kube-api-access-zl67h") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "kube-api-access-zl67h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:23:58.378665 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.378628    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-istio-token" (OuterVolumeSpecName: "istio-token") pod "74591601-8d78-46a6-a7c2-28cebed14d55" (UID: "74591601-8d78-46a6-a7c2-28cebed14d55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:23:58.476966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.476928    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.476966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.476959    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.476966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.476967    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74591601-8d78-46a6-a7c2-28cebed14d55-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.476966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.476975    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.477326 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.476983    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl67h\" (UniqueName: \"kubernetes.io/projected/74591601-8d78-46a6-a7c2-28cebed14d55-kube-api-access-zl67h\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.477326 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.476992    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.477326 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.477000    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74591601-8d78-46a6-a7c2-28cebed14d55-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.477326 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.477008    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74591601-8d78-46a6-a7c2-28cebed14d55-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:23:58.759757 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.759666    2567 generic.go:356] "Generic (PLEG): container finished" podID="74591601-8d78-46a6-a7c2-28cebed14d55" containerID="d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be" exitCode=0
Jul 23 10:23:58.759757 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.759721    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"
Jul 23 10:23:58.759757 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.759745    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" event={"ID":"74591601-8d78-46a6-a7c2-28cebed14d55","Type":"ContainerDied","Data":"d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be"}
Jul 23 10:23:58.760004 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.759798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm" event={"ID":"74591601-8d78-46a6-a7c2-28cebed14d55","Type":"ContainerDied","Data":"e9513fe4d0569e025bc168196e82414c521d283d09ec10f4176580cdd003e999"}
Jul 23 10:23:58.760004 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.759825    2567 scope.go:117] "RemoveContainer" containerID="d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be"
Jul 23 10:23:58.769439 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.769418    2567 scope.go:117] "RemoveContainer" containerID="fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9"
Jul 23 10:23:58.778018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.777996    2567 scope.go:117] "RemoveContainer" containerID="d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be"
Jul 23 10:23:58.778442 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:23:58.778421    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be\": container with ID starting with d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be not found: ID does not exist" containerID="d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be"
Jul 23 10:23:58.778493 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.778453    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be"} err="failed to get container status \"d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be\": rpc error: code = NotFound desc = could not find container \"d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be\": container with ID starting with d5da713d451352aebd7b614d16f830a6e81fee54b059fd847ef6a1b9ad7cf3be not found: ID does not exist"
Jul 23 10:23:58.778493 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.778472    2567 scope.go:117] "RemoveContainer" containerID="fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9"
Jul 23 10:23:58.778746 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:23:58.778727    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9\": container with ID starting with fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9 not found: ID does not exist" containerID="fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9"
Jul 23 10:23:58.778809 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.778751    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9"} err="failed to get container status \"fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9\": rpc error: code = NotFound desc = could not find container \"fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9\": container with ID starting with fd2c49c5ce1313674f7573c63eef5a651466a9054149f5a313e9ea04d4d035a9 not found: ID does not exist"
Jul 23 10:23:58.782674 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.782651    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"]
Jul 23 10:23:58.787177 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:23:58.787143    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2ee93e9e-openshift-default-7cbc8477b7-p78cm"]
Jul 23 10:24:00.231676 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:24:00.231643    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" path="/var/lib/kubelet/pods/74591601-8d78-46a6-a7c2-28cebed14d55/volumes"
Jul 23 10:24:36.302078 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:24:36.302048    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:24:36.305305 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:24:36.305282    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:25:36.387066 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387035    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"]
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387415    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd8044e-161d-4656-bf18-4cdd2cfa117e" containerName="revoke-keys"
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387427    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd8044e-161d-4656-bf18-4cdd2cfa117e" containerName="revoke-keys"
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387441    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy"
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387446    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy"
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387458    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy"
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387462    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy"
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387533    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy"
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387540    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd8044e-161d-4656-bf18-4cdd2cfa117e" containerName="revoke-keys"
Jul 23 10:25:36.387572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.387548    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="74591601-8d78-46a6-a7c2-28cebed14d55" containerName="istio-proxy"
Jul 23 10:25:36.390597 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.390582    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.396537 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.396515    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b328edc3-openshift-default-dockercfg-qzrmr\""
Jul 23 10:25:36.431877 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.431849    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"]
Jul 23 10:25:36.497597 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b206693-2a81-43d5-984d-ec531ba799e6-istiod-ca-cert\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.497761 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-socket\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.497761 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-envoy\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.497761 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497715    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-certs\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.497897 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497764    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-data\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.497897 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497794    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-istio-token\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.497897 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqc5\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-kube-api-access-nqqc5\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.497897 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497861    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b206693-2a81-43d5-984d-ec531ba799e6-istio-podinfo\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.498022 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.497905    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-credential-socket\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.598913 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.598875    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b206693-2a81-43d5-984d-ec531ba799e6-istiod-ca-cert\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599081 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.598944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-socket\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599081 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.598981    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-envoy\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599081 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-certs\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599081 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-data\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599339 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599105    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-istio-token\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599339 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqc5\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-kube-api-access-nqqc5\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599339 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b206693-2a81-43d5-984d-ec531ba799e6-istio-podinfo\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599339 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-credential-socket\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599535 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599449    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-certs\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599535 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-socket\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599827 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599806    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-data\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.599977 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.599898    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-credential-socket\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.600203 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.600180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b206693-2a81-43d5-984d-ec531ba799e6-istiod-ca-cert\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.602402 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.602378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-envoy\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.602537 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.602447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b206693-2a81-43d5-984d-ec531ba799e6-istio-podinfo\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.608260 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.608211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-istio-token\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.608721 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.608704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqc5\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-kube-api-access-nqqc5\") pod \"e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") " pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.701457 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.701372    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:36.844377 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.844355    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"]
Jul 23 10:25:36.846629 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:25:36.846606    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b206693_2a81_43d5_984d_ec531ba799e6.slice/crio-8a34a2b188c16723d07645b54c8363a3a47874cbcc19b38accbd349cc8a162be WatchSource:0}: Error finding container 8a34a2b188c16723d07645b54c8363a3a47874cbcc19b38accbd349cc8a162be: Status 404 returned error can't find the container with id 8a34a2b188c16723d07645b54c8363a3a47874cbcc19b38accbd349cc8a162be
Jul 23 10:25:36.848727 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.848693    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:25:36.848803 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.848759    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:25:36.848803 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:36.848785    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:25:37.245062 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:37.245031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" event={"ID":"1b206693-2a81-43d5-984d-ec531ba799e6","Type":"ContainerStarted","Data":"d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2"}
Jul 23 10:25:37.245263 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:37.245081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" event={"ID":"1b206693-2a81-43d5-984d-ec531ba799e6","Type":"ContainerStarted","Data":"8a34a2b188c16723d07645b54c8363a3a47874cbcc19b38accbd349cc8a162be"}
Jul 23 10:25:37.270306 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:37.270257    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" podStartSLOduration=1.270226027 podStartE2EDuration="1.270226027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:25:37.267889202 +0000 UTC m=+1861.506084455" watchObservedRunningTime="2026-07-23 10:25:37.270226027 +0000 UTC m=+1861.508421278"
Jul 23 10:25:37.701971 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:37.701934    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:37.707089 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:37.707065    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:38.250151 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:38.250122    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:38.251148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:38.251130    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:51.019096 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.019057    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"]
Jul 23 10:25:51.022883 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.022859    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"
Jul 23 10:25:51.025638 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.025613    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 10:25:51.025752 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.025613    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2vbpd\""
Jul 23 10:25:51.030207 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.030183    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"]
Jul 23 10:25:51.138742 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.138697    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3692af0f-3782-4de6-b075-3b47b9b07428-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9\" (UID: \"3692af0f-3782-4de6-b075-3b47b9b07428\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"
Jul 23 10:25:51.239665 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.239615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3692af0f-3782-4de6-b075-3b47b9b07428-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9\" (UID: \"3692af0f-3782-4de6-b075-3b47b9b07428\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"
Jul 23 10:25:51.240314 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.240281    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3692af0f-3782-4de6-b075-3b47b9b07428-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9\" (UID: \"3692af0f-3782-4de6-b075-3b47b9b07428\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"
Jul 23 10:25:51.336258 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.336141    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"
Jul 23 10:25:51.483121 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:51.482987    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"]
Jul 23 10:25:51.486153 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:25:51.486121    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3692af0f_3782_4de6_b075_3b47b9b07428.slice/crio-46398fe6f8c05caa40e2dd5a14e2706b8eab5aef044dfa611ed48be1e33b0546 WatchSource:0}: Error finding container 46398fe6f8c05caa40e2dd5a14e2706b8eab5aef044dfa611ed48be1e33b0546: Status 404 returned error can't find the container with id 46398fe6f8c05caa40e2dd5a14e2706b8eab5aef044dfa611ed48be1e33b0546
Jul 23 10:25:52.325408 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:52.325372    2567 generic.go:356] "Generic (PLEG): container finished" podID="3692af0f-3782-4de6-b075-3b47b9b07428" containerID="45deaab000515bd6d8ae02a5ca642a6d1b3539b8e284a897fc9ec4b8fdb5a405" exitCode=0
Jul 23 10:25:52.325925 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:52.325420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9" event={"ID":"3692af0f-3782-4de6-b075-3b47b9b07428","Type":"ContainerDied","Data":"45deaab000515bd6d8ae02a5ca642a6d1b3539b8e284a897fc9ec4b8fdb5a405"}
Jul 23 10:25:52.325925 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:52.325470    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9" event={"ID":"3692af0f-3782-4de6-b075-3b47b9b07428","Type":"ContainerStarted","Data":"46398fe6f8c05caa40e2dd5a14e2706b8eab5aef044dfa611ed48be1e33b0546"}
Jul 23 10:25:53.251940 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.251863    2567 patch_prober.go:28] interesting pod/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 10:25:53.251940 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.251915    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 10:25:53.331846 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.331817    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b206693-2a81-43d5-984d-ec531ba799e6" containerID="d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2" exitCode=0
Jul 23 10:25:53.332292 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.331895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" event={"ID":"1b206693-2a81-43d5-984d-ec531ba799e6","Type":"ContainerDied","Data":"d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2"}
Jul 23 10:25:53.332731 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.332432    2567 scope.go:117] "RemoveContainer" containerID="d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2"
Jul 23 10:25:53.333443 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.333417    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:25:53.333517 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.333484    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:25:53.333556 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.333523    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:25:53.476454 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.476429    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"
Jul 23 10:25:53.562563 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.562476    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3692af0f-3782-4de6-b075-3b47b9b07428-maas-api-service-ca\") pod \"3692af0f-3782-4de6-b075-3b47b9b07428\" (UID: \"3692af0f-3782-4de6-b075-3b47b9b07428\") "
Jul 23 10:25:53.562857 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.562835    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3692af0f-3782-4de6-b075-3b47b9b07428-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3692af0f-3782-4de6-b075-3b47b9b07428" (UID: "3692af0f-3782-4de6-b075-3b47b9b07428"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:25:53.663674 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:53.663645    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3692af0f-3782-4de6-b075-3b47b9b07428-maas-api-service-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:25:54.338516 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:54.338486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" event={"ID":"1b206693-2a81-43d5-984d-ec531ba799e6","Type":"ContainerStarted","Data":"afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107"}
Jul 23 10:25:54.339881 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:54.339859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9" event={"ID":"3692af0f-3782-4de6-b075-3b47b9b07428","Type":"ContainerDied","Data":"46398fe6f8c05caa40e2dd5a14e2706b8eab5aef044dfa611ed48be1e33b0546"}
Jul 23 10:25:54.339995 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:54.339897    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46398fe6f8c05caa40e2dd5a14e2706b8eab5aef044dfa611ed48be1e33b0546"
Jul 23 10:25:54.339995 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:54.339871    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"
Jul 23 10:25:54.702332 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:54.702295    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:54.702841 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:54.702542    2567 patch_prober.go:28] interesting pod/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 10:25:54.702841 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:54.702595    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 10:25:55.702547 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:55.702507    2567 patch_prober.go:28] interesting pod/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 10:25:55.703086 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:55.702592    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 10:25:56.702165 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:56.702121    2567 patch_prober.go:28] interesting pod/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 10:25:56.702412 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:56.702184    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 10:25:57.702887 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:57.702793    2567 patch_prober.go:28] interesting pod/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 10:25:57.703491 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:57.703455    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 10:25:58.705944 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:58.705912    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:58.706400 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:58.706334    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:25:58.706940 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:25:58.706923    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:26:06.093444 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:06.093408    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"]
Jul 23 10:26:06.095829 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:06.095806    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b328edc3-hqgr9"]
Jul 23 10:26:06.231557 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:06.231523    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3692af0f-3782-4de6-b075-3b47b9b07428" path="/var/lib/kubelet/pods/3692af0f-3782-4de6-b075-3b47b9b07428/volumes"
Jul 23 10:26:12.566707 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:12.566672    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"]
Jul 23 10:26:12.567137 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:12.566911    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy" containerID="cri-o://afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107" gracePeriod=30
Jul 23 10:26:13.708894 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:13.708859    2567 patch_prober.go:28] interesting pod/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 23 10:26:13.709286 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:13.708920    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 10:26:17.821682 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.821660    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:26:17.890683 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890658    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-envoy\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.890863 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890699    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-socket\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.890863 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890716    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b206693-2a81-43d5-984d-ec531ba799e6-istio-podinfo\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.890863 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890747    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqqc5\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-kube-api-access-nqqc5\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.890863 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890809    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b206693-2a81-43d5-984d-ec531ba799e6-istiod-ca-cert\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.890863 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890857    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-data\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.891129 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890896    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-credential-socket\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.891129 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890919    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-istio-token\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.891129 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890961    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:26:17.891129 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.890975    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-certs\") pod \"1b206693-2a81-43d5-984d-ec531ba799e6\" (UID: \"1b206693-2a81-43d5-984d-ec531ba799e6\") "
Jul 23 10:26:17.891481 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.891263    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b206693-2a81-43d5-984d-ec531ba799e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:26:17.891481 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.891360    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:17.891481 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.891355    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:26:17.891823 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.891485    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:26:17.891823 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.891390    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b206693-2a81-43d5-984d-ec531ba799e6-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:17.891932 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.891906    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:26:17.893077 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.893051    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:26:17.893196 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.893131    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:26:17.893196 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.893137    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b206693-2a81-43d5-984d-ec531ba799e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:26:17.893196 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.893155    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-kube-api-access-nqqc5" (OuterVolumeSpecName: "kube-api-access-nqqc5") pod "1b206693-2a81-43d5-984d-ec531ba799e6" (UID: "1b206693-2a81-43d5-984d-ec531ba799e6"). InnerVolumeSpecName "kube-api-access-nqqc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:26:17.992207 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.992178    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b206693-2a81-43d5-984d-ec531ba799e6-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:17.992207 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.992204    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqqc5\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-kube-api-access-nqqc5\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:17.992207 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.992215    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:17.992448 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.992223    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:17.992448 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.992231    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b206693-2a81-43d5-984d-ec531ba799e6-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:17.992448 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.992262    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:17.992448 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:17.992270    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b206693-2a81-43d5-984d-ec531ba799e6-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:26:18.464782 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.464748    2567 generic.go:356] "Generic (PLEG): container finished" podID="1b206693-2a81-43d5-984d-ec531ba799e6" containerID="afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107" exitCode=0
Jul 23 10:26:18.464941 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.464798    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"
Jul 23 10:26:18.464941 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.464828    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" event={"ID":"1b206693-2a81-43d5-984d-ec531ba799e6","Type":"ContainerDied","Data":"afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107"}
Jul 23 10:26:18.464941 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.464886    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7" event={"ID":"1b206693-2a81-43d5-984d-ec531ba799e6","Type":"ContainerDied","Data":"8a34a2b188c16723d07645b54c8363a3a47874cbcc19b38accbd349cc8a162be"}
Jul 23 10:26:18.464941 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.464909    2567 scope.go:117] "RemoveContainer" containerID="afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107"
Jul 23 10:26:18.474129 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.474100    2567 scope.go:117] "RemoveContainer" containerID="d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2"
Jul 23 10:26:18.481958 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.481940    2567 scope.go:117] "RemoveContainer" containerID="afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107"
Jul 23 10:26:18.482303 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:26:18.482272    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107\": container with ID starting with afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107 not found: ID does not exist" containerID="afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107"
Jul 23 10:26:18.482392 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.482311    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107"} err="failed to get container status \"afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107\": rpc error: code = NotFound desc = could not find container \"afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107\": container with ID starting with afbc13c245dd33fa40de70d1ba859f74dafd215240da189821714893066cf107 not found: ID does not exist"
Jul 23 10:26:18.482392 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.482337    2567 scope.go:117] "RemoveContainer" containerID="d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2"
Jul 23 10:26:18.482784 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:26:18.482763    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2\": container with ID starting with d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2 not found: ID does not exist" containerID="d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2"
Jul 23 10:26:18.482850 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.482789    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2"} err="failed to get container status \"d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2\": rpc error: code = NotFound desc = could not find container \"d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2\": container with ID starting with d4563539d5ca3b2bc3f3e511163fec80455359ff246790872d135b846ce6ada2 not found: ID does not exist"
Jul 23 10:26:18.483924 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.483907    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"]
Jul 23 10:26:18.488023 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:18.488003    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b328edc3-openshift-default-76fb78b8d7-4j4v7"]
Jul 23 10:26:20.231994 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:20.231963    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" path="/var/lib/kubelet/pods/1b206693-2a81-43d5-984d-ec531ba799e6/volumes"
Jul 23 10:26:32.200778 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.200748    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"]
Jul 23 10:26:32.201139 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.201102    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3692af0f-3782-4de6-b075-3b47b9b07428" containerName="revoke-keys"
Jul 23 10:26:32.201139 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.201113    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3692af0f-3782-4de6-b075-3b47b9b07428" containerName="revoke-keys"
Jul 23 10:26:32.201139 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.201125    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy"
Jul 23 10:26:32.201139 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.201131    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy"
Jul 23 10:26:32.201139 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.201140    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy"
Jul 23 10:26:32.201328 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.201146    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy"
Jul 23 10:26:32.201328 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.201213    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy"
Jul 23 10:26:32.201328 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.201219    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3692af0f-3782-4de6-b075-3b47b9b07428" containerName="revoke-keys"
Jul 23 10:26:32.205656 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.205618    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.208329 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.208313    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8941949f-openshift-default-dockercfg-jlssd\""
Jul 23 10:26:32.218046 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.218024    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"]
Jul 23 10:26:32.325187 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-envoy\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.325187 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-socket\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.325421 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325212    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c0b99fa-2a79-449f-b714-7e347503745e-istiod-ca-cert\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.325421 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8fkq\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-kube-api-access-q8fkq\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.325421 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325396    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c0b99fa-2a79-449f-b714-7e347503745e-istio-podinfo\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.325533 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-data\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.325533 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325475    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-istio-token\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.325533 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-credential-socket\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.325709 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.325609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-certs\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427105 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427071    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-credential-socket\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-certs\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-envoy\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427186    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-socket\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427211    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c0b99fa-2a79-449f-b714-7e347503745e-istiod-ca-cert\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427253    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8fkq\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-kube-api-access-q8fkq\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427533 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c0b99fa-2a79-449f-b714-7e347503745e-istio-podinfo\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427533 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-data\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427533 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-istio-token\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427533 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-credential-socket\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427716 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427597    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-certs\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427752 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427729    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-socket\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427887 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427867    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-data\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.427972 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.427950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c0b99fa-2a79-449f-b714-7e347503745e-istiod-ca-cert\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.429708 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.429676    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-envoy\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.430102 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.430087    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c0b99fa-2a79-449f-b714-7e347503745e-istio-podinfo\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.448992 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.448973    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-istio-token\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.449982 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.449959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8fkq\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-kube-api-access-q8fkq\") pod \"e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") " pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.516534 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.516466    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:32.657275 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.657231    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"]
Jul 23 10:26:32.658466 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:26:32.658445    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0b99fa_2a79_449f_b714_7e347503745e.slice/crio-7d5c250ba66ce4c3a25431835c08cddf797ebaacb5dc99d11d8c4aed5fa26431 WatchSource:0}: Error finding container 7d5c250ba66ce4c3a25431835c08cddf797ebaacb5dc99d11d8c4aed5fa26431: Status 404 returned error can't find the container with id 7d5c250ba66ce4c3a25431835c08cddf797ebaacb5dc99d11d8c4aed5fa26431
Jul 23 10:26:32.660712 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.660680    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:26:32.660810 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.660748    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:26:32.660810 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:32.660796    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:26:33.538841 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:33.538808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" event={"ID":"6c0b99fa-2a79-449f-b714-7e347503745e","Type":"ContainerStarted","Data":"52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104"}
Jul 23 10:26:33.539226 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:33.538860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" event={"ID":"6c0b99fa-2a79-449f-b714-7e347503745e","Type":"ContainerStarted","Data":"7d5c250ba66ce4c3a25431835c08cddf797ebaacb5dc99d11d8c4aed5fa26431"}
Jul 23 10:26:33.562734 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:33.562666    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" podStartSLOduration=1.5626505590000002 podStartE2EDuration="1.562650559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:26:33.561705362 +0000 UTC m=+1917.799900614" watchObservedRunningTime="2026-07-23 10:26:33.562650559 +0000 UTC m=+1917.800845811"
Jul 23 10:26:34.517338 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:34.517304    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:34.521890 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:34.521866    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:34.543940 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:34.543915    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:34.544698 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:34.544678    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:49.784296 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.784264    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"]
Jul 23 10:26:49.784889 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.784672    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b206693-2a81-43d5-984d-ec531ba799e6" containerName="istio-proxy"
Jul 23 10:26:49.787808 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.787788    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.790357 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.790333    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8941949f\"/\"openshift-service-ca.crt\""
Jul 23 10:26:49.791410 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.791385    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8941949f\"/\"kube-root-ca.crt\""
Jul 23 10:26:49.791517 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.791434    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8941949f\"/\"e2e-lifecycle-model-8941949f-kserve-self-signed-certs\""
Jul 23 10:26:49.791517 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.791468    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8941949f\"/\"default-dockercfg-xp2cl\""
Jul 23 10:26:49.796186 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.796164    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"]
Jul 23 10:26:49.895414 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.895384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-tmp-dir\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.895568 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.895423    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7sxn\" (UniqueName: \"kubernetes.io/projected/cc41b208-e1fc-4e42-9106-c8a446473943-kube-api-access-p7sxn\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.895568 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.895456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-dshm\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.895568 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.895480    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-model-cache\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.895676 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.895555    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc41b208-e1fc-4e42-9106-c8a446473943-tls-certs\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.895676 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.895595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-home\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996249 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996199    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-tmp-dir\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996264    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7sxn\" (UniqueName: \"kubernetes.io/projected/cc41b208-e1fc-4e42-9106-c8a446473943-kube-api-access-p7sxn\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-dshm\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-model-cache\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc41b208-e1fc-4e42-9106-c8a446473943-tls-certs\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-home\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996695 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996606    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-tmp-dir\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996695 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996667    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-model-cache\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.996789 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.996730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-home\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.998653 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.998628    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-dshm\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:49.999051 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:49.999030    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc41b208-e1fc-4e42-9106-c8a446473943-tls-certs\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:50.005515 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.005500    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7sxn\" (UniqueName: \"kubernetes.io/projected/cc41b208-e1fc-4e42-9106-c8a446473943-kube-api-access-p7sxn\") pod \"e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") " pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:50.098489 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.098419    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:26:50.116512 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.116093    2567 patch_prober.go:28] interesting pod/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": read tcp 10.132.0.2:42466->10.132.0.49:15021: read: connection reset by peer" start-of-body=
Jul 23 10:26:50.116512 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.116187    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": read tcp 10.132.0.2:42466->10.132.0.49:15021: read: connection reset by peer"
Jul 23 10:26:50.236195 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.236176    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"]
Jul 23 10:26:50.237475 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:26:50.237446    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc41b208_e1fc_4e42_9106_c8a446473943.slice/crio-9b37ae2518a097e64a32d2efdc3a43809bcf1d802ec8e1f9fc819cd0ec456d0e WatchSource:0}: Error finding container 9b37ae2518a097e64a32d2efdc3a43809bcf1d802ec8e1f9fc819cd0ec456d0e: Status 404 returned error can't find the container with id 9b37ae2518a097e64a32d2efdc3a43809bcf1d802ec8e1f9fc819cd0ec456d0e
Jul 23 10:26:50.643706 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.643672    2567 generic.go:356] "Generic (PLEG): container finished" podID="6c0b99fa-2a79-449f-b714-7e347503745e" containerID="52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104" exitCode=0
Jul 23 10:26:50.643932 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.643744    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" event={"ID":"6c0b99fa-2a79-449f-b714-7e347503745e","Type":"ContainerDied","Data":"52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104"}
Jul 23 10:26:50.644208 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.644185    2567 scope.go:117] "RemoveContainer" containerID="52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104"
Jul 23 10:26:50.645284 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.645252    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:26:50.645384 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.645334    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:26:50.645434 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.645404    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:26:50.645474 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.645445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4" event={"ID":"cc41b208-e1fc-4e42-9106-c8a446473943","Type":"ContainerStarted","Data":"fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7"}
Jul 23 10:26:50.645510 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.645475    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4" event={"ID":"cc41b208-e1fc-4e42-9106-c8a446473943","Type":"ContainerStarted","Data":"9b37ae2518a097e64a32d2efdc3a43809bcf1d802ec8e1f9fc819cd0ec456d0e"}
Jul 23 10:26:50.679461 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:50.679396    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4" podStartSLOduration=1.679374986 podStartE2EDuration="1.679374986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:26:50.678549745 +0000 UTC m=+1934.916745009" watchObservedRunningTime="2026-07-23 10:26:50.679374986 +0000 UTC m=+1934.917570240"
Jul 23 10:26:51.651996 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:51.651962    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" event={"ID":"6c0b99fa-2a79-449f-b714-7e347503745e","Type":"ContainerStarted","Data":"f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c"}
Jul 23 10:26:52.517512 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:52.517473    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:52.518066 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:52.518041    2567 patch_prober.go:28] interesting pod/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 10:26:52.518303 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:52.518275    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 10:26:53.517202 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:53.517159    2567 patch_prober.go:28] interesting pod/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 10:26:53.517733 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:53.517255    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 10:26:54.517663 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:54.517625    2567 patch_prober.go:28] interesting pod/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 10:26:54.518660 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:54.518624    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 10:26:55.520519 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:55.520490    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:55.520894 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:55.520757    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:26:55.521339 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:26:55.521320    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:27:00.098664 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:00.098631    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:27:00.099075 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:00.098676    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:27:00.110966 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:00.110944    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:27:00.707449 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:00.707415    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:27:13.466755 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.466722    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"]
Jul 23 10:27:13.469274 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.469257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"
Jul 23 10:27:13.472320 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.472291    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 10:27:13.472457 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.472411    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2vbpd\""
Jul 23 10:27:13.481445 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.481417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"]
Jul 23 10:27:13.507173 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.507140    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69df17d0-6e08-49b8-bcee-e48465b81f32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8941949f-n4h2r\" (UID: \"69df17d0-6e08-49b8-bcee-e48465b81f32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"
Jul 23 10:27:13.607737 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.607702    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69df17d0-6e08-49b8-bcee-e48465b81f32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8941949f-n4h2r\" (UID: \"69df17d0-6e08-49b8-bcee-e48465b81f32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"
Jul 23 10:27:13.608338 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.608322    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69df17d0-6e08-49b8-bcee-e48465b81f32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8941949f-n4h2r\" (UID: \"69df17d0-6e08-49b8-bcee-e48465b81f32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"
Jul 23 10:27:13.782106 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.782031    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"
Jul 23 10:27:13.932457 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:13.932431    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"]
Jul 23 10:27:13.934585 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:27:13.934553    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69df17d0_6e08_49b8_bcee_e48465b81f32.slice/crio-7705970b11b8e94ee4d39cc03ba77a83b09d4cd3843a5d7b26fc0aa656a45faf WatchSource:0}: Error finding container 7705970b11b8e94ee4d39cc03ba77a83b09d4cd3843a5d7b26fc0aa656a45faf: Status 404 returned error can't find the container with id 7705970b11b8e94ee4d39cc03ba77a83b09d4cd3843a5d7b26fc0aa656a45faf
Jul 23 10:27:14.769004 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:14.768966    2567 generic.go:356] "Generic (PLEG): container finished" podID="69df17d0-6e08-49b8-bcee-e48465b81f32" containerID="232c57c896c9fe11ca5460696813ebde6541c5f85c27ce31a2d02bd46242e479" exitCode=0
Jul 23 10:27:14.769422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:14.769033    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r" event={"ID":"69df17d0-6e08-49b8-bcee-e48465b81f32","Type":"ContainerDied","Data":"232c57c896c9fe11ca5460696813ebde6541c5f85c27ce31a2d02bd46242e479"}
Jul 23 10:27:14.769422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:14.769070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r" event={"ID":"69df17d0-6e08-49b8-bcee-e48465b81f32","Type":"ContainerStarted","Data":"7705970b11b8e94ee4d39cc03ba77a83b09d4cd3843a5d7b26fc0aa656a45faf"}
Jul 23 10:27:15.918465 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:15.918435    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"
Jul 23 10:27:16.028953 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:16.028848    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69df17d0-6e08-49b8-bcee-e48465b81f32-maas-api-service-ca\") pod \"69df17d0-6e08-49b8-bcee-e48465b81f32\" (UID: \"69df17d0-6e08-49b8-bcee-e48465b81f32\") "
Jul 23 10:27:16.029293 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:16.029268    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69df17d0-6e08-49b8-bcee-e48465b81f32-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69df17d0-6e08-49b8-bcee-e48465b81f32" (UID: "69df17d0-6e08-49b8-bcee-e48465b81f32"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:27:16.130626 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:16.130596    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69df17d0-6e08-49b8-bcee-e48465b81f32-maas-api-service-ca\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:27:16.780206 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:16.780173    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"
Jul 23 10:27:16.780206 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:16.780183    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r" event={"ID":"69df17d0-6e08-49b8-bcee-e48465b81f32","Type":"ContainerDied","Data":"7705970b11b8e94ee4d39cc03ba77a83b09d4cd3843a5d7b26fc0aa656a45faf"}
Jul 23 10:27:16.780457 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:16.780249    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7705970b11b8e94ee4d39cc03ba77a83b09d4cd3843a5d7b26fc0aa656a45faf"
Jul 23 10:27:33.618104 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:33.618031    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"]
Jul 23 10:27:33.637870 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:33.637841    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8941949f-n4h2r"]
Jul 23 10:27:34.231547 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:34.231513    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69df17d0-6e08-49b8-bcee-e48465b81f32" path="/var/lib/kubelet/pods/69df17d0-6e08-49b8-bcee-e48465b81f32/volumes"
Jul 23 10:27:36.391377 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:36.391348    2567 scope.go:117] "RemoveContainer" containerID="726e245bafc652ff4b9116b1ffa67756e65a06664243640b576fff3b466baa76"
Jul 23 10:27:40.959723 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:40.959694    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"]
Jul 23 10:27:55.980211 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:55.980150    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4" podUID="cc41b208-e1fc-4e42-9106-c8a446473943" containerName="main" containerID="cri-o://fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7" gracePeriod=45
Jul 23 10:27:56.243379 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.243320    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:27:56.301387 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301338    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-home\") pod \"cc41b208-e1fc-4e42-9106-c8a446473943\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") "
Jul 23 10:27:56.301567 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301439    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc41b208-e1fc-4e42-9106-c8a446473943-tls-certs\") pod \"cc41b208-e1fc-4e42-9106-c8a446473943\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") "
Jul 23 10:27:56.301567 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301486    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-tmp-dir\") pod \"cc41b208-e1fc-4e42-9106-c8a446473943\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") "
Jul 23 10:27:56.301567 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301502    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-dshm\") pod \"cc41b208-e1fc-4e42-9106-c8a446473943\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") "
Jul 23 10:27:56.301567 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301554    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7sxn\" (UniqueName: \"kubernetes.io/projected/cc41b208-e1fc-4e42-9106-c8a446473943-kube-api-access-p7sxn\") pod \"cc41b208-e1fc-4e42-9106-c8a446473943\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") "
Jul 23 10:27:56.301812 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301577    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-model-cache\") pod \"cc41b208-e1fc-4e42-9106-c8a446473943\" (UID: \"cc41b208-e1fc-4e42-9106-c8a446473943\") "
Jul 23 10:27:56.301812 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301623    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-home" (OuterVolumeSpecName: "home") pod "cc41b208-e1fc-4e42-9106-c8a446473943" (UID: "cc41b208-e1fc-4e42-9106-c8a446473943"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:27:56.301812 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301704    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc41b208-e1fc-4e42-9106-c8a446473943" (UID: "cc41b208-e1fc-4e42-9106-c8a446473943"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:27:56.301947 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301921    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc41b208-e1fc-4e42-9106-c8a446473943" (UID: "cc41b208-e1fc-4e42-9106-c8a446473943"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:27:56.302008 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.301993    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-tmp-dir\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:27:56.302055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.302011    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-home\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:27:56.303926 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.303896    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-dshm" (OuterVolumeSpecName: "dshm") pod "cc41b208-e1fc-4e42-9106-c8a446473943" (UID: "cc41b208-e1fc-4e42-9106-c8a446473943"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:27:56.304059 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.303953    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc41b208-e1fc-4e42-9106-c8a446473943-kube-api-access-p7sxn" (OuterVolumeSpecName: "kube-api-access-p7sxn") pod "cc41b208-e1fc-4e42-9106-c8a446473943" (UID: "cc41b208-e1fc-4e42-9106-c8a446473943"). InnerVolumeSpecName "kube-api-access-p7sxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:27:56.304059 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.304019    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc41b208-e1fc-4e42-9106-c8a446473943-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc41b208-e1fc-4e42-9106-c8a446473943" (UID: "cc41b208-e1fc-4e42-9106-c8a446473943"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:27:56.402820 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.402781    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7sxn\" (UniqueName: \"kubernetes.io/projected/cc41b208-e1fc-4e42-9106-c8a446473943-kube-api-access-p7sxn\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:27:56.402820 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.402813    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-model-cache\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:27:56.402820 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.402822    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc41b208-e1fc-4e42-9106-c8a446473943-tls-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:27:56.402820 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.402830    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc41b208-e1fc-4e42-9106-c8a446473943-dshm\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:27:56.993230 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.993193    2567 generic.go:356] "Generic (PLEG): container finished" podID="cc41b208-e1fc-4e42-9106-c8a446473943" containerID="fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7" exitCode=0
Jul 23 10:27:56.993751 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.993281    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"
Jul 23 10:27:56.993751 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.993274    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4" event={"ID":"cc41b208-e1fc-4e42-9106-c8a446473943","Type":"ContainerDied","Data":"fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7"}
Jul 23 10:27:56.993751 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.993401    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4" event={"ID":"cc41b208-e1fc-4e42-9106-c8a446473943","Type":"ContainerDied","Data":"9b37ae2518a097e64a32d2efdc3a43809bcf1d802ec8e1f9fc819cd0ec456d0e"}
Jul 23 10:27:56.993751 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:56.993427    2567 scope.go:117] "RemoveContainer" containerID="fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7"
Jul 23 10:27:57.002666 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:57.002649    2567 scope.go:117] "RemoveContainer" containerID="fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7"
Jul 23 10:27:57.002930 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:27:57.002911    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7\": container with ID starting with fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7 not found: ID does not exist" containerID="fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7"
Jul 23 10:27:57.003002 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:57.002942    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7"} err="failed to get container status \"fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7\": rpc error: code = NotFound desc = could not find container \"fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7\": container with ID starting with fc953737c88ef8e07b25484ea82bed86e08d1cc9a7b37f11632ae3fc60de8ce7 not found: ID does not exist"
Jul 23 10:27:57.017558 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:57.017535    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"]
Jul 23 10:27:57.020835 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:57.020813    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8941949f/e2e-lifecycle-model-8941949f-kserve-84fcb56b4c-lppd4"]
Jul 23 10:27:58.231989 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:27:58.231955    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc41b208-e1fc-4e42-9106-c8a446473943" path="/var/lib/kubelet/pods/cc41b208-e1fc-4e42-9106-c8a446473943/volumes"
Jul 23 10:28:24.334982 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:24.334949    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"]
Jul 23 10:28:24.335475 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:24.335193    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy" containerID="cri-o://f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c" gracePeriod=30
Jul 23 10:28:25.523728 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:25.523691    2567 patch_prober.go:28] interesting pod/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 10:28:25.524113 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:25.523746    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 10:28:29.587689 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.587664    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:28:29.622632 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622591    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-certs\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.622780 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622660    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-socket\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.622780 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622714    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-data\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.622780 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622747    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-envoy\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.622958 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622790    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c0b99fa-2a79-449f-b714-7e347503745e-istiod-ca-cert\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.622958 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622817    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c0b99fa-2a79-449f-b714-7e347503745e-istio-podinfo\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.622958 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622852    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-istio-token\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.622958 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622880    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-credential-socket\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.622958 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622886    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:28:29.622958 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622951    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8fkq\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-kube-api-access-q8fkq\") pod \"6c0b99fa-2a79-449f-b714-7e347503745e\" (UID: \"6c0b99fa-2a79-449f-b714-7e347503745e\") "
Jul 23 10:28:29.623295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.622986    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:28:29.623295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.623205    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:28:29.623295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.623276    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:29.623414 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.623294    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:29.623414 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.623298    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c0b99fa-2a79-449f-b714-7e347503745e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:28:29.623561 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.623534    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:28:29.625403 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.625369    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:28:29.625516 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.625472    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-kube-api-access-q8fkq" (OuterVolumeSpecName: "kube-api-access-q8fkq") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "kube-api-access-q8fkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:28:29.625560 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.625543    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c0b99fa-2a79-449f-b714-7e347503745e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:28:29.625762 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.625744    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c0b99fa-2a79-449f-b714-7e347503745e" (UID: "6c0b99fa-2a79-449f-b714-7e347503745e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:28:29.724055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.724016    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c0b99fa-2a79-449f-b714-7e347503745e-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:29.724055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.724048    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c0b99fa-2a79-449f-b714-7e347503745e-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:29.724055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.724056    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:29.724055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.724065    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:29.724368 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.724077    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8fkq\" (UniqueName: \"kubernetes.io/projected/6c0b99fa-2a79-449f-b714-7e347503745e-kube-api-access-q8fkq\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:29.724368 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.724085    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:29.724368 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:29.724093    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c0b99fa-2a79-449f-b714-7e347503745e-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:28:30.159503 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.159469    2567 generic.go:356] "Generic (PLEG): container finished" podID="6c0b99fa-2a79-449f-b714-7e347503745e" containerID="f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c" exitCode=0
Jul 23 10:28:30.159666 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.159506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" event={"ID":"6c0b99fa-2a79-449f-b714-7e347503745e","Type":"ContainerDied","Data":"f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c"}
Jul 23 10:28:30.159666 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.159522    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"
Jul 23 10:28:30.159666 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.159561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd" event={"ID":"6c0b99fa-2a79-449f-b714-7e347503745e","Type":"ContainerDied","Data":"7d5c250ba66ce4c3a25431835c08cddf797ebaacb5dc99d11d8c4aed5fa26431"}
Jul 23 10:28:30.159666 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.159586    2567 scope.go:117] "RemoveContainer" containerID="f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c"
Jul 23 10:28:30.168756 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.168740    2567 scope.go:117] "RemoveContainer" containerID="52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104"
Jul 23 10:28:30.177291 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.177275    2567 scope.go:117] "RemoveContainer" containerID="f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c"
Jul 23 10:28:30.177510 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:28:30.177491    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c\": container with ID starting with f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c not found: ID does not exist" containerID="f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c"
Jul 23 10:28:30.177563 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.177517    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c"} err="failed to get container status \"f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c\": rpc error: code = NotFound desc = could not find container \"f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c\": container with ID starting with f931dda775640537647bebe9eb0b141c029a299f49a668d40b8582d1c52b657c not found: ID does not exist"
Jul 23 10:28:30.177563 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.177537    2567 scope.go:117] "RemoveContainer" containerID="52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104"
Jul 23 10:28:30.177782 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:28:30.177768    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104\": container with ID starting with 52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104 not found: ID does not exist" containerID="52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104"
Jul 23 10:28:30.177828 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.177786    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104"} err="failed to get container status \"52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104\": rpc error: code = NotFound desc = could not find container \"52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104\": container with ID starting with 52045f84073b78b1f373b4d0a1cf796dec66e89103a56107dfabc6bfb139d104 not found: ID does not exist"
Jul 23 10:28:30.181659 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.181638    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"]
Jul 23 10:28:30.185643 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.185625    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8941949f-openshift-default-5c4f87db4c-wc8rd"]
Jul 23 10:28:30.231639 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:30.231615    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" path="/var/lib/kubelet/pods/6c0b99fa-2a79-449f-b714-7e347503745e/volumes"
Jul 23 10:28:36.410417 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:28:36.410388    2567 scope.go:117] "RemoveContainer" containerID="775077291dfc314f287ba6f40428c26ca63f1fb26d6da732e97b1b6280e558ed"
Jul 23 10:29:19.929348 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929263    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"]
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929641    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc41b208-e1fc-4e42-9106-c8a446473943" containerName="main"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929656    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc41b208-e1fc-4e42-9106-c8a446473943" containerName="main"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929686    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69df17d0-6e08-49b8-bcee-e48465b81f32" containerName="revoke-keys"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929695    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="69df17d0-6e08-49b8-bcee-e48465b81f32" containerName="revoke-keys"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929708    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929714    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929729    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929733    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929797    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc41b208-e1fc-4e42-9106-c8a446473943" containerName="main"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929805    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="69df17d0-6e08-49b8-bcee-e48465b81f32" containerName="revoke-keys"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929811    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy"
Jul 23 10:29:19.929819 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.929817    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0b99fa-2a79-449f-b714-7e347503745e" containerName="istio-proxy"
Jul 23 10:29:19.932658 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.932640    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:19.936564 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.936519    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d95f36-openshift-default-dockercfg-xmt5x\""
Jul 23 10:29:19.946027 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:19.946004    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"]
Jul 23 10:29:20.000377 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000346    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-podinfo\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.000377 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-credential-socket\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.000598 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnbb5\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-kube-api-access-rnbb5\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.000598 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-data\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.000598 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-token\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.000598 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-certs\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.000745 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2bff45d-bd92-411d-91f5-eb40219121f4-istiod-ca-cert\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.000745 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-socket\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.000745 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.000682    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-envoy\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.101654 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.101613    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-podinfo\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.101859 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.101666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-credential-socket\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.101859 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.101703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnbb5\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-kube-api-access-rnbb5\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.101859 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.101745    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-data\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.101859 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.101770    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-token\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102089 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.101891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-certs\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102089 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.101947    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2bff45d-bd92-411d-91f5-eb40219121f4-istiod-ca-cert\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102089 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.101982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-socket\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102089 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.102030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-envoy\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102341 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.102318    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-credential-socket\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102397 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.102349    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-data\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102809 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.102778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-socket\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102929 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.102847    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-certs\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.102929 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.102917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2bff45d-bd92-411d-91f5-eb40219121f4-istiod-ca-cert\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.104523 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.104500    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-podinfo\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.104636 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.104619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-envoy\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.114707 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.114688    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnbb5\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-kube-api-access-rnbb5\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.117204 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.117184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-token\") pod \"e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") " pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.242547 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.242467    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:20.380509 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.380484    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"]
Jul 23 10:29:20.382339 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:29:20.382313    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bff45d_bd92_411d_91f5_eb40219121f4.slice/crio-7fd34d1f7bc6f5ee91a877889ca3067b24cfe6f39ad2b14b0c54a18437f48a9d WatchSource:0}: Error finding container 7fd34d1f7bc6f5ee91a877889ca3067b24cfe6f39ad2b14b0c54a18437f48a9d: Status 404 returned error can't find the container with id 7fd34d1f7bc6f5ee91a877889ca3067b24cfe6f39ad2b14b0c54a18437f48a9d
Jul 23 10:29:20.384475 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.384444    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:20.384554 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.384512    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:20.384554 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.384539    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:20.403185 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:20.403151    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" event={"ID":"a2bff45d-bd92-411d-91f5-eb40219121f4","Type":"ContainerStarted","Data":"7fd34d1f7bc6f5ee91a877889ca3067b24cfe6f39ad2b14b0c54a18437f48a9d"}
Jul 23 10:29:21.409720 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:21.409688    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" event={"ID":"a2bff45d-bd92-411d-91f5-eb40219121f4","Type":"ContainerStarted","Data":"2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63"}
Jul 23 10:29:21.434071 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:21.434020    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" podStartSLOduration=2.434005479 podStartE2EDuration="2.434005479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:29:21.431168801 +0000 UTC m=+2085.669364064" watchObservedRunningTime="2026-07-23 10:29:21.434005479 +0000 UTC m=+2085.672200731"
Jul 23 10:29:22.243594 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:22.243563    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:22.248392 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:22.248370    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:22.414891 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:22.414861    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:22.415872 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:22.415856    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:28.491733 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.491690    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"]
Jul 23 10:29:28.495987 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.495967    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.498702 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.498675    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6fb9c7-openshift-default-dockercfg-wd4zb\""
Jul 23 10:29:28.505453 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.505433    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"]
Jul 23 10:29:28.581306 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-credential-socket\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.581504 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581327    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-socket\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.581504 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-envoy\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.581504 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a11eec7-41ab-4725-999a-9fdb5b427f89-istiod-ca-cert\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.581504 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-token\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.581742 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581538    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-podinfo\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.581742 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581591    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w4zm\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-kube-api-access-6w4zm\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.581742 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581621    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-certs\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.581742 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.581663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-data\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.682695 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682654    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-podinfo\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.682892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w4zm\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-kube-api-access-6w4zm\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.682892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682737    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-certs\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.682892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-data\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.682892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-credential-socket\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.682892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682854    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-socket\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.682892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682884    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-envoy\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.683169 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a11eec7-41ab-4725-999a-9fdb5b427f89-istiod-ca-cert\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.683169 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.682957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-token\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.683317 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.683229    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-certs\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.683376 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.683318    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-credential-socket\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.683376 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.683326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-socket\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.683641 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.683617    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-data\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.683887 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.683867    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a11eec7-41ab-4725-999a-9fdb5b427f89-istiod-ca-cert\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.685351 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.685330    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-podinfo\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.685463 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.685329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-envoy\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.690848 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.690826    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w4zm\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-kube-api-access-6w4zm\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.690955 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.690916    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-token\") pod \"e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") " pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.808501 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.808416    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:28.948259 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.948178    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"]
Jul 23 10:29:28.951158 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:29:28.951133    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a11eec7_41ab_4725_999a_9fdb5b427f89.slice/crio-65757166ec02ca206427beda028cd2b1a8a958710bc27968052b65971cab242d WatchSource:0}: Error finding container 65757166ec02ca206427beda028cd2b1a8a958710bc27968052b65971cab242d: Status 404 returned error can't find the container with id 65757166ec02ca206427beda028cd2b1a8a958710bc27968052b65971cab242d
Jul 23 10:29:28.953432 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.953402    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:28.953530 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.953480    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:28.953599 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:28.953527    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:29.451900 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:29.451867    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" event={"ID":"8a11eec7-41ab-4725-999a-9fdb5b427f89","Type":"ContainerStarted","Data":"15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b"}
Jul 23 10:29:29.452075 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:29.451918    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" event={"ID":"8a11eec7-41ab-4725-999a-9fdb5b427f89","Type":"ContainerStarted","Data":"65757166ec02ca206427beda028cd2b1a8a958710bc27968052b65971cab242d"}
Jul 23 10:29:29.473588 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:29.473527    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" podStartSLOduration=1.473512636 podStartE2EDuration="1.473512636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:29:29.472265312 +0000 UTC m=+2093.710460585" watchObservedRunningTime="2026-07-23 10:29:29.473512636 +0000 UTC m=+2093.711707888"
Jul 23 10:29:29.809080 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:29.808998    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:30.820010 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:30.819965    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:31.462103 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:31.462072    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:31.463122 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:31.463102    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:36.344775 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:36.344744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:29:36.354874 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:36.354848    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:29:36.437539 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:36.437508    2567 scope.go:117] "RemoveContainer" containerID="610f2ec113010878001995f163ff16350736d8eea650c9aa86f9e1ce656c7400"
Jul 23 10:29:37.796572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:37.796116    2567 patch_prober.go:28] interesting pod/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:47262->10.132.0.52:15021: read: connection reset by peer" start-of-body=
Jul 23 10:29:37.796572 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:37.796181    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": read tcp 10.132.0.2:47262->10.132.0.52:15021: read: connection reset by peer"
Jul 23 10:29:38.499373 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:38.499338    2567 generic.go:356] "Generic (PLEG): container finished" podID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerID="2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63" exitCode=0
Jul 23 10:29:38.499525 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:38.499409    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" event={"ID":"a2bff45d-bd92-411d-91f5-eb40219121f4","Type":"ContainerDied","Data":"2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63"}
Jul 23 10:29:38.499846 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:38.499833    2567 scope.go:117] "RemoveContainer" containerID="2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63"
Jul 23 10:29:38.500852 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:38.500827    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:38.500930 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:38.500913    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:38.500965 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:38.500956    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:39.510000 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:39.509953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" event={"ID":"a2bff45d-bd92-411d-91f5-eb40219121f4","Type":"ContainerStarted","Data":"de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc"}
Jul 23 10:29:40.243525 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:40.243493    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:40.243781 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:40.243759    2567 patch_prober.go:28] interesting pod/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 10:29:40.243842 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:40.243823    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 10:29:41.243436 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:41.243395    2567 patch_prober.go:28] interesting pod/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 10:29:41.243903 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:41.243478    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 10:29:42.243276 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:42.243221    2567 patch_prober.go:28] interesting pod/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 10:29:42.243473 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:42.243295    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 10:29:43.243359 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:43.243324    2567 patch_prober.go:28] interesting pod/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 10:29:43.243545 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:43.243378    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 10:29:44.246835 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.246802    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:44.247327 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.247137    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:44.247787 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.247770    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:29:44.543583 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.543498    2567 generic.go:356] "Generic (PLEG): container finished" podID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerID="15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b" exitCode=0
Jul 23 10:29:44.543754 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.543579    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" event={"ID":"8a11eec7-41ab-4725-999a-9fdb5b427f89","Type":"ContainerDied","Data":"15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b"}
Jul 23 10:29:44.544081 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.544063    2567 scope.go:117] "RemoveContainer" containerID="15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b"
Jul 23 10:29:44.545065 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.545038    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:44.545138 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.545122    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:44.545201 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:44.545184    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:29:45.550602 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:45.550571    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" event={"ID":"8a11eec7-41ab-4725-999a-9fdb5b427f89","Type":"ContainerStarted","Data":"fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2"}
Jul 23 10:29:45.811042 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:45.810885    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:45.811396 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:45.811371    2567 patch_prober.go:28] interesting pod/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 10:29:45.811583 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:45.811559    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 10:29:46.462366 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:46.462330    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:46.809761 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:46.809721    2567 patch_prober.go:28] interesting pod/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 10:29:46.810266 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:46.809785    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 10:29:47.809726 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:47.809680    2567 patch_prober.go:28] interesting pod/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 10:29:47.809939 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:47.809749    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 10:29:48.809373 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:48.809332    2567 patch_prober.go:28] interesting pod/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 10:29:48.809598 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:48.809398    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 10:29:49.812788 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:49.812760    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:29:49.813724 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:29:49.813705    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:30:00.141735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.141703    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"]
Jul 23 10:30:00.144364 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.144349    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"
Jul 23 10:30:00.151445 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.151419    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2vbpd\""
Jul 23 10:30:00.153933 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.153907    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"]
Jul 23 10:30:00.154315 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.154295    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"
Jul 23 10:30:00.160704 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.160168    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"
Jul 23 10:30:00.164741 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.164716    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"]
Jul 23 10:30:00.175930 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.175750    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"]
Jul 23 10:30:00.192621 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.192601    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"
Jul 23 10:30:00.322073 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.322043    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"]
Jul 23 10:30:00.325491 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:30:00.325453    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb7300ea_ce3a_4725_b3b7_5a72f400c6db.slice/crio-f8dd88af1f22a4b64853dad80b98ccafcc977217952a0c41d9289f80d0f2991c WatchSource:0}: Error finding container f8dd88af1f22a4b64853dad80b98ccafcc977217952a0c41d9289f80d0f2991c: Status 404 returned error can't find the container with id f8dd88af1f22a4b64853dad80b98ccafcc977217952a0c41d9289f80d0f2991c
Jul 23 10:30:00.346987 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.346964    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"]
Jul 23 10:30:00.355394 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:30:00.355370    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b30e85_d977_438a_abd0_1618fcfabb62.slice/crio-ab997ab8c1a24ac640eb9e5b0fc634a9814f1a8a00897a23a56efd62b72ab413 WatchSource:0}: Error finding container ab997ab8c1a24ac640eb9e5b0fc634a9814f1a8a00897a23a56efd62b72ab413: Status 404 returned error can't find the container with id ab997ab8c1a24ac640eb9e5b0fc634a9814f1a8a00897a23a56efd62b72ab413
Jul 23 10:30:00.631631 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.631603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf" event={"ID":"eb7300ea-ce3a-4725-b3b7-5a72f400c6db","Type":"ContainerStarted","Data":"008cc1878f6b347d6ea3b19b32b853db464610fe9d869205231d67e4c735c63a"}
Jul 23 10:30:00.631754 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.631662    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf" event={"ID":"eb7300ea-ce3a-4725-b3b7-5a72f400c6db","Type":"ContainerStarted","Data":"f8dd88af1f22a4b64853dad80b98ccafcc977217952a0c41d9289f80d0f2991c"}
Jul 23 10:30:00.633091 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.633068    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp" event={"ID":"44b30e85-d977-438a-abd0-1618fcfabb62","Type":"ContainerStarted","Data":"aae603d4125246fff26bdfbcb7e3dcf5d779c17d049e9f4b89a33fec730d9d99"}
Jul 23 10:30:00.633172 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.633106    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp" event={"ID":"44b30e85-d977-438a-abd0-1618fcfabb62","Type":"ContainerStarted","Data":"ab997ab8c1a24ac640eb9e5b0fc634a9814f1a8a00897a23a56efd62b72ab413"}
Jul 23 10:30:00.654028 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:00.653988    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf" podStartSLOduration=0.653976042 podStartE2EDuration="653.976042ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:30:00.652354092 +0000 UTC m=+2124.890549344" watchObservedRunningTime="2026-07-23 10:30:00.653976042 +0000 UTC m=+2124.892171308"
Jul 23 10:30:01.639979 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:01.639941    2567 generic.go:356] "Generic (PLEG): container finished" podID="44b30e85-d977-438a-abd0-1618fcfabb62" containerID="aae603d4125246fff26bdfbcb7e3dcf5d779c17d049e9f4b89a33fec730d9d99" exitCode=0
Jul 23 10:30:01.640428 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:01.640026    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp" event={"ID":"44b30e85-d977-438a-abd0-1618fcfabb62","Type":"ContainerDied","Data":"aae603d4125246fff26bdfbcb7e3dcf5d779c17d049e9f4b89a33fec730d9d99"}
Jul 23 10:30:01.641488 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:01.641470    2567 generic.go:356] "Generic (PLEG): container finished" podID="eb7300ea-ce3a-4725-b3b7-5a72f400c6db" containerID="008cc1878f6b347d6ea3b19b32b853db464610fe9d869205231d67e4c735c63a" exitCode=0
Jul 23 10:30:01.641567 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:01.641549    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf" event={"ID":"eb7300ea-ce3a-4725-b3b7-5a72f400c6db","Type":"ContainerDied","Data":"008cc1878f6b347d6ea3b19b32b853db464610fe9d869205231d67e4c735c63a"}
Jul 23 10:30:02.789651 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:02.789619    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"
Jul 23 10:30:02.792565 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:02.792547    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"
Jul 23 10:30:03.655297 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:03.655265    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"
Jul 23 10:30:03.655297 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:03.655285    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp" event={"ID":"44b30e85-d977-438a-abd0-1618fcfabb62","Type":"ContainerDied","Data":"ab997ab8c1a24ac640eb9e5b0fc634a9814f1a8a00897a23a56efd62b72ab413"}
Jul 23 10:30:03.655508 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:03.655334    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab997ab8c1a24ac640eb9e5b0fc634a9814f1a8a00897a23a56efd62b72ab413"
Jul 23 10:30:03.656543 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:03.656523    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"
Jul 23 10:30:03.656543 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:03.656540    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf" event={"ID":"eb7300ea-ce3a-4725-b3b7-5a72f400c6db","Type":"ContainerDied","Data":"f8dd88af1f22a4b64853dad80b98ccafcc977217952a0c41d9289f80d0f2991c"}
Jul 23 10:30:03.656713 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:03.656567    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8dd88af1f22a4b64853dad80b98ccafcc977217952a0c41d9289f80d0f2991c"
Jul 23 10:30:20.818101 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.818066    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"]
Jul 23 10:30:20.818502 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.818474    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb7300ea-ce3a-4725-b3b7-5a72f400c6db" containerName="cleanup"
Jul 23 10:30:20.818502 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.818485    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb7300ea-ce3a-4725-b3b7-5a72f400c6db" containerName="cleanup"
Jul 23 10:30:20.818502 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.818497    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b30e85-d977-438a-abd0-1618fcfabb62" containerName="cleanup"
Jul 23 10:30:20.818502 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.818503    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b30e85-d977-438a-abd0-1618fcfabb62" containerName="cleanup"
Jul 23 10:30:20.818628 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.818566    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b30e85-d977-438a-abd0-1618fcfabb62" containerName="cleanup"
Jul 23 10:30:20.818628 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.818577    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb7300ea-ce3a-4725-b3b7-5a72f400c6db" containerName="cleanup"
Jul 23 10:30:20.820823 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.820793    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:20.825216 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.825192    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6fb9c7\"/\"kube-root-ca.crt\""
Jul 23 10:30:20.825337 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.825192    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6fb9c7\"/\"openshift-service-ca.crt\""
Jul 23 10:30:20.826202 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.826185    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6fb9c7\"/\"default-dockercfg-rnv9b\""
Jul 23 10:30:20.826470 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.826441    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6fb9c7\"/\"test-model-6fb9c7-kserve-self-signed-certs\""
Jul 23 10:30:20.834273 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.834228    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"]
Jul 23 10:30:20.984087 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.984049    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-model-cache\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:20.984295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.984119    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rk7\" (UniqueName: \"kubernetes.io/projected/ccf925c7-bbb5-40ee-bd37-141118b467eb-kube-api-access-55rk7\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:20.984295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.984192    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf925c7-bbb5-40ee-bd37-141118b467eb-tls-certs\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:20.984295 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.984223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-tmp-dir\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:20.984435 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.984315    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-dshm\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:20.984435 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:20.984336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-home\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.084882 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.084796    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rk7\" (UniqueName: \"kubernetes.io/projected/ccf925c7-bbb5-40ee-bd37-141118b467eb-kube-api-access-55rk7\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.084882 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.084842    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf925c7-bbb5-40ee-bd37-141118b467eb-tls-certs\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.084882 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.084861    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-tmp-dir\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.085186 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.084899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-dshm\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.085186 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.084927    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-home\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.085186 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.084972    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-model-cache\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.085394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.085359    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-tmp-dir\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.085394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.085372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-model-cache\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.085465 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.085427    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-home\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.087307 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.087280    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-dshm\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.087448 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.087431    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf925c7-bbb5-40ee-bd37-141118b467eb-tls-certs\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.093611 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.093586    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rk7\" (UniqueName: \"kubernetes.io/projected/ccf925c7-bbb5-40ee-bd37-141118b467eb-kube-api-access-55rk7\") pod \"test-model-6fb9c7-kserve-f5f977bc-tc5qb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") " pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.130400 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.130368    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:21.275777 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.275756    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"]
Jul 23 10:30:21.278371 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:30:21.278342    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccf925c7_bbb5_40ee_bd37_141118b467eb.slice/crio-f5fe5e9f330e00d9b80d7b24b74258e9b494866ab0604fd0ac053e5707a4c23d WatchSource:0}: Error finding container f5fe5e9f330e00d9b80d7b24b74258e9b494866ab0604fd0ac053e5707a4c23d: Status 404 returned error can't find the container with id f5fe5e9f330e00d9b80d7b24b74258e9b494866ab0604fd0ac053e5707a4c23d
Jul 23 10:30:21.750423 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.750386    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb" event={"ID":"ccf925c7-bbb5-40ee-bd37-141118b467eb","Type":"ContainerStarted","Data":"5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1"}
Jul 23 10:30:21.750616 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.750433    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb" event={"ID":"ccf925c7-bbb5-40ee-bd37-141118b467eb","Type":"ContainerStarted","Data":"f5fe5e9f330e00d9b80d7b24b74258e9b494866ab0604fd0ac053e5707a4c23d"}
Jul 23 10:30:21.774422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:21.774371    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb" podStartSLOduration=1.774354435 podStartE2EDuration="1.774354435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:30:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:30:21.772133404 +0000 UTC m=+2146.010328657" watchObservedRunningTime="2026-07-23 10:30:21.774354435 +0000 UTC m=+2146.012549686"
Jul 23 10:30:31.131394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:31.131298    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:31.131394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:31.131367    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:31.144388 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:31.144364    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:31.814913 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:31.814882    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:30:36.458228 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:30:36.458191    2567 scope.go:117] "RemoveContainer" containerID="249afe242559b3f62af1fea61eeb954f090286f10d447538414602d17d4193de"
Jul 23 10:31:02.272000 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:02.271967    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"]
Jul 23 10:31:13.003628 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:13.003583    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"]
Jul 23 10:31:13.010539 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:13.010509    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d95f36-29746710-jqbsp"]
Jul 23 10:31:14.231616 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:14.231581    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b30e85-d977-438a-abd0-1618fcfabb62" path="/var/lib/kubelet/pods/44b30e85-d977-438a-abd0-1618fcfabb62/volumes"
Jul 23 10:31:17.292400 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.292340    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb" podUID="ccf925c7-bbb5-40ee-bd37-141118b467eb" containerName="main" containerID="cri-o://5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1" gracePeriod=45
Jul 23 10:31:17.542217 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.542186    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:31:17.603851 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.603826    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-dshm\") pod \"ccf925c7-bbb5-40ee-bd37-141118b467eb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") "
Jul 23 10:31:17.604013 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.603929    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-model-cache\") pod \"ccf925c7-bbb5-40ee-bd37-141118b467eb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") "
Jul 23 10:31:17.604013 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.603949    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-tmp-dir\") pod \"ccf925c7-bbb5-40ee-bd37-141118b467eb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") "
Jul 23 10:31:17.604013 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.603968    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf925c7-bbb5-40ee-bd37-141118b467eb-tls-certs\") pod \"ccf925c7-bbb5-40ee-bd37-141118b467eb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") "
Jul 23 10:31:17.604013 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.603981    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-home\") pod \"ccf925c7-bbb5-40ee-bd37-141118b467eb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") "
Jul 23 10:31:17.604013 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.604007    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55rk7\" (UniqueName: \"kubernetes.io/projected/ccf925c7-bbb5-40ee-bd37-141118b467eb-kube-api-access-55rk7\") pod \"ccf925c7-bbb5-40ee-bd37-141118b467eb\" (UID: \"ccf925c7-bbb5-40ee-bd37-141118b467eb\") "
Jul 23 10:31:17.604275 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.604228    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-model-cache" (OuterVolumeSpecName: "model-cache") pod "ccf925c7-bbb5-40ee-bd37-141118b467eb" (UID: "ccf925c7-bbb5-40ee-bd37-141118b467eb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:17.604336 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.604273    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ccf925c7-bbb5-40ee-bd37-141118b467eb" (UID: "ccf925c7-bbb5-40ee-bd37-141118b467eb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:17.604394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.604338    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-model-cache\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:17.604394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.604350    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-home" (OuterVolumeSpecName: "home") pod "ccf925c7-bbb5-40ee-bd37-141118b467eb" (UID: "ccf925c7-bbb5-40ee-bd37-141118b467eb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:17.606392 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.606365    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-dshm" (OuterVolumeSpecName: "dshm") pod "ccf925c7-bbb5-40ee-bd37-141118b467eb" (UID: "ccf925c7-bbb5-40ee-bd37-141118b467eb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:17.606510 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.606396    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccf925c7-bbb5-40ee-bd37-141118b467eb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ccf925c7-bbb5-40ee-bd37-141118b467eb" (UID: "ccf925c7-bbb5-40ee-bd37-141118b467eb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:31:17.606510 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.606427    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf925c7-bbb5-40ee-bd37-141118b467eb-kube-api-access-55rk7" (OuterVolumeSpecName: "kube-api-access-55rk7") pod "ccf925c7-bbb5-40ee-bd37-141118b467eb" (UID: "ccf925c7-bbb5-40ee-bd37-141118b467eb"). InnerVolumeSpecName "kube-api-access-55rk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:31:17.704903 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.704860    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-dshm\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:17.704903 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.704895    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-tmp-dir\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:17.704903 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.704905    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf925c7-bbb5-40ee-bd37-141118b467eb-tls-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:17.704903 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.704912    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf925c7-bbb5-40ee-bd37-141118b467eb-home\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:17.705180 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:17.704921    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55rk7\" (UniqueName: \"kubernetes.io/projected/ccf925c7-bbb5-40ee-bd37-141118b467eb-kube-api-access-55rk7\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:18.037005 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.036922    2567 generic.go:356] "Generic (PLEG): container finished" podID="ccf925c7-bbb5-40ee-bd37-141118b467eb" containerID="5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1" exitCode=0
Jul 23 10:31:18.037005 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.036967    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"
Jul 23 10:31:18.037186 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.037007    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb" event={"ID":"ccf925c7-bbb5-40ee-bd37-141118b467eb","Type":"ContainerDied","Data":"5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1"}
Jul 23 10:31:18.037186 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.037051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb" event={"ID":"ccf925c7-bbb5-40ee-bd37-141118b467eb","Type":"ContainerDied","Data":"f5fe5e9f330e00d9b80d7b24b74258e9b494866ab0604fd0ac053e5707a4c23d"}
Jul 23 10:31:18.037186 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.037073    2567 scope.go:117] "RemoveContainer" containerID="5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1"
Jul 23 10:31:18.046084 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.046068    2567 scope.go:117] "RemoveContainer" containerID="5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1"
Jul 23 10:31:18.046371 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:31:18.046350    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1\": container with ID starting with 5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1 not found: ID does not exist" containerID="5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1"
Jul 23 10:31:18.046481 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.046376    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1"} err="failed to get container status \"5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1\": rpc error: code = NotFound desc = could not find container \"5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1\": container with ID starting with 5cd8d071509594802ee38d545455f2168730ea1888cfce092ca834e196993ad1 not found: ID does not exist"
Jul 23 10:31:18.077892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.077864    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"]
Jul 23 10:31:18.083764 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.083732    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6fb9c7/test-model-6fb9c7-kserve-f5f977bc-tc5qb"]
Jul 23 10:31:18.231173 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:18.231138    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccf925c7-bbb5-40ee-bd37-141118b467eb" path="/var/lib/kubelet/pods/ccf925c7-bbb5-40ee-bd37-141118b467eb/volumes"
Jul 23 10:31:24.199226 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:24.199193    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"]
Jul 23 10:31:24.199725 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:24.199472    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy" containerID="cri-o://de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc" gracePeriod=30
Jul 23 10:31:29.248678 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.248642    2567 patch_prober.go:28] interesting pod/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 10:31:29.249078 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.248717    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 10:31:29.456211 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.456190    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:31:29.508602 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508537    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-data\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.508602 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508574    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-certs\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.508602 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508597    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-podinfo\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.508838 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508644    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-socket\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.508838 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508664    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnbb5\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-kube-api-access-rnbb5\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.508838 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508678    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-credential-socket\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.508838 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508694    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-token\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.508838 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508710    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2bff45d-bd92-411d-91f5-eb40219121f4-istiod-ca-cert\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.508838 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508735    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-envoy\") pod \"a2bff45d-bd92-411d-91f5-eb40219121f4\" (UID: \"a2bff45d-bd92-411d-91f5-eb40219121f4\") "
Jul 23 10:31:29.509127 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508833    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:29.509127 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.508894    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:29.509127 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.509050    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:29.509127 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.509070    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:29.509352 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.509135    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:29.509352 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.509162    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2bff45d-bd92-411d-91f5-eb40219121f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:31:29.509638 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.509397    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:29.511024 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.510999    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:29.511133 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.511035    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:31:29.511133 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.511065    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:31:29.511133 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.511109    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-kube-api-access-rnbb5" (OuterVolumeSpecName: "kube-api-access-rnbb5") pod "a2bff45d-bd92-411d-91f5-eb40219121f4" (UID: "a2bff45d-bd92-411d-91f5-eb40219121f4"). InnerVolumeSpecName "kube-api-access-rnbb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:31:29.610445 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.610402    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnbb5\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-kube-api-access-rnbb5\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:29.610445 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.610439    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:29.610445 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.610452    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:29.610445 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.610461    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2bff45d-bd92-411d-91f5-eb40219121f4-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:29.610693 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.610468    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:29.610693 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.610475    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:29.610693 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:29.610482    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2bff45d-bd92-411d-91f5-eb40219121f4-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:30.101013 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.100985    2567 generic.go:356] "Generic (PLEG): container finished" podID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerID="de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc" exitCode=0
Jul 23 10:31:30.101177 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.101038    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"
Jul 23 10:31:30.101177 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.101073    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" event={"ID":"a2bff45d-bd92-411d-91f5-eb40219121f4","Type":"ContainerDied","Data":"de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc"}
Jul 23 10:31:30.101177 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.101124    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4" event={"ID":"a2bff45d-bd92-411d-91f5-eb40219121f4","Type":"ContainerDied","Data":"7fd34d1f7bc6f5ee91a877889ca3067b24cfe6f39ad2b14b0c54a18437f48a9d"}
Jul 23 10:31:30.101177 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.101145    2567 scope.go:117] "RemoveContainer" containerID="de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc"
Jul 23 10:31:30.110536 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.110514    2567 scope.go:117] "RemoveContainer" containerID="2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63"
Jul 23 10:31:30.118527 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.118509    2567 scope.go:117] "RemoveContainer" containerID="de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc"
Jul 23 10:31:30.118772 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:31:30.118753    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc\": container with ID starting with de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc not found: ID does not exist" containerID="de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc"
Jul 23 10:31:30.118850 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.118783    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc"} err="failed to get container status \"de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc\": rpc error: code = NotFound desc = could not find container \"de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc\": container with ID starting with de973b1cf9657a2910f0e0010e90092058f520907868fcd991a2234a17485bfc not found: ID does not exist"
Jul 23 10:31:30.118850 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.118806    2567 scope.go:117] "RemoveContainer" containerID="2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63"
Jul 23 10:31:30.119029 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:31:30.119013    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63\": container with ID starting with 2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63 not found: ID does not exist" containerID="2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63"
Jul 23 10:31:30.119072 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.119035    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63"} err="failed to get container status \"2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63\": rpc error: code = NotFound desc = could not find container \"2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63\": container with ID starting with 2af539f184439a19cf153eb0cf372ede64efaac6236d793a81a6f821f2920e63 not found: ID does not exist"
Jul 23 10:31:30.123397 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.123376    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"]
Jul 23 10:31:30.127982 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.127962    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d95f36-openshift-default-6fcc8dbc9f-q55c4"]
Jul 23 10:31:30.231283 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:30.231253    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" path="/var/lib/kubelet/pods/a2bff45d-bd92-411d-91f5-eb40219121f4/volumes"
Jul 23 10:31:34.989692 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:34.989662    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"]
Jul 23 10:31:34.992524 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:34.992495    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-6fb9c7-29746710-j5zjf"]
Jul 23 10:31:36.231518 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:36.231479    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb7300ea-ce3a-4725-b3b7-5a72f400c6db" path="/var/lib/kubelet/pods/eb7300ea-ce3a-4725-b3b7-5a72f400c6db/volumes"
Jul 23 10:31:46.195936 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:46.195900    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"]
Jul 23 10:31:46.196427 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:46.196156    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy" containerID="cri-o://fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2" gracePeriod=30
Jul 23 10:31:47.068370 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.068341    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"]
Jul 23 10:31:47.068726 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.068712    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy"
Jul 23 10:31:47.068771 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.068731    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy"
Jul 23 10:31:47.068771 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.068739    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf925c7-bbb5-40ee-bd37-141118b467eb" containerName="main"
Jul 23 10:31:47.068771 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.068745    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf925c7-bbb5-40ee-bd37-141118b467eb" containerName="main"
Jul 23 10:31:47.068860 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.068831    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf925c7-bbb5-40ee-bd37-141118b467eb" containerName="main"
Jul 23 10:31:47.068860 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.068840    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy"
Jul 23 10:31:47.068860 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.068845    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy"
Jul 23 10:31:47.071897 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.071879    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.074935 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.074915    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b4fbcc-openshift-default-dockercfg-4qq5f\""
Jul 23 10:31:47.086526 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.086500    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"]
Jul 23 10:31:47.169968 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.169916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-credential-socket\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.169968 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.169970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-data\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.170223 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.170054    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istiod-ca-cert\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.170223 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.170103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-token\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.170223 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.170136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-socket\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.170223 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.170207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-envoy\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.170427 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.170261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-podinfo\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.170427 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.170296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2z75\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-kube-api-access-t2z75\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.170427 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.170328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-certs\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.271614 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271580    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-podinfo\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271622    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2z75\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-kube-api-access-t2z75\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-certs\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-credential-socket\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-data\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istiod-ca-cert\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-token\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-socket\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272043 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.271907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-envoy\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.272184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-certs\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.272210    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-socket\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.272284    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-credential-socket\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272569 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.272532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istiod-ca-cert\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.272785 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.272766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-data\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.274137 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.274115    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-envoy\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.274294 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.274276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-podinfo\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.281723 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.281699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2z75\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-kube-api-access-t2z75\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.282834 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.282808    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-token\") pod \"e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") " pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.382047 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.382011    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:47.526276 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.526251    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"]
Jul 23 10:31:47.528312 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:31:47.528283    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6fb5b5_71ea_4488_8c48_7881ef3de348.slice/crio-86fd00594281af0ed897ca9ead8274ca2f9a53b3343da89b184853e8bcd4cd27 WatchSource:0}: Error finding container 86fd00594281af0ed897ca9ead8274ca2f9a53b3343da89b184853e8bcd4cd27: Status 404 returned error can't find the container with id 86fd00594281af0ed897ca9ead8274ca2f9a53b3343da89b184853e8bcd4cd27
Jul 23 10:31:47.530303 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.530276    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:31:47.530376 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.530337    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:31:47.530376 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:47.530363    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:31:48.210596 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:48.210564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" event={"ID":"0e6fb5b5-71ea-4488-8c48-7881ef3de348","Type":"ContainerStarted","Data":"2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a"}
Jul 23 10:31:48.210773 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:48.210613    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" event={"ID":"0e6fb5b5-71ea-4488-8c48-7881ef3de348","Type":"ContainerStarted","Data":"86fd00594281af0ed897ca9ead8274ca2f9a53b3343da89b184853e8bcd4cd27"}
Jul 23 10:31:48.235070 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:48.235022    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" podStartSLOduration=1.23500784 podStartE2EDuration="1.23500784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:31:48.233287874 +0000 UTC m=+2232.471483139" watchObservedRunningTime="2026-07-23 10:31:48.23500784 +0000 UTC m=+2232.473203090"
Jul 23 10:31:48.382780 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:48.382744    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:48.387634 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:48.387610    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:49.216603 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:49.216565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:49.217580 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:49.217557    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:31:49.815410 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:49.815378    2567 patch_prober.go:28] interesting pod/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 10:31:49.815769 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:49.815430    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 10:31:51.454169 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.454142    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:31:51.614034 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614006    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-envoy\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.614196 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614041    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a11eec7-41ab-4725-999a-9fdb5b427f89-istiod-ca-cert\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.614196 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614061    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-token\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.614196 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614096    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-socket\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.614196 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614135    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-podinfo\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.614632 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614605    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-credential-socket\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.614773 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614703    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w4zm\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-kube-api-access-6w4zm\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.614773 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614742    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-data\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.614879 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614767    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:51.614879 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614773    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a11eec7-41ab-4725-999a-9fdb5b427f89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:31:51.614879 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.614815    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-certs\") pod \"8a11eec7-41ab-4725-999a-9fdb5b427f89\" (UID: \"8a11eec7-41ab-4725-999a-9fdb5b427f89\") "
Jul 23 10:31:51.615117 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.615024    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:51.615515 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.615494    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:51.615622 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.615599    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:51.617018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.616332    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:51.617018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.616356    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:51.617018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.616371    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:51.617018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.616434    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:51.617018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.616446    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a11eec7-41ab-4725-999a-9fdb5b427f89-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:51.623141 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.617332    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-kube-api-access-6w4zm" (OuterVolumeSpecName: "kube-api-access-6w4zm") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "kube-api-access-6w4zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:31:51.623141 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.617428    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:31:51.623141 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.617754    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:31:51.623141 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.623134    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a11eec7-41ab-4725-999a-9fdb5b427f89" (UID: "8a11eec7-41ab-4725-999a-9fdb5b427f89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:31:51.717987 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.717953    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w4zm\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-kube-api-access-6w4zm\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:51.717987 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.717984    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:51.717987 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.717994    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:51.718215 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:51.718002    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a11eec7-41ab-4725-999a-9fdb5b427f89-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:31:52.232846 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.232808    2567 generic.go:356] "Generic (PLEG): container finished" podID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerID="fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2" exitCode=0
Jul 23 10:31:52.233040 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.232872    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"
Jul 23 10:31:52.233040 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.232895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" event={"ID":"8a11eec7-41ab-4725-999a-9fdb5b427f89","Type":"ContainerDied","Data":"fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2"}
Jul 23 10:31:52.233040 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.232957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f" event={"ID":"8a11eec7-41ab-4725-999a-9fdb5b427f89","Type":"ContainerDied","Data":"65757166ec02ca206427beda028cd2b1a8a958710bc27968052b65971cab242d"}
Jul 23 10:31:52.233040 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.232986    2567 scope.go:117] "RemoveContainer" containerID="fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2"
Jul 23 10:31:52.242397 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.242381    2567 scope.go:117] "RemoveContainer" containerID="15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b"
Jul 23 10:31:52.250414 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.250397    2567 scope.go:117] "RemoveContainer" containerID="fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2"
Jul 23 10:31:52.250652 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:31:52.250636    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2\": container with ID starting with fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2 not found: ID does not exist" containerID="fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2"
Jul 23 10:31:52.250722 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.250658    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2"} err="failed to get container status \"fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2\": rpc error: code = NotFound desc = could not find container \"fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2\": container with ID starting with fd859449c8d8f9f1fae0c3a1e936b6adf940c190226a4b9c237a318556e9f3b2 not found: ID does not exist"
Jul 23 10:31:52.250722 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.250673    2567 scope.go:117] "RemoveContainer" containerID="15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b"
Jul 23 10:31:52.250921 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:31:52.250904    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b\": container with ID starting with 15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b not found: ID does not exist" containerID="15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b"
Jul 23 10:31:52.250967 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.250927    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b"} err="failed to get container status \"15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b\": rpc error: code = NotFound desc = could not find container \"15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b\": container with ID starting with 15ee05e5717b001170a91b22174f8ffbb704a2ccb3e21a7f05008d4c17acf24b not found: ID does not exist"
Jul 23 10:31:52.257015 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.256995    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"]
Jul 23 10:31:52.261121 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:52.261102    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6fb9c7-openshift-default-7b7fdd8785-mzm4f"]
Jul 23 10:31:54.231056 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:54.231026    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" path="/var/lib/kubelet/pods/8a11eec7-41ab-4725-999a-9fdb5b427f89/volumes"
Jul 23 10:31:55.439632 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.439598    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"]
Jul 23 10:31:55.440541 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.439994    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy"
Jul 23 10:31:55.440541 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.440006    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2bff45d-bd92-411d-91f5-eb40219121f4" containerName="istio-proxy"
Jul 23 10:31:55.440541 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.440030    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy"
Jul 23 10:31:55.440541 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.440035    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy"
Jul 23 10:31:55.440541 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.440042    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy"
Jul 23 10:31:55.440541 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.440049    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy"
Jul 23 10:31:55.440541 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.440107    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy"
Jul 23 10:31:55.440541 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.440117    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a11eec7-41ab-4725-999a-9fdb5b427f89" containerName="istio-proxy"
Jul 23 10:31:55.444328 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.444306    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.447081 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.447064    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2df747-openshift-default-dockercfg-9xc7x\""
Jul 23 10:31:55.456056 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.456037    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"]
Jul 23 10:31:55.554313 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554263    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smkhx\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-kube-api-access-smkhx\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.554503 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-credential-socket\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.554503 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554424    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af217e4-0969-4941-b041-42c724aa13bc-istiod-ca-cert\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.554503 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554470    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-envoy\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.554686 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-data\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.554686 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554565    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-certs\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.554686 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554589    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-istio-token\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.554686 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af217e4-0969-4941-b041-42c724aa13bc-istio-podinfo\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.554863 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.554702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-socket\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656092 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656055    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af217e4-0969-4941-b041-42c724aa13bc-istio-podinfo\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656313 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-socket\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656313 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smkhx\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-kube-api-access-smkhx\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656313 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656211    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-credential-socket\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656313 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af217e4-0969-4941-b041-42c724aa13bc-istiod-ca-cert\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656313 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-envoy\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656594 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-data\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656594 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-certs\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656594 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656389    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-istio-token\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656752 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656669    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-socket\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656899 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-credential-socket\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.656956 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.656907    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-data\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.657126 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.657026    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-certs\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.657432 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.657409    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af217e4-0969-4941-b041-42c724aa13bc-istiod-ca-cert\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.658694 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.658669    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-envoy\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.658869 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.658853    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af217e4-0969-4941-b041-42c724aa13bc-istio-podinfo\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.664200 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.664175    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-istio-token\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.664349 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.664332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smkhx\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-kube-api-access-smkhx\") pod \"e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") " pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.755524 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.755436    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:55.897494 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.897468    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"]
Jul 23 10:31:55.899706 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:31:55.899674    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af217e4_0969_4941_b041_42c724aa13bc.slice/crio-0c5f4c15c46859f7a5f9dc32e79b524488be93242a7ea56935bf8245bb09de5d WatchSource:0}: Error finding container 0c5f4c15c46859f7a5f9dc32e79b524488be93242a7ea56935bf8245bb09de5d: Status 404 returned error can't find the container with id 0c5f4c15c46859f7a5f9dc32e79b524488be93242a7ea56935bf8245bb09de5d
Jul 23 10:31:55.902347 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.902304    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:31:55.902476 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.902389    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:31:55.902476 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:55.902433    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:31:56.255791 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:56.255751    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" event={"ID":"9af217e4-0969-4941-b041-42c724aa13bc","Type":"ContainerStarted","Data":"bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51"}
Jul 23 10:31:56.255988 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:56.255813    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" event={"ID":"9af217e4-0969-4941-b041-42c724aa13bc","Type":"ContainerStarted","Data":"0c5f4c15c46859f7a5f9dc32e79b524488be93242a7ea56935bf8245bb09de5d"}
Jul 23 10:31:56.277876 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:56.277818    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" podStartSLOduration=1.277797467 podStartE2EDuration="1.277797467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:31:56.275263212 +0000 UTC m=+2240.513458456" watchObservedRunningTime="2026-07-23 10:31:56.277797467 +0000 UTC m=+2240.515992722"
Jul 23 10:31:56.756104 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:56.756071    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:56.761114 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:56.761090    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:57.261746 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:57.261662    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:31:57.262672 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:31:57.262652    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:32:05.259368 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:05.259338    2567 patch_prober.go:28] interesting pod/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 10:32:05.260786 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:05.259387    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 10:32:05.303157 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:05.303131    2567 generic.go:356] "Generic (PLEG): container finished" podID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerID="2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a" exitCode=0
Jul 23 10:32:05.303275 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:05.303199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" event={"ID":"0e6fb5b5-71ea-4488-8c48-7881ef3de348","Type":"ContainerDied","Data":"2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a"}
Jul 23 10:32:05.303607 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:05.303592    2567 scope.go:117] "RemoveContainer" containerID="2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a"
Jul 23 10:32:05.304576 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:05.304549    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:32:05.304647 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:05.304635    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:32:05.304683 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:05.304668    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:32:06.313536 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:06.313499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" event={"ID":"0e6fb5b5-71ea-4488-8c48-7881ef3de348","Type":"ContainerStarted","Data":"c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7"}
Jul 23 10:32:06.382307 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:06.382274    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:32:06.382497 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:06.382478    2567 patch_prober.go:28] interesting pod/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 10:32:06.382542 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:06.382523    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 10:32:07.382570 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:07.382543    2567 patch_prober.go:28] interesting pod/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 10:32:07.383018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:07.382992    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 10:32:08.382987 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:08.382950    2567 patch_prober.go:28] interesting pod/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 10:32:08.383402 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:08.383010    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 10:32:09.383333 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:09.383294    2567 patch_prober.go:28] interesting pod/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 10:32:09.383730 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:09.383349    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 10:32:10.386008 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:10.385981    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:32:10.386412 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:10.386354    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:32:10.387079 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:10.387060    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:32:13.303423 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:13.303379    2567 patch_prober.go:28] interesting pod/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 10:32:13.303840 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:13.303449    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 10:32:13.501075 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:32:13.501044    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@10-24204-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af217e4_0969_4941_b041_42c724aa13bc.slice/crio-bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51.scope\": RecentStats: unable to find data in memory cache]"
Jul 23 10:32:14.364875 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:14.364838    2567 generic.go:356] "Generic (PLEG): container finished" podID="9af217e4-0969-4941-b041-42c724aa13bc" containerID="bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51" exitCode=0
Jul 23 10:32:14.365274 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:14.364912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" event={"ID":"9af217e4-0969-4941-b041-42c724aa13bc","Type":"ContainerDied","Data":"bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51"}
Jul 23 10:32:14.365352 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:14.365338    2567 scope.go:117] "RemoveContainer" containerID="bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51"
Jul 23 10:32:14.366366 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:14.366341    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:32:14.366425 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:14.366403    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:32:14.366471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:14.366432    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:32:15.372050 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:15.372018    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" event={"ID":"9af217e4-0969-4941-b041-42c724aa13bc","Type":"ContainerStarted","Data":"f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a"}
Jul 23 10:32:15.756579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:15.756480    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:32:15.756731 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:15.756684    2567 patch_prober.go:28] interesting pod/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 23 10:32:15.756773 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:15.756734    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 23 10:32:16.756076 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:16.756038    2567 patch_prober.go:28] interesting pod/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 23 10:32:16.756531 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:16.756109    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 23 10:32:17.756492 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:17.756456    2567 patch_prober.go:28] interesting pod/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 23 10:32:17.756905 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:17.756514    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 23 10:32:18.756697 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:18.756657    2567 patch_prober.go:28] interesting pod/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 23 10:32:18.757115 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:18.756729    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 23 10:32:19.759310 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:19.759281    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:32:19.759747 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:19.759689    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:32:19.760497 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:19.760452    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:32:36.493480 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:36.493452    2567 scope.go:117] "RemoveContainer" containerID="45deaab000515bd6d8ae02a5ca642a6d1b3539b8e284a897fc9ec4b8fdb5a405"
Jul 23 10:32:37.536304 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:37.536264    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"]
Jul 23 10:32:37.536793 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:37.536479    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy" containerID="cri-o://c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7" gracePeriod=30
Jul 23 10:32:40.388991 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:40.388952    2567 patch_prober.go:28] interesting pod/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 10:32:40.389430 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:40.389022    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 10:32:42.798916 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.798853    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:32:42.824421 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824391    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-socket\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.824595 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824434    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-certs\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.824595 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824457    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-data\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.824595 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824490    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-podinfo\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.824595 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824528    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-credential-socket\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.824808 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824682    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:32:42.824808 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824700    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-token\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.824808 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824763    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:32:42.824808 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824765    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-envoy\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.825027 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824863    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istiod-ca-cert\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.825027 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.824906    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2z75\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-kube-api-access-t2z75\") pod \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\" (UID: \"0e6fb5b5-71ea-4488-8c48-7881ef3de348\") "
Jul 23 10:32:42.825172 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.825148    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:32:42.825274 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.825193    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:32:42.825342 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.825269    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:42.825342 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.825286    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:42.825342 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.825300    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:42.825999 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.825936    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:32:42.827484 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.827455    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:32:42.827636 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.827607    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:32:42.827864 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.827841    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:32:42.827969 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.827927    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-kube-api-access-t2z75" (OuterVolumeSpecName: "kube-api-access-t2z75") pod "0e6fb5b5-71ea-4488-8c48-7881ef3de348" (UID: "0e6fb5b5-71ea-4488-8c48-7881ef3de348"). InnerVolumeSpecName "kube-api-access-t2z75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:32:42.926118 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.926089    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:42.926118 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.926116    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2z75\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-kube-api-access-t2z75\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:42.926118 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.926125    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:42.926118 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.926133    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:42.926495 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.926141    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:42.926495 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:42.926149    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e6fb5b5-71ea-4488-8c48-7881ef3de348-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:32:43.523846 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.523816    2567 generic.go:356] "Generic (PLEG): container finished" podID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerID="c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7" exitCode=0
Jul 23 10:32:43.524020 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.523866    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"
Jul 23 10:32:43.524020 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.523902    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" event={"ID":"0e6fb5b5-71ea-4488-8c48-7881ef3de348","Type":"ContainerDied","Data":"c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7"}
Jul 23 10:32:43.524020 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.523952    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt" event={"ID":"0e6fb5b5-71ea-4488-8c48-7881ef3de348","Type":"ContainerDied","Data":"86fd00594281af0ed897ca9ead8274ca2f9a53b3343da89b184853e8bcd4cd27"}
Jul 23 10:32:43.524020 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.523974    2567 scope.go:117] "RemoveContainer" containerID="c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7"
Jul 23 10:32:43.533643 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.533624    2567 scope.go:117] "RemoveContainer" containerID="2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a"
Jul 23 10:32:43.541924 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.541905    2567 scope.go:117] "RemoveContainer" containerID="c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7"
Jul 23 10:32:43.542176 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:32:43.542158    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7\": container with ID starting with c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7 not found: ID does not exist" containerID="c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7"
Jul 23 10:32:43.542277 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.542185    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7"} err="failed to get container status \"c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7\": rpc error: code = NotFound desc = could not find container \"c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7\": container with ID starting with c4d204aeca99947f798126ec8eee1a88298910ba62bab36a71f8516c137667c7 not found: ID does not exist"
Jul 23 10:32:43.542277 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.542201    2567 scope.go:117] "RemoveContainer" containerID="2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a"
Jul 23 10:32:43.542468 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:32:43.542451    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a\": container with ID starting with 2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a not found: ID does not exist" containerID="2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a"
Jul 23 10:32:43.542507 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.542475    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a"} err="failed to get container status \"2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a\": rpc error: code = NotFound desc = could not find container \"2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a\": container with ID starting with 2e470c296b2390b3e41ff8f626d1f5fde4bd68b33b415739a2f55920cefaf19a not found: ID does not exist"
Jul 23 10:32:43.546834 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.546812    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"]
Jul 23 10:32:43.551280 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:43.551228    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b4fbcc-openshift-default-67b9866f6c-tldvt"]
Jul 23 10:32:44.232508 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:32:44.232478    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" path="/var/lib/kubelet/pods/0e6fb5b5-71ea-4488-8c48-7881ef3de348/volumes"
Jul 23 10:33:04.325582 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:04.325542    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"]
Jul 23 10:33:04.326029 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:04.325784    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy" containerID="cri-o://f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a" gracePeriod=30
Jul 23 10:33:04.762052 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:04.761996    2567 patch_prober.go:28] interesting pod/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 23 10:33:04.762209 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:04.762093    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 10:33:05.224441 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.224403    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"]
Jul 23 10:33:05.224831 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.224818    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy"
Jul 23 10:33:05.224907 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.224834    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy"
Jul 23 10:33:05.224954 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.224915    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy"
Jul 23 10:33:05.224954 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.224926    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy"
Jul 23 10:33:05.228485 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.228454    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.231405 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.231382    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d0ac3e-openshift-default-dockercfg-728hp\""
Jul 23 10:33:05.240383 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.240357    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"]
Jul 23 10:33:05.343470 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343423    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-istio-token\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.343946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64db815f-c171-42e7-ac37-3ca616c3537a-istio-podinfo\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.343946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rtx\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-kube-api-access-d6rtx\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.343946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-envoy\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.343946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343589    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-data\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.343946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343618    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-socket\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.343946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64db815f-c171-42e7-ac37-3ca616c3537a-istiod-ca-cert\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.343946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343673    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-certs\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.343946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.343712    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-credential-socket\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444342 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-istio-token\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444536 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444364    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64db815f-c171-42e7-ac37-3ca616c3537a-istio-podinfo\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444594 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rtx\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-kube-api-access-d6rtx\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444594 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-envoy\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444707 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444603    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-data\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444707 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-socket\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444707 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64db815f-c171-42e7-ac37-3ca616c3537a-istiod-ca-cert\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444707 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-certs\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.444905 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-credential-socket\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.445005 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.444980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-data\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.445118 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.445094    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-socket\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.445178 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.445120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-certs\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.445230 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.445201    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-credential-socket\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.445782 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.445760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64db815f-c171-42e7-ac37-3ca616c3537a-istiod-ca-cert\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.446931 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.446911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64db815f-c171-42e7-ac37-3ca616c3537a-istio-podinfo\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.447013 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.446996    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-envoy\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.452905 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.452883    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-istio-token\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.453075 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.453053    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rtx\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-kube-api-access-d6rtx\") pod \"e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") " pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.539723 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.539631    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:05.685177 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.685148    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"]
Jul 23 10:33:05.687285 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:33:05.687225    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64db815f_c171_42e7_ac37_3ca616c3537a.slice/crio-7162c62522999e076499bb7e588168aa314bfec13639d05af607a040bfd72c91 WatchSource:0}: Error finding container 7162c62522999e076499bb7e588168aa314bfec13639d05af607a040bfd72c91: Status 404 returned error can't find the container with id 7162c62522999e076499bb7e588168aa314bfec13639d05af607a040bfd72c91
Jul 23 10:33:05.689368 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.689338    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:05.689460 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.689403    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:05.689460 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:05.689430    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:06.643307 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:06.643277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" event={"ID":"64db815f-c171-42e7-ac37-3ca616c3537a","Type":"ContainerStarted","Data":"b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e"}
Jul 23 10:33:06.643679 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:06.643330    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" event={"ID":"64db815f-c171-42e7-ac37-3ca616c3537a","Type":"ContainerStarted","Data":"7162c62522999e076499bb7e588168aa314bfec13639d05af607a040bfd72c91"}
Jul 23 10:33:06.666324 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:06.666283    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" podStartSLOduration=1.666266261 podStartE2EDuration="1.666266261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:33:06.665348444 +0000 UTC m=+2310.903543695" watchObservedRunningTime="2026-07-23 10:33:06.666266261 +0000 UTC m=+2310.904461512"
Jul 23 10:33:07.540840 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:07.540810    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:07.546326 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:07.546301    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:07.648789 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:07.648762    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:07.649894 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:07.649873    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:09.579513 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.579480    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:33:09.659955 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.659920    2567 generic.go:356] "Generic (PLEG): container finished" podID="9af217e4-0969-4941-b041-42c724aa13bc" containerID="f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a" exitCode=0
Jul 23 10:33:09.660149 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.659966    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"
Jul 23 10:33:09.660149 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.660008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" event={"ID":"9af217e4-0969-4941-b041-42c724aa13bc","Type":"ContainerDied","Data":"f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a"}
Jul 23 10:33:09.660149 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.660062    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf" event={"ID":"9af217e4-0969-4941-b041-42c724aa13bc","Type":"ContainerDied","Data":"0c5f4c15c46859f7a5f9dc32e79b524488be93242a7ea56935bf8245bb09de5d"}
Jul 23 10:33:09.660149 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.660091    2567 scope.go:117] "RemoveContainer" containerID="f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a"
Jul 23 10:33:09.668964 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.668946    2567 scope.go:117] "RemoveContainer" containerID="bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51"
Jul 23 10:33:09.676735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.676705    2567 scope.go:117] "RemoveContainer" containerID="f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a"
Jul 23 10:33:09.676980 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:33:09.676962    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a\": container with ID starting with f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a not found: ID does not exist" containerID="f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a"
Jul 23 10:33:09.677041 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.676990    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a"} err="failed to get container status \"f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a\": rpc error: code = NotFound desc = could not find container \"f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a\": container with ID starting with f15d90e3c83fc39c4d9dae8787e020ffb999f48d91ac449cf509af703624316a not found: ID does not exist"
Jul 23 10:33:09.677041 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.677007    2567 scope.go:117] "RemoveContainer" containerID="bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51"
Jul 23 10:33:09.677260 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:33:09.677223    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51\": container with ID starting with bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51 not found: ID does not exist" containerID="bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51"
Jul 23 10:33:09.677313 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.677264    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51"} err="failed to get container status \"bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51\": rpc error: code = NotFound desc = could not find container \"bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51\": container with ID starting with bf7440cad8d9ae2e3ae49baa3712055b441cf09d9f6aac25f8cd6076715b7c51 not found: ID does not exist"
Jul 23 10:33:09.687334 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687314    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af217e4-0969-4941-b041-42c724aa13bc-istio-podinfo\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687413 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687368    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-credential-socket\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687413 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687399    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-socket\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687497 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687430    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af217e4-0969-4941-b041-42c724aa13bc-istiod-ca-cert\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687497 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687468    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-data\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687602 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687498    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-certs\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687602 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687569    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-envoy\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687696 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687610    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-istio-token\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687696 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687642    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smkhx\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-kube-api-access-smkhx\") pod \"9af217e4-0969-4941-b041-42c724aa13bc\" (UID: \"9af217e4-0969-4941-b041-42c724aa13bc\") "
Jul 23 10:33:09.687798 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687727    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:33:09.687798 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687732    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:33:09.687910 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687806    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af217e4-0969-4941-b041-42c724aa13bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:33:09.687910 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.687901    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:33:09.688132 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.688101    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.688207 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.688131    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.688207 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.688154    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af217e4-0969-4941-b041-42c724aa13bc-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.688207 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.688169    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.688729 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.688705    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:33:09.689647 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.689622    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9af217e4-0969-4941-b041-42c724aa13bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:33:09.689916 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.689887    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:33:09.690001 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.689947    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-kube-api-access-smkhx" (OuterVolumeSpecName: "kube-api-access-smkhx") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "kube-api-access-smkhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:33:09.690087 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.690071    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9af217e4-0969-4941-b041-42c724aa13bc" (UID: "9af217e4-0969-4941-b041-42c724aa13bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:33:09.789229 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.789196    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.789229 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.789224    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.789467 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.789265    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smkhx\" (UniqueName: \"kubernetes.io/projected/9af217e4-0969-4941-b041-42c724aa13bc-kube-api-access-smkhx\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.789467 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.789279    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af217e4-0969-4941-b041-42c724aa13bc-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.789467 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.789292    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af217e4-0969-4941-b041-42c724aa13bc-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:33:09.984631 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.984596    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"]
Jul 23 10:33:09.991463 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:09.991439    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2df747-openshift-default-758f85f45c-2fjbf"]
Jul 23 10:33:10.233024 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:10.232947    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9af217e4-0969-4941-b041-42c724aa13bc" path="/var/lib/kubelet/pods/9af217e4-0969-4941-b041-42c724aa13bc/volumes"
Jul 23 10:33:13.856364 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856328    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"]
Jul 23 10:33:13.856738 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856688    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy"
Jul 23 10:33:13.856738 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856698    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6fb5b5-71ea-4488-8c48-7881ef3de348" containerName="istio-proxy"
Jul 23 10:33:13.856738 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856709    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy"
Jul 23 10:33:13.856738 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856714    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy"
Jul 23 10:33:13.856738 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856726    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy"
Jul 23 10:33:13.856738 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856732    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy"
Jul 23 10:33:13.856931 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856790    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy"
Jul 23 10:33:13.856931 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.856799    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af217e4-0969-4941-b041-42c724aa13bc" containerName="istio-proxy"
Jul 23 10:33:13.859105 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.859089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.862041 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.862021    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-bc0d57-openshift-default-dockercfg-kbwpl\""
Jul 23 10:33:13.875580 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.875560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"]
Jul 23 10:33:13.931611 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.931563    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-socket\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.931799 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.931627    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-data\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.931799 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.931667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-token\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.931799 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.931693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ktt\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-kube-api-access-r4ktt\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.932055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.931797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-podinfo\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.932055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.931851    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-credential-socket\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.932055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.931885    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-envoy\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.932055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.931938    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-certs\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:13.932055 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:13.932022    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28ce714-0cc9-472a-aacd-be337afa70f7-istiod-ca-cert\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032463 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-credential-socket\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032463 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-envoy\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032494    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-certs\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28ce714-0cc9-472a-aacd-be337afa70f7-istiod-ca-cert\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032580    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-socket\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-data\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032651    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-token\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ktt\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-kube-api-access-r4ktt\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.032735 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-podinfo\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.033090 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032890    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-credential-socket\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.033090 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.032950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-certs\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.033190 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.033131    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-data\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.033287 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.033262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-socket\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.033410 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.033390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28ce714-0cc9-472a-aacd-be337afa70f7-istiod-ca-cert\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.035697 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.035678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-envoy\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.035902 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.035885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-podinfo\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.041862 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.041838    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-token\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.041961 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.041944    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ktt\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-kube-api-access-r4ktt\") pod \"e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") " pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.169602 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.169497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:14.331016 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.330984    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"]
Jul 23 10:33:14.333021 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:33:14.332995    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28ce714_0cc9_472a_aacd_be337afa70f7.slice/crio-2e038fc8a01d185c2c27d108ae8472630dc83deeb11ce711889fe82853ddfd8c WatchSource:0}: Error finding container 2e038fc8a01d185c2c27d108ae8472630dc83deeb11ce711889fe82853ddfd8c: Status 404 returned error can't find the container with id 2e038fc8a01d185c2c27d108ae8472630dc83deeb11ce711889fe82853ddfd8c
Jul 23 10:33:14.335172 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.335138    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:14.335271 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.335204    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:14.335271 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.335262    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:14.689943 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.689904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" event={"ID":"b28ce714-0cc9-472a-aacd-be337afa70f7","Type":"ContainerStarted","Data":"3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3"}
Jul 23 10:33:14.690109 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.689969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" event={"ID":"b28ce714-0cc9-472a-aacd-be337afa70f7","Type":"ContainerStarted","Data":"2e038fc8a01d185c2c27d108ae8472630dc83deeb11ce711889fe82853ddfd8c"}
Jul 23 10:33:14.711109 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:14.711058    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" podStartSLOduration=1.7110411920000002 podStartE2EDuration="1.711041192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:33:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:33:14.709722272 +0000 UTC m=+2318.947917551" watchObservedRunningTime="2026-07-23 10:33:14.711041192 +0000 UTC m=+2318.949236443"
Jul 23 10:33:15.170718 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:15.170680    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:15.175639 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:15.175614    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:15.695818 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:15.695787    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:15.696820 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:15.696802    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:23.690421 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:23.690382    2567 patch_prober.go:28] interesting pod/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 10:33:23.690898 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:23.690478    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 10:33:25.753557 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:25.753462    2567 generic.go:356] "Generic (PLEG): container finished" podID="64db815f-c171-42e7-ac37-3ca616c3537a" containerID="b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e" exitCode=0
Jul 23 10:33:25.753557 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:25.753535    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" event={"ID":"64db815f-c171-42e7-ac37-3ca616c3537a","Type":"ContainerDied","Data":"b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e"}
Jul 23 10:33:25.754078 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:25.753978    2567 scope.go:117] "RemoveContainer" containerID="b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e"
Jul 23 10:33:25.755046 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:25.755019    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:25.755111 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:25.755100    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:25.755172 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:25.755157    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:26.760596 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:26.760564    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" event={"ID":"64db815f-c171-42e7-ac37-3ca616c3537a","Type":"ContainerStarted","Data":"84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640"}
Jul 23 10:33:27.540339 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:27.540250    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:27.540727 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:27.540637    2567 patch_prober.go:28] interesting pod/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 10:33:27.540898 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:27.540873    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 10:33:28.542690 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:28.542653    2567 patch_prober.go:28] interesting pod/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 10:33:28.543285 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:28.543252    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 10:33:29.540719 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:29.540683    2567 patch_prober.go:28] interesting pod/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 10:33:29.540915 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:29.540742    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 10:33:30.540108 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:30.540060    2567 patch_prober.go:28] interesting pod/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 10:33:30.540528 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:30.540145    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 10:33:31.543382 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:31.543352    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:31.543848 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:31.543738    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:31.544386 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:31.544366    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:33:31.738348 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:31.738315    2567 patch_prober.go:28] interesting pod/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 10:33:31.738523 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:31.738362    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 10:33:32.793657 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:32.793623    2567 generic.go:356] "Generic (PLEG): container finished" podID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerID="3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3" exitCode=0
Jul 23 10:33:32.794200 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:32.793696    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" event={"ID":"b28ce714-0cc9-472a-aacd-be337afa70f7","Type":"ContainerDied","Data":"3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3"}
Jul 23 10:33:32.794200 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:32.794189    2567 scope.go:117] "RemoveContainer" containerID="3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3"
Jul 23 10:33:32.795264 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:32.795219    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:32.795380 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:32.795315    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:32.795380 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:32.795366    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 23 10:33:33.801186 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:33.801154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" event={"ID":"b28ce714-0cc9-472a-aacd-be337afa70f7","Type":"ContainerStarted","Data":"77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e"}
Jul 23 10:33:34.169728 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:34.169687    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:34.169938 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:34.169917    2567 patch_prober.go:28] interesting pod/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 10:33:34.169996 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:34.169976    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 10:33:35.170484 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:35.170449    2567 patch_prober.go:28] interesting pod/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 10:33:35.170921 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:35.170511    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 10:33:36.169847 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:36.169816    2567 patch_prober.go:28] interesting pod/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 10:33:36.170009 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:36.169875    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 10:33:36.518552 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:36.518452    2567 scope.go:117] "RemoveContainer" containerID="232c57c896c9fe11ca5460696813ebde6541c5f85c27ce31a2d02bd46242e479"
Jul 23 10:33:37.170213 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:37.170179    2567 patch_prober.go:28] interesting pod/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 10:33:37.170427 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:37.170231    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 10:33:38.173249 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:38.173212    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:38.173716 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:38.173690    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:33:38.174333 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:33:38.174314    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:34:28.792788 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.792757    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"]
Jul 23 10:34:28.796021 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.795997    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:28.799502 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.799476    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"default-dockercfg-npscq\""
Jul 23 10:34:28.800612 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.800591    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"kube-root-ca.crt\""
Jul 23 10:34:28.800756 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.800615    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"openshift-service-ca.crt\""
Jul 23 10:34:28.800980 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.800963    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"auth-test-model-bc0d57-kserve-self-signed-certs\""
Jul 23 10:34:28.817813 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.817787    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"]
Jul 23 10:34:28.961260 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.961207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-home\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:28.961441 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.961304    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qftk9\" (UniqueName: \"kubernetes.io/projected/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-kube-api-access-qftk9\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:28.961441 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.961365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tls-certs\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:28.961441 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.961407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tmp-dir\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:28.961441 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.961430    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-dshm\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:28.961573 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:28.961462    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-model-cache\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.062187    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tls-certs\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.062284    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tmp-dir\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.062313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-dshm\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.062339    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-model-cache\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.062446    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-home\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.062496    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qftk9\" (UniqueName: \"kubernetes.io/projected/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-kube-api-access-qftk9\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.063476    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tmp-dir\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.063512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-model-cache\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.063779    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-home\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.065471 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.065437    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-dshm\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.066123 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.065958    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tls-certs\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.075827 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.073085    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qftk9\" (UniqueName: \"kubernetes.io/projected/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-kube-api-access-qftk9\") pod \"auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") " pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.106363 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.106327    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:29.241094 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:29.241071    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"]
Jul 23 10:34:29.243929 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:34:29.243900    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a90f1ab_0998_4f80_be7e_c5801ec32aa5.slice/crio-948e0e700c6367fafe1da43b556d92a33558f2d9c772d693f05ad530e59455b0 WatchSource:0}: Error finding container 948e0e700c6367fafe1da43b556d92a33558f2d9c772d693f05ad530e59455b0: Status 404 returned error can't find the container with id 948e0e700c6367fafe1da43b556d92a33558f2d9c772d693f05ad530e59455b0
Jul 23 10:34:30.095563 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:30.095527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s" event={"ID":"2a90f1ab-0998-4f80-be7e-c5801ec32aa5","Type":"ContainerStarted","Data":"f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129"}
Jul 23 10:34:30.095963 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:30.095570    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s" event={"ID":"2a90f1ab-0998-4f80-be7e-c5801ec32aa5","Type":"ContainerStarted","Data":"948e0e700c6367fafe1da43b556d92a33558f2d9c772d693f05ad530e59455b0"}
Jul 23 10:34:30.116412 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:30.116364    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s" podStartSLOduration=2.116348686 podStartE2EDuration="2.116348686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:34:30.114367572 +0000 UTC m=+2394.352562853" watchObservedRunningTime="2026-07-23 10:34:30.116348686 +0000 UTC m=+2394.354543935"
Jul 23 10:34:36.380094 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:36.380072    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:34:36.392311 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:36.392288    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:34:39.106924 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:39.106886    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:39.106924 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:39.106934    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:39.119370 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:39.119342    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:34:39.150908 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:34:39.150873    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:36:18.707171 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:18.707137    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"]
Jul 23 10:36:33.728078 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:33.728017    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s" podUID="2a90f1ab-0998-4f80-be7e-c5801ec32aa5" containerName="main" containerID="cri-o://f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129" gracePeriod=45
Jul 23 10:36:33.972614 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:33.972584    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:36:34.077932 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.077843    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-dshm\") pod \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") "
Jul 23 10:36:34.077932 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.077885    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qftk9\" (UniqueName: \"kubernetes.io/projected/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-kube-api-access-qftk9\") pod \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") "
Jul 23 10:36:34.078168 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.077967    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tmp-dir\") pod \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") "
Jul 23 10:36:34.078168 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.077992    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tls-certs\") pod \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") "
Jul 23 10:36:34.078168 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.078025    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-model-cache\") pod \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") "
Jul 23 10:36:34.078168 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.078075    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-home\") pod \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\" (UID: \"2a90f1ab-0998-4f80-be7e-c5801ec32aa5\") "
Jul 23 10:36:34.078419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.078255    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a90f1ab-0998-4f80-be7e-c5801ec32aa5" (UID: "2a90f1ab-0998-4f80-be7e-c5801ec32aa5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:36:34.078419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.078300    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a90f1ab-0998-4f80-be7e-c5801ec32aa5" (UID: "2a90f1ab-0998-4f80-be7e-c5801ec32aa5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:36:34.078419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.078360    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tmp-dir\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:36:34.078529 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.078432    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-home" (OuterVolumeSpecName: "home") pod "2a90f1ab-0998-4f80-be7e-c5801ec32aa5" (UID: "2a90f1ab-0998-4f80-be7e-c5801ec32aa5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:36:34.080325 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.080302    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-dshm" (OuterVolumeSpecName: "dshm") pod "2a90f1ab-0998-4f80-be7e-c5801ec32aa5" (UID: "2a90f1ab-0998-4f80-be7e-c5801ec32aa5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:36:34.080388 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.080360    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a90f1ab-0998-4f80-be7e-c5801ec32aa5" (UID: "2a90f1ab-0998-4f80-be7e-c5801ec32aa5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:36:34.080425 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.080401    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-kube-api-access-qftk9" (OuterVolumeSpecName: "kube-api-access-qftk9") pod "2a90f1ab-0998-4f80-be7e-c5801ec32aa5" (UID: "2a90f1ab-0998-4f80-be7e-c5801ec32aa5"). InnerVolumeSpecName "kube-api-access-qftk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:36:34.179148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.179112    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-tls-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:36:34.179148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.179143    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-model-cache\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:36:34.179148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.179152    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-home\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:36:34.179148 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.179160    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-dshm\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:36:34.179454 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.179169    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qftk9\" (UniqueName: \"kubernetes.io/projected/2a90f1ab-0998-4f80-be7e-c5801ec32aa5-kube-api-access-qftk9\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:36:34.719261 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.719207    2567 generic.go:356] "Generic (PLEG): container finished" podID="2a90f1ab-0998-4f80-be7e-c5801ec32aa5" containerID="f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129" exitCode=0
Jul 23 10:36:34.719479 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.719288    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"
Jul 23 10:36:34.719479 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.719301    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s" event={"ID":"2a90f1ab-0998-4f80-be7e-c5801ec32aa5","Type":"ContainerDied","Data":"f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129"}
Jul 23 10:36:34.719479 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.719354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s" event={"ID":"2a90f1ab-0998-4f80-be7e-c5801ec32aa5","Type":"ContainerDied","Data":"948e0e700c6367fafe1da43b556d92a33558f2d9c772d693f05ad530e59455b0"}
Jul 23 10:36:34.719479 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.719375    2567 scope.go:117] "RemoveContainer" containerID="f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129"
Jul 23 10:36:34.728018 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.728006    2567 scope.go:117] "RemoveContainer" containerID="f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129"
Jul 23 10:36:34.728296 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:36:34.728275    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129\": container with ID starting with f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129 not found: ID does not exist" containerID="f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129"
Jul 23 10:36:34.728568 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.728309    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129"} err="failed to get container status \"f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129\": rpc error: code = NotFound desc = could not find container \"f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129\": container with ID starting with f39a9137ed1aad39fbcc24845361c9d66719bd48238772f1b8a8946b6a817129 not found: ID does not exist"
Jul 23 10:36:34.736855 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.736834    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"]
Jul 23 10:36:34.740386 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:34.740365    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/auth-test-model-bc0d57-kserve-78dbfb74ff-lnb4s"]
Jul 23 10:36:36.232130 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:36.232102    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a90f1ab-0998-4f80-be7e-c5801ec32aa5" path="/var/lib/kubelet/pods/2a90f1ab-0998-4f80-be7e-c5801ec32aa5/volumes"
Jul 23 10:36:36.564566 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:36.564481    2567 scope.go:117] "RemoveContainer" containerID="008cc1878f6b347d6ea3b19b32b853db464610fe9d869205231d67e4c735c63a"
Jul 23 10:36:36.573087 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:36:36.573067    2567 scope.go:117] "RemoveContainer" containerID="aae603d4125246fff26bdfbcb7e3dcf5d779c17d049e9f4b89a33fec730d9d99"
Jul 23 10:37:08.087286 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.087229    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"]
Jul 23 10:37:08.087755 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.087686    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a90f1ab-0998-4f80-be7e-c5801ec32aa5" containerName="main"
Jul 23 10:37:08.087755 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.087698    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a90f1ab-0998-4f80-be7e-c5801ec32aa5" containerName="main"
Jul 23 10:37:08.087755 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.087754    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a90f1ab-0998-4f80-be7e-c5801ec32aa5" containerName="main"
Jul 23 10:37:08.090835 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.090817    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.097320 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.097287    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"kube-root-ca.crt\""
Jul 23 10:37:08.097395 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.097379    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"openshift-service-ca.crt\""
Jul 23 10:37:08.097450 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.097405    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"default-dockercfg-npscq\""
Jul 23 10:37:08.097450 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.097409    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"sub-test-model-bc0d57-kserve-self-signed-certs\""
Jul 23 10:37:08.098967 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.098948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tmp-dir\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.099053 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.099034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-home\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.099095 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.099075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tls-certs\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.099201 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.099186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-model-cache\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.099276 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.099214    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-dshm\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.099326 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.099272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llvz8\" (UniqueName: \"kubernetes.io/projected/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-kube-api-access-llvz8\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.106278 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.106225    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"]
Jul 23 10:37:08.200225 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tmp-dir\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.200422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-home\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.200422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200285    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tls-certs\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.200422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-model-cache\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.200422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-dshm\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.200422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200393    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llvz8\" (UniqueName: \"kubernetes.io/projected/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-kube-api-access-llvz8\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.200672 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200630    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tmp-dir\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.200672 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-home\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.200806 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.200719    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-model-cache\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.202703 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.202679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-dshm\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.202882 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.202866    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tls-certs\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.214565 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.214538    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llvz8\" (UniqueName: \"kubernetes.io/projected/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-kube-api-access-llvz8\") pod \"sub-test-model-bc0d57-kserve-6fd984557c-z2f97\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") " pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.399562 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.399512    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:08.534405 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.534378    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"]
Jul 23 10:37:08.536504 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:37:08.536470    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28d5eae5_5fe7_4ea8_9447_8b983d9401d0.slice/crio-04aa3004aec7df80025455f2bda0e1fb185675c7dba9205f92e9e75e3dbbceca WatchSource:0}: Error finding container 04aa3004aec7df80025455f2bda0e1fb185675c7dba9205f92e9e75e3dbbceca: Status 404 returned error can't find the container with id 04aa3004aec7df80025455f2bda0e1fb185675c7dba9205f92e9e75e3dbbceca
Jul 23 10:37:08.889045 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.889016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97" event={"ID":"28d5eae5-5fe7-4ea8-9447-8b983d9401d0","Type":"ContainerStarted","Data":"4bb351b5b8f6c12bebf9dfd6b31bf98280472668d1a8363344917c8d0d4a5cea"}
Jul 23 10:37:08.889264 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.889054    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97" event={"ID":"28d5eae5-5fe7-4ea8-9447-8b983d9401d0","Type":"ContainerStarted","Data":"04aa3004aec7df80025455f2bda0e1fb185675c7dba9205f92e9e75e3dbbceca"}
Jul 23 10:37:08.909139 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:08.909092    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97" podStartSLOduration=0.909076093 podStartE2EDuration="909.076093ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:37:08.907891907 +0000 UTC m=+2553.146087195" watchObservedRunningTime="2026-07-23 10:37:08.909076093 +0000 UTC m=+2553.147271345"
Jul 23 10:37:18.400574 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:18.400537    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:18.400574 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:18.400582    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:18.413366 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:18.413336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:18.951276 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:18.951221    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:43.955447 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:43.955418    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"]
Jul 23 10:37:58.975905 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:58.975811    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97" podUID="28d5eae5-5fe7-4ea8-9447-8b983d9401d0" containerName="main" containerID="cri-o://4bb351b5b8f6c12bebf9dfd6b31bf98280472668d1a8363344917c8d0d4a5cea" gracePeriod=45
Jul 23 10:37:59.150211 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.150183    2567 generic.go:356] "Generic (PLEG): container finished" podID="28d5eae5-5fe7-4ea8-9447-8b983d9401d0" containerID="4bb351b5b8f6c12bebf9dfd6b31bf98280472668d1a8363344917c8d0d4a5cea" exitCode=0
Jul 23 10:37:59.150367 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.150223    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97" event={"ID":"28d5eae5-5fe7-4ea8-9447-8b983d9401d0","Type":"ContainerDied","Data":"4bb351b5b8f6c12bebf9dfd6b31bf98280472668d1a8363344917c8d0d4a5cea"}
Jul 23 10:37:59.228796 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.228738    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:37:59.277098 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277068    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-model-cache\") pod \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") "
Jul 23 10:37:59.277291 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277123    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-home\") pod \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") "
Jul 23 10:37:59.277291 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277185    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-dshm\") pod \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") "
Jul 23 10:37:59.277422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277317    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llvz8\" (UniqueName: \"kubernetes.io/projected/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-kube-api-access-llvz8\") pod \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") "
Jul 23 10:37:59.277422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277349    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tls-certs\") pod \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") "
Jul 23 10:37:59.277422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277374    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-home" (OuterVolumeSpecName: "home") pod "28d5eae5-5fe7-4ea8-9447-8b983d9401d0" (UID: "28d5eae5-5fe7-4ea8-9447-8b983d9401d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:37:59.277422 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277392    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tmp-dir\") pod \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\" (UID: \"28d5eae5-5fe7-4ea8-9447-8b983d9401d0\") "
Jul 23 10:37:59.277629 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277388    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "28d5eae5-5fe7-4ea8-9447-8b983d9401d0" (UID: "28d5eae5-5fe7-4ea8-9447-8b983d9401d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:37:59.277692 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277638    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28d5eae5-5fe7-4ea8-9447-8b983d9401d0" (UID: "28d5eae5-5fe7-4ea8-9447-8b983d9401d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:37:59.277750 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277706    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-model-cache\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:37:59.277750 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.277723    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-home\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:37:59.279544 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.279514    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-dshm" (OuterVolumeSpecName: "dshm") pod "28d5eae5-5fe7-4ea8-9447-8b983d9401d0" (UID: "28d5eae5-5fe7-4ea8-9447-8b983d9401d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:37:59.279654 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.279552    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-kube-api-access-llvz8" (OuterVolumeSpecName: "kube-api-access-llvz8") pod "28d5eae5-5fe7-4ea8-9447-8b983d9401d0" (UID: "28d5eae5-5fe7-4ea8-9447-8b983d9401d0"). InnerVolumeSpecName "kube-api-access-llvz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:37:59.279654 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.279576    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28d5eae5-5fe7-4ea8-9447-8b983d9401d0" (UID: "28d5eae5-5fe7-4ea8-9447-8b983d9401d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:37:59.378417 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.378379    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-dshm\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:37:59.378417 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.378411    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llvz8\" (UniqueName: \"kubernetes.io/projected/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-kube-api-access-llvz8\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:37:59.378417 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.378424    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tls-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:37:59.378643 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:37:59.378460    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28d5eae5-5fe7-4ea8-9447-8b983d9401d0-tmp-dir\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:38:00.157850 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:00.157815    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"
Jul 23 10:38:00.157850 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:00.157833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97" event={"ID":"28d5eae5-5fe7-4ea8-9447-8b983d9401d0","Type":"ContainerDied","Data":"04aa3004aec7df80025455f2bda0e1fb185675c7dba9205f92e9e75e3dbbceca"}
Jul 23 10:38:00.158406 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:00.157887    2567 scope.go:117] "RemoveContainer" containerID="4bb351b5b8f6c12bebf9dfd6b31bf98280472668d1a8363344917c8d0d4a5cea"
Jul 23 10:38:00.180712 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:00.180682    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"]
Jul 23 10:38:00.186757 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:00.186736    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/sub-test-model-bc0d57-kserve-6fd984557c-z2f97"]
Jul 23 10:38:00.232595 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:00.232562    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28d5eae5-5fe7-4ea8-9447-8b983d9401d0" path="/var/lib/kubelet/pods/28d5eae5-5fe7-4ea8-9447-8b983d9401d0/volumes"
Jul 23 10:38:12.290973 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.290940    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"]
Jul 23 10:38:12.291391 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.291329    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28d5eae5-5fe7-4ea8-9447-8b983d9401d0" containerName="main"
Jul 23 10:38:12.291391 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.291340    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="28d5eae5-5fe7-4ea8-9447-8b983d9401d0" containerName="main"
Jul 23 10:38:12.291479 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.291412    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="28d5eae5-5fe7-4ea8-9447-8b983d9401d0" containerName="main"
Jul 23 10:38:12.294394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.294377    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.297084 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.297061    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"openshift-service-ca.crt\""
Jul 23 10:38:12.297205 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.297114    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"default-dockercfg-npscq\""
Jul 23 10:38:12.298401 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.298380    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"rate-test-model-bc0d57-kserve-self-signed-certs\""
Jul 23 10:38:12.298500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.298383    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bc0d57\"/\"kube-root-ca.crt\""
Jul 23 10:38:12.308809 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.308784    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"]
Jul 23 10:38:12.403125 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.403083    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-model-cache\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.403358 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.403133    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-home\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.403358 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.403208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5zs4\" (UniqueName: \"kubernetes.io/projected/a8967c55-d697-48a9-998a-95e75e687b3e-kube-api-access-h5zs4\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.403358 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.403294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-dshm\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.403358 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.403350    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8967c55-d697-48a9-998a-95e75e687b3e-tls-certs\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.403531 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.403439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-tmp-dir\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.504623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.504583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5zs4\" (UniqueName: \"kubernetes.io/projected/a8967c55-d697-48a9-998a-95e75e687b3e-kube-api-access-h5zs4\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.504623 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.504630    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-dshm\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.504907 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.504664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8967c55-d697-48a9-998a-95e75e687b3e-tls-certs\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.504907 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.504700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-tmp-dir\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.504907 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.504760    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-model-cache\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.504907 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.504783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-home\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.505192 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.505162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-tmp-dir\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.505298 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.505196    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-model-cache\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.505298 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.505266    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-home\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.507162 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.507134    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-dshm\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.507411 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.507392    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8967c55-d697-48a9-998a-95e75e687b3e-tls-certs\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.514034 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.514011    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5zs4\" (UniqueName: \"kubernetes.io/projected/a8967c55-d697-48a9-998a-95e75e687b3e-kube-api-access-h5zs4\") pod \"rate-test-model-bc0d57-kserve-76b94ddc47-lr54x\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") " pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.604337 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.604306    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:12.742102 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:12.742074    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"]
Jul 23 10:38:12.743570 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:38:12.743542    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8967c55_d697_48a9_998a_95e75e687b3e.slice/crio-90254ea88f0c8a7348435d9aab26da1a7574c4bc852b08c8e0ea4f8cc33a51b8 WatchSource:0}: Error finding container 90254ea88f0c8a7348435d9aab26da1a7574c4bc852b08c8e0ea4f8cc33a51b8: Status 404 returned error can't find the container with id 90254ea88f0c8a7348435d9aab26da1a7574c4bc852b08c8e0ea4f8cc33a51b8
Jul 23 10:38:13.223834 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:13.223795    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x" event={"ID":"a8967c55-d697-48a9-998a-95e75e687b3e","Type":"ContainerStarted","Data":"483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d"}
Jul 23 10:38:13.223834 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:13.223839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x" event={"ID":"a8967c55-d697-48a9-998a-95e75e687b3e","Type":"ContainerStarted","Data":"90254ea88f0c8a7348435d9aab26da1a7574c4bc852b08c8e0ea4f8cc33a51b8"}
Jul 23 10:38:13.243782 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:13.243734    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x" podStartSLOduration=1.24371763 podStartE2EDuration="1.24371763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:38:13.241924211 +0000 UTC m=+2617.480119463" watchObservedRunningTime="2026-07-23 10:38:13.24371763 +0000 UTC m=+2617.481912882"
Jul 23 10:38:22.604863 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:22.604824    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:22.605470 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:22.604880    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:22.617558 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:22.617524    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:23.294193 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:23.294164    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:38:53.704264 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:38:53.704212    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"]
Jul 23 10:39:08.724977 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:08.724935    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x" podUID="a8967c55-d697-48a9-998a-95e75e687b3e" containerName="main" containerID="cri-o://483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d" gracePeriod=45
Jul 23 10:39:08.988646 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:08.988574    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:39:09.141329 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141297    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5zs4\" (UniqueName: \"kubernetes.io/projected/a8967c55-d697-48a9-998a-95e75e687b3e-kube-api-access-h5zs4\") pod \"a8967c55-d697-48a9-998a-95e75e687b3e\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") "
Jul 23 10:39:09.141329 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141334    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8967c55-d697-48a9-998a-95e75e687b3e-tls-certs\") pod \"a8967c55-d697-48a9-998a-95e75e687b3e\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") "
Jul 23 10:39:09.141579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141354    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-tmp-dir\") pod \"a8967c55-d697-48a9-998a-95e75e687b3e\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") "
Jul 23 10:39:09.141579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141398    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-home\") pod \"a8967c55-d697-48a9-998a-95e75e687b3e\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") "
Jul 23 10:39:09.141579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141492    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-dshm\") pod \"a8967c55-d697-48a9-998a-95e75e687b3e\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") "
Jul 23 10:39:09.141579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141548    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-model-cache\") pod \"a8967c55-d697-48a9-998a-95e75e687b3e\" (UID: \"a8967c55-d697-48a9-998a-95e75e687b3e\") "
Jul 23 10:39:09.141803 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141651    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8967c55-d697-48a9-998a-95e75e687b3e" (UID: "a8967c55-d697-48a9-998a-95e75e687b3e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:09.141803 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141727    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-home" (OuterVolumeSpecName: "home") pod "a8967c55-d697-48a9-998a-95e75e687b3e" (UID: "a8967c55-d697-48a9-998a-95e75e687b3e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:09.141902 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141872    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8967c55-d697-48a9-998a-95e75e687b3e" (UID: "a8967c55-d697-48a9-998a-95e75e687b3e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:09.142016 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.141995    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-model-cache\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:09.142109 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.142043    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-tmp-dir\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:09.142109 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.142056    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-home\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:09.143661 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.143639    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8967c55-d697-48a9-998a-95e75e687b3e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8967c55-d697-48a9-998a-95e75e687b3e" (UID: "a8967c55-d697-48a9-998a-95e75e687b3e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:39:09.143755 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.143709    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-dshm" (OuterVolumeSpecName: "dshm") pod "a8967c55-d697-48a9-998a-95e75e687b3e" (UID: "a8967c55-d697-48a9-998a-95e75e687b3e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:09.143755 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.143722    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8967c55-d697-48a9-998a-95e75e687b3e-kube-api-access-h5zs4" (OuterVolumeSpecName: "kube-api-access-h5zs4") pod "a8967c55-d697-48a9-998a-95e75e687b3e" (UID: "a8967c55-d697-48a9-998a-95e75e687b3e"). InnerVolumeSpecName "kube-api-access-h5zs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:39:09.243394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.243308    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8967c55-d697-48a9-998a-95e75e687b3e-dshm\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:09.243394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.243337    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5zs4\" (UniqueName: \"kubernetes.io/projected/a8967c55-d697-48a9-998a-95e75e687b3e-kube-api-access-h5zs4\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:09.243394 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.243348    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8967c55-d697-48a9-998a-95e75e687b3e-tls-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:09.514889 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.514798    2567 generic.go:356] "Generic (PLEG): container finished" podID="a8967c55-d697-48a9-998a-95e75e687b3e" containerID="483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d" exitCode=0
Jul 23 10:39:09.514889 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.514838    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"
Jul 23 10:39:09.515097 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.514883    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x" event={"ID":"a8967c55-d697-48a9-998a-95e75e687b3e","Type":"ContainerDied","Data":"483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d"}
Jul 23 10:39:09.515097 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.514926    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x" event={"ID":"a8967c55-d697-48a9-998a-95e75e687b3e","Type":"ContainerDied","Data":"90254ea88f0c8a7348435d9aab26da1a7574c4bc852b08c8e0ea4f8cc33a51b8"}
Jul 23 10:39:09.515097 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.514943    2567 scope.go:117] "RemoveContainer" containerID="483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d"
Jul 23 10:39:09.524077 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.524060    2567 scope.go:117] "RemoveContainer" containerID="483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d"
Jul 23 10:39:09.524363 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:39:09.524346    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d\": container with ID starting with 483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d not found: ID does not exist" containerID="483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d"
Jul 23 10:39:09.524445 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.524371    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d"} err="failed to get container status \"483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d\": rpc error: code = NotFound desc = could not find container \"483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d\": container with ID starting with 483b8ac72694d34da4803a9856254f994b852e62ebc418d685ee975a3aa1ad5d not found: ID does not exist"
Jul 23 10:39:09.536945 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.536918    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"]
Jul 23 10:39:09.543130 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:09.543107    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bc0d57/rate-test-model-bc0d57-kserve-76b94ddc47-lr54x"]
Jul 23 10:39:10.231651 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:10.231619    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8967c55-d697-48a9-998a-95e75e687b3e" path="/var/lib/kubelet/pods/a8967c55-d697-48a9-998a-95e75e687b3e/volumes"
Jul 23 10:39:34.875824 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:34.875794    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"]
Jul 23 10:39:34.876370 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:34.875999    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy" containerID="cri-o://84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640" gracePeriod=30
Jul 23 10:39:36.410941 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:36.410912    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:39:36.424579 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:36.424550    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:39:40.140761 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.140692    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:39:40.237320 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237293    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-credential-socket\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237478 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237340    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-socket\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237478 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237381    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64db815f-c171-42e7-ac37-3ca616c3537a-istiod-ca-cert\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237478 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237401    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-data\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237478 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6rtx\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-kube-api-access-d6rtx\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237478 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237447    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-certs\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237478 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237465    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64db815f-c171-42e7-ac37-3ca616c3537a-istio-podinfo\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237816 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237535    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-envoy\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237816 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237570    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-istio-token\") pod \"64db815f-c171-42e7-ac37-3ca616c3537a\" (UID: \"64db815f-c171-42e7-ac37-3ca616c3537a\") "
Jul 23 10:39:40.237816 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237569    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:40.237816 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237798    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:40.238032 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237817    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:40.238032 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237862    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64db815f-c171-42e7-ac37-3ca616c3537a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:39:40.238032 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237931    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64db815f-c171-42e7-ac37-3ca616c3537a-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.238032 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237948    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.238032 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237962    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.238032 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.237977    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.238556 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.238532    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-data" (OuterVolumeSpecName: "istio-data") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:40.239925 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.239895    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-kube-api-access-d6rtx" (OuterVolumeSpecName: "kube-api-access-d6rtx") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "kube-api-access-d6rtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:39:40.240041 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.239935    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64db815f-c171-42e7-ac37-3ca616c3537a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:39:40.240041 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.239978    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-istio-token" (OuterVolumeSpecName: "istio-token") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:39:40.240041 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.240030    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64db815f-c171-42e7-ac37-3ca616c3537a" (UID: "64db815f-c171-42e7-ac37-3ca616c3537a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:40.338848 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.338810    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.338848 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.338850    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.338848 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.338862    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64db815f-c171-42e7-ac37-3ca616c3537a-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.339184 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.338876    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6rtx\" (UniqueName: \"kubernetes.io/projected/64db815f-c171-42e7-ac37-3ca616c3537a-kube-api-access-d6rtx\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.339184 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.338889    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64db815f-c171-42e7-ac37-3ca616c3537a-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:39:40.679161 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.679131    2567 generic.go:356] "Generic (PLEG): container finished" podID="64db815f-c171-42e7-ac37-3ca616c3537a" containerID="84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640" exitCode=0
Jul 23 10:39:40.679362 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.679179    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"
Jul 23 10:39:40.679362 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.679224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" event={"ID":"64db815f-c171-42e7-ac37-3ca616c3537a","Type":"ContainerDied","Data":"84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640"}
Jul 23 10:39:40.679362 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.679285    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n" event={"ID":"64db815f-c171-42e7-ac37-3ca616c3537a","Type":"ContainerDied","Data":"7162c62522999e076499bb7e588168aa314bfec13639d05af607a040bfd72c91"}
Jul 23 10:39:40.679362 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.679307    2567 scope.go:117] "RemoveContainer" containerID="84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640"
Jul 23 10:39:40.688645 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.688628    2567 scope.go:117] "RemoveContainer" containerID="b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e"
Jul 23 10:39:40.697053 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.697034    2567 scope.go:117] "RemoveContainer" containerID="84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640"
Jul 23 10:39:40.697322 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:39:40.697305    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640\": container with ID starting with 84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640 not found: ID does not exist" containerID="84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640"
Jul 23 10:39:40.697372 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.697330    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640"} err="failed to get container status \"84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640\": rpc error: code = NotFound desc = could not find container \"84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640\": container with ID starting with 84498d6ba9cd038de0d224e81b61ce2f8fce42eb638db69da077bc90cabb0640 not found: ID does not exist"
Jul 23 10:39:40.697372 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.697346    2567 scope.go:117] "RemoveContainer" containerID="b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e"
Jul 23 10:39:40.697557 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:39:40.697538    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e\": container with ID starting with b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e not found: ID does not exist" containerID="b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e"
Jul 23 10:39:40.697599 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.697565    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e"} err="failed to get container status \"b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e\": rpc error: code = NotFound desc = could not find container \"b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e\": container with ID starting with b790688b9ac94ed07ff3d8b938d200330bc2c1f4931800a7c0527ff455bc863e not found: ID does not exist"
Jul 23 10:39:40.701557 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.701536    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"]
Jul 23 10:39:40.705774 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:40.705754    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d0ac3e-openshift-default-5cd86dbdf5-jkm7n"]
Jul 23 10:39:42.231208 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:42.231173    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" path="/var/lib/kubelet/pods/64db815f-c171-42e7-ac37-3ca616c3537a/volumes"
Jul 23 10:39:56.780535 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:56.780503    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"]
Jul 23 10:39:56.781048 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:39:56.780698    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy" containerID="cri-o://77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e" gracePeriod=30
Jul 23 10:40:02.036668 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.036642    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:40:02.154626 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154585    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4ktt\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-kube-api-access-r4ktt\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.154814 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154634    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-certs\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.154814 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154661    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-token\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.154814 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154679    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-credential-socket\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.154814 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154789    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-podinfo\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.155030 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154832    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-socket\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.155030 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154879    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28ce714-0cc9-472a-aacd-be337afa70f7-istiod-ca-cert\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.155030 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154918    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-envoy\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.155030 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.154921    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:40:02.155030 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.155015    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:40:02.155340 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.155047    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-data\") pod \"b28ce714-0cc9-472a-aacd-be337afa70f7\" (UID: \"b28ce714-0cc9-472a-aacd-be337afa70f7\") "
Jul 23 10:40:02.155340 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.155216    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:40:02.155340 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.155288    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b28ce714-0cc9-472a-aacd-be337afa70f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:40:02.155494 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.155438    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-certs\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.155494 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.155469    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-credential-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.155494 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.155482    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-workload-socket\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.155818 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.155497    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b28ce714-0cc9-472a-aacd-be337afa70f7-istiod-ca-cert\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.156211 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.156185    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:40:02.157221 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.157200    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:40:02.157332 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.157253    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 10:40:02.157483 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.157466    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-kube-api-access-r4ktt" (OuterVolumeSpecName: "kube-api-access-r4ktt") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "kube-api-access-r4ktt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:40:02.157538 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.157492    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "b28ce714-0cc9-472a-aacd-be337afa70f7" (UID: "b28ce714-0cc9-472a-aacd-be337afa70f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:40:02.256745 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.256713    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-token\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.256745 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.256743    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-podinfo\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.256745 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.256752    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-envoy\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.256971 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.256760    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b28ce714-0cc9-472a-aacd-be337afa70f7-istio-data\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.256971 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.256770    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4ktt\" (UniqueName: \"kubernetes.io/projected/b28ce714-0cc9-472a-aacd-be337afa70f7-kube-api-access-r4ktt\") on node \"ip-10-0-141-125.ec2.internal\" DevicePath \"\""
Jul 23 10:40:02.787915 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.787875    2567 generic.go:356] "Generic (PLEG): container finished" podID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerID="77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e" exitCode=0
Jul 23 10:40:02.788097 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.787933    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"
Jul 23 10:40:02.788097 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.787944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" event={"ID":"b28ce714-0cc9-472a-aacd-be337afa70f7","Type":"ContainerDied","Data":"77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e"}
Jul 23 10:40:02.788097 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.787992    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj" event={"ID":"b28ce714-0cc9-472a-aacd-be337afa70f7","Type":"ContainerDied","Data":"2e038fc8a01d185c2c27d108ae8472630dc83deeb11ce711889fe82853ddfd8c"}
Jul 23 10:40:02.788097 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.788015    2567 scope.go:117] "RemoveContainer" containerID="77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e"
Jul 23 10:40:02.797143 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.797122    2567 scope.go:117] "RemoveContainer" containerID="3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3"
Jul 23 10:40:02.805760 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.805738    2567 scope.go:117] "RemoveContainer" containerID="77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e"
Jul 23 10:40:02.806389 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:40:02.806174    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e\": container with ID starting with 77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e not found: ID does not exist" containerID="77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e"
Jul 23 10:40:02.806389 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.806211    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e"} err="failed to get container status \"77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e\": rpc error: code = NotFound desc = could not find container \"77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e\": container with ID starting with 77eec32bd85c458a72ee980d96b91e1ca8cd82e210f219a21916ac58efabdf2e not found: ID does not exist"
Jul 23 10:40:02.806389 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.806273    2567 scope.go:117] "RemoveContainer" containerID="3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3"
Jul 23 10:40:02.806613 ip-10-0-141-125 kubenswrapper[2567]: E0723 10:40:02.806573    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3\": container with ID starting with 3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3 not found: ID does not exist" containerID="3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3"
Jul 23 10:40:02.806613 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.806602    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3"} err="failed to get container status \"3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3\": rpc error: code = NotFound desc = could not find container \"3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3\": container with ID starting with 3462693f4c4ffda0f1f4d2736c7626f829b1eee20785f18f3a7db834c455f2b3 not found: ID does not exist"
Jul 23 10:40:02.808225 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.808206    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"]
Jul 23 10:40:02.812607 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:02.812586    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-bc0d57-openshift-default-5bbfc559ff-rfjlj"]
Jul 23 10:40:03.329535 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:03.329496    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hmngd_66bee048-f2c2-49c1-bf31-b1421dc5ab15/server/0.log"
Jul 23 10:40:03.836891 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:03.836862    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bc8b458c-xpkjw_d110948b-a9a5-48bb-8b83-84cb34b56c49/copy-manifests/0.log"
Jul 23 10:40:03.844636 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:03.844611    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bc8b458c-xpkjw_d110948b-a9a5-48bb-8b83-84cb34b56c49/manager/0.log"
Jul 23 10:40:04.231296 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:04.231257    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" path="/var/lib/kubelet/pods/b28ce714-0cc9-472a-aacd-be337afa70f7/volumes"
Jul 23 10:40:04.328959 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:04.328929    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746695-4mp2d_0a8eaf5f-2692-418a-8d82-8c375996ef06/cleanup/0.log"
Jul 23 10:40:07.187063 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:07.187032    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48qbkd_1a44011e-4093-4f3c-bc5a-5049ff4faaed/istio-proxy/0.log"
Jul 23 10:40:07.307401 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:07.307373    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qks6l_29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57/discovery/0.log"
Jul 23 10:40:07.660383 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:07.660352    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qbb77_a7ee7728-74b0-44f9-8571-5312875dbc60/istio-proxy/1.log"
Jul 23 10:40:08.051532 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:08.051440    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6fb8b4bb-rcggg_2b55c9a2-3b56-4a4f-823e-d63f3fad1631/router/0.log"
Jul 23 10:40:08.509746 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:08.509711    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bnfd2_5a98ecb1-4714-4cf1-891b-7d38f33168c7/main/0.log"
Jul 23 10:40:17.129056 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:17.129019    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-469fj_1946fb9c-00aa-446d-be1e-cecb14f56b61/global-pull-secret-syncer/0.log"
Jul 23 10:40:17.369469 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:17.369437    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gw6j9_12ded5c6-48c0-41af-ab5a-6235eba9d5e9/konnectivity-agent/0.log"
Jul 23 10:40:17.435028 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:17.434918    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-125.ec2.internal_3bc2b0ba399541b1dd777c069fca6d48/haproxy/0.log"
Jul 23 10:40:25.114390 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.114364    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64a7b292-66be-4ab1-8295-2b7cc9bc86b3/alertmanager/0.log"
Jul 23 10:40:25.142567 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.142535    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64a7b292-66be-4ab1-8295-2b7cc9bc86b3/config-reloader/0.log"
Jul 23 10:40:25.171968 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.171933    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64a7b292-66be-4ab1-8295-2b7cc9bc86b3/kube-rbac-proxy-web/0.log"
Jul 23 10:40:25.199159 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.199128    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64a7b292-66be-4ab1-8295-2b7cc9bc86b3/kube-rbac-proxy/0.log"
Jul 23 10:40:25.222430 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.222401    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64a7b292-66be-4ab1-8295-2b7cc9bc86b3/kube-rbac-proxy-metric/0.log"
Jul 23 10:40:25.249946 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.249916    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64a7b292-66be-4ab1-8295-2b7cc9bc86b3/prom-label-proxy/0.log"
Jul 23 10:40:25.275759 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.275731    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_64a7b292-66be-4ab1-8295-2b7cc9bc86b3/init-config-reloader/0.log"
Jul 23 10:40:25.327229 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.327197    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-hrp9f_d4fc16e2-347d-4676-afe3-7b39abdf7a5f/cluster-monitoring-operator/0.log"
Jul 23 10:40:25.503274 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.503177    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-5stpl_e0feff49-89d4-4e59-83b8-963e565b7466/monitoring-plugin/0.log"
Jul 23 10:40:25.713102 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.713068    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwzjw_570ebf96-4a6e-45b0-bbe1-03b33c1ce06a/node-exporter/0.log"
Jul 23 10:40:25.755737 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.755668    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwzjw_570ebf96-4a6e-45b0-bbe1-03b33c1ce06a/kube-rbac-proxy/0.log"
Jul 23 10:40:25.788517 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.788493    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nwzjw_570ebf96-4a6e-45b0-bbe1-03b33c1ce06a/init-textfile/0.log"
Jul 23 10:40:25.837833 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.837809    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-twgs4_f682521f-36cb-4fb1-a409-9392e9d9286f/kube-rbac-proxy-main/0.log"
Jul 23 10:40:25.880358 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.880328    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-twgs4_f682521f-36cb-4fb1-a409-9392e9d9286f/kube-rbac-proxy-self/0.log"
Jul 23 10:40:25.943094 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:25.943067    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-twgs4_f682521f-36cb-4fb1-a409-9392e9d9286f/openshift-state-metrics/0.log"
Jul 23 10:40:26.286964 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:26.286938    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6974b7cf9b-bn496_64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed/telemeter-client/0.log"
Jul 23 10:40:26.330787 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:26.330758    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6974b7cf9b-bn496_64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed/reload/0.log"
Jul 23 10:40:26.386744 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:26.386710    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6974b7cf9b-bn496_64790b8e-9e9d-4e67-b1b6-30e98e0fe0ed/kube-rbac-proxy/0.log"
Jul 23 10:40:27.822956 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.822927    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-8wlsw_59d64ea9-f7cc-4292-947a-f905ff9f039a/networking-console-plugin/0.log"
Jul 23 10:40:27.868146 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868112    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"]
Jul 23 10:40:27.868492 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868477    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy"
Jul 23 10:40:27.868550 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868493    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy"
Jul 23 10:40:27.868550 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868507    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy"
Jul 23 10:40:27.868550 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868512    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy"
Jul 23 10:40:27.868550 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868521    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy"
Jul 23 10:40:27.868550 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868526    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy"
Jul 23 10:40:27.868550 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868536    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8967c55-d697-48a9-998a-95e75e687b3e" containerName="main"
Jul 23 10:40:27.868550 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868541    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8967c55-d697-48a9-998a-95e75e687b3e" containerName="main"
Jul 23 10:40:27.868763 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868600    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy"
Jul 23 10:40:27.868763 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868609    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy"
Jul 23 10:40:27.868763 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868616    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b28ce714-0cc9-472a-aacd-be337afa70f7" containerName="istio-proxy"
Jul 23 10:40:27.868763 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868623    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="64db815f-c171-42e7-ac37-3ca616c3537a" containerName="istio-proxy"
Jul 23 10:40:27.868763 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.868630    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8967c55-d697-48a9-998a-95e75e687b3e" containerName="main"
Jul 23 10:40:27.871891 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.871872    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:27.875087 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.875070    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjjkv\"/\"kube-root-ca.crt\""
Jul 23 10:40:27.875271 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.875228    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zjjkv\"/\"default-dockercfg-7rpwf\""
Jul 23 10:40:27.876345 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.876328    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjjkv\"/\"openshift-service-ca.crt\""
Jul 23 10:40:27.880125 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.880101    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"]
Jul 23 10:40:27.998664 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.998576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-sys\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:27.998664 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.998629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-podres\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:27.998664 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.998652    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vk66\" (UniqueName: \"kubernetes.io/projected/2f3848d2-d10c-489a-b621-0f75b45bca4c-kube-api-access-5vk66\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:27.998892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.998693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-lib-modules\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:27.998892 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:27.998721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-proc\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.099586 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-sys\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.099776 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099602    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-podres\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.099776 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vk66\" (UniqueName: \"kubernetes.io/projected/2f3848d2-d10c-489a-b621-0f75b45bca4c-kube-api-access-5vk66\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.099776 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099669    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-lib-modules\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.099776 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-sys\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.099776 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099714    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-proc\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.099776 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-podres\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.100091 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-proc\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.100091 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.099809    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f3848d2-d10c-489a-b621-0f75b45bca4c-lib-modules\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.108496 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.108467    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vk66\" (UniqueName: \"kubernetes.io/projected/2f3848d2-d10c-489a-b621-0f75b45bca4c-kube-api-access-5vk66\") pod \"perf-node-gather-daemonset-9ffqr\" (UID: \"2f3848d2-d10c-489a-b621-0f75b45bca4c\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.182567 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.182534    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.318443 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.318387    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"]
Jul 23 10:40:28.320668 ip-10-0-141-125 kubenswrapper[2567]: W0723 10:40:28.320638    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2f3848d2_d10c_489a_b621_0f75b45bca4c.slice/crio-aa6a5b50c70385d2bfe780d923c10008a4807c9756f99577d373f27310d70eef WatchSource:0}: Error finding container aa6a5b50c70385d2bfe780d923c10008a4807c9756f99577d373f27310d70eef: Status 404 returned error can't find the container with id aa6a5b50c70385d2bfe780d923c10008a4807c9756f99577d373f27310d70eef
Jul 23 10:40:28.494419 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.494370    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/2.log"
Jul 23 10:40:28.502260 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.502215    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2hvdb_7750c8de-1209-4e09-a4ba-720eb375f07b/console-operator/3.log"
Jul 23 10:40:28.915414 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.915384    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr" event={"ID":"2f3848d2-d10c-489a-b621-0f75b45bca4c","Type":"ContainerStarted","Data":"be26816947f78afe3877735c7bab8f3b8bd44a6ac7f383014a195bb87f561d9d"}
Jul 23 10:40:28.915910 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.915430    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr" event={"ID":"2f3848d2-d10c-489a-b621-0f75b45bca4c","Type":"ContainerStarted","Data":"aa6a5b50c70385d2bfe780d923c10008a4807c9756f99577d373f27310d70eef"}
Jul 23 10:40:28.915910 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.915485    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:28.933264 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:28.933191    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr" podStartSLOduration=1.933169823 podStartE2EDuration="1.933169823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 10:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:40:28.932099518 +0000 UTC m=+2753.170294772" watchObservedRunningTime="2026-07-23 10:40:28.933169823 +0000 UTC m=+2753.171365076"
Jul 23 10:40:29.587337 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:29.587311    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-dbbg7_ca3e4373-64d7-4e96-83be-9a439763d123/volume-data-source-validator/0.log"
Jul 23 10:40:30.745408 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:30.745371    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xn2qz_96cceed0-f182-475b-9410-18f174240014/dns/0.log"
Jul 23 10:40:30.764598 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:30.764573    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xn2qz_96cceed0-f182-475b-9410-18f174240014/kube-rbac-proxy/0.log"
Jul 23 10:40:30.839174 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:30.839145    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xtvrq_e7bdd090-55e9-44f4-b09f-17021a14f169/dns-node-resolver/0.log"
Jul 23 10:40:31.401609 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:31.401581    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g8pml_90f3e1db-0b1f-497a-af08-c6d7587c7c8b/node-ca/0.log"
Jul 23 10:40:32.397842 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:32.397816    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48qbkd_1a44011e-4093-4f3c-bc5a-5049ff4faaed/istio-proxy/0.log"
Jul 23 10:40:32.621312 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:32.621279    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qks6l_29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57/discovery/0.log"
Jul 23 10:40:32.693206 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:32.693118    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qbb77_a7ee7728-74b0-44f9-8571-5312875dbc60/istio-proxy/0.log"
Jul 23 10:40:32.744648 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:32.744615    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qbb77_a7ee7728-74b0-44f9-8571-5312875dbc60/istio-proxy/1.log"
Jul 23 10:40:32.845536 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:32.845503    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6fb8b4bb-rcggg_2b55c9a2-3b56-4a4f-823e-d63f3fad1631/router/0.log"
Jul 23 10:40:33.519298 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:33.519272    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jqh8v_f3a8e806-0afc-4058-9116-cca6bfde7d98/serve-healthcheck-canary/0.log"
Jul 23 10:40:34.075138 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:34.075100    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-dpdjn_8ab152ad-c1e0-43a3-907b-6db993bbabf7/insights-operator/0.log"
Jul 23 10:40:34.076385 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:34.076366    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-dpdjn_8ab152ad-c1e0-43a3-907b-6db993bbabf7/insights-operator/1.log"
Jul 23 10:40:34.237208 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:34.237179    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjhk5_7bed865b-e7a5-420d-ac41-9fab6d00035b/kube-rbac-proxy/0.log"
Jul 23 10:40:34.260764 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:34.260742    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjhk5_7bed865b-e7a5-420d-ac41-9fab6d00035b/exporter/0.log"
Jul 23 10:40:34.284621 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:34.284593    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjhk5_7bed865b-e7a5-420d-ac41-9fab6d00035b/extractor/0.log"
Jul 23 10:40:34.932156 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:34.932129    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-9ffqr"
Jul 23 10:40:37.070059 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:37.070035    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hmngd_66bee048-f2c2-49c1-bf31-b1421dc5ab15/server/0.log"
Jul 23 10:40:37.437689 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:37.437657    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bc8b458c-xpkjw_d110948b-a9a5-48bb-8b83-84cb34b56c49/manager/0.log"
Jul 23 10:40:37.475319 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:37.475297    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bc8b458c-xpkjw_d110948b-a9a5-48bb-8b83-84cb34b56c49/copy-manifests/0.log"
Jul 23 10:40:38.361609 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:38.361575    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48qbkd_1a44011e-4093-4f3c-bc5a-5049ff4faaed/istio-proxy/0.log"
Jul 23 10:40:38.580330 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:38.580304    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qks6l_29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57/discovery/0.log"
Jul 23 10:40:38.628119 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:38.628019    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qbb77_a7ee7728-74b0-44f9-8571-5312875dbc60/istio-proxy/0.log"
Jul 23 10:40:38.678374 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:38.678348    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qbb77_a7ee7728-74b0-44f9-8571-5312875dbc60/istio-proxy/1.log"
Jul 23 10:40:38.763459 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:38.763428    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6fb8b4bb-rcggg_2b55c9a2-3b56-4a4f-823e-d63f3fad1631/router/0.log"
Jul 23 10:40:38.817403 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:38.817366    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d6fb6dcb8-fg6d8_f497a3d1-789e-425a-82ad-9b5d5947d0f7/manager/0.log"
Jul 23 10:40:40.077732 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:40.077698    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48qbkd_1a44011e-4093-4f3c-bc5a-5049ff4faaed/istio-proxy/0.log"
Jul 23 10:40:40.297934 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:40.297903    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qks6l_29400b28-3f7c-4cd0-8dd7-c3d7ea9bed57/discovery/0.log"
Jul 23 10:40:40.350506 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:40.350390    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qbb77_a7ee7728-74b0-44f9-8571-5312875dbc60/istio-proxy/0.log"
Jul 23 10:40:40.402625 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:40.402587    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qbb77_a7ee7728-74b0-44f9-8571-5312875dbc60/istio-proxy/1.log"
Jul 23 10:40:40.482345 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:40.482319    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b6fb8b4bb-rcggg_2b55c9a2-3b56-4a4f-823e-d63f3fad1631/router/0.log"
Jul 23 10:40:44.251500 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:44.251399    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-w9gfw_f117bef5-3c98-4c4f-a337-9459f67cd78f/kube-storage-version-migrator-operator/1.log"
Jul 23 10:40:44.253100 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:44.253073    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-w9gfw_f117bef5-3c98-4c4f-a337-9459f67cd78f/kube-storage-version-migrator-operator/0.log"
Jul 23 10:40:45.279283 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:45.279257    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bzr5_350c77c7-2f2a-4516-943b-446441017528/kube-multus-additional-cni-plugins/0.log"
Jul 23 10:40:45.301383 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:45.301360    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bzr5_350c77c7-2f2a-4516-943b-446441017528/egress-router-binary-copy/0.log"
Jul 23 10:40:45.323110 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:45.323086    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bzr5_350c77c7-2f2a-4516-943b-446441017528/cni-plugins/0.log"
Jul 23 10:40:45.343571 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:45.343542    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bzr5_350c77c7-2f2a-4516-943b-446441017528/bond-cni-plugin/0.log"
Jul 23 10:40:45.363694 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:45.363670    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bzr5_350c77c7-2f2a-4516-943b-446441017528/routeoverride-cni/0.log"
Jul 23 10:40:45.382923 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:45.382896    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bzr5_350c77c7-2f2a-4516-943b-446441017528/whereabouts-cni-bincopy/0.log"
Jul 23 10:40:45.402409 ip-10-0-141-125 kubenswrapper[2567]: I0723 10:40:45.402383    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5bzr5_350c77c7-2f2a-4516-943b-446441017528/whereabouts-cni/0.log"